-- Logs begin at Thu 2022-08-04 21:08:19 UTC, end at Fri 2022-08-05 00:04:00 UTC. -- Aug 04 23:04:15.112041 dv-cinder-852210-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 23:04:15.121277 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 23:04:15.123114 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 23:04:15 2022] *** Aug 04 23:04:15.123114 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 23:04:15.123114 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 23:04:15.123114 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: nodename: dv-cinder-852210-1-iscsi Aug 04 23:04:15.123114 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: machine: x86_64 Aug 04 23:04:15.123114 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: clock source: unix Aug 04 23:04:15.123114 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: pcre jit disabled Aug 04 23:04:15.123114 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: detected number of CPU cores: 4 Aug 04 23:04:15.123114 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: current working directory: / Aug 04 23:04:15.123114 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: detected binary path: /usr/bin/uwsgi-core Aug 04 23:04:15.123710 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: your processes number limit is 47680 Aug 04 23:04:15.123710 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: your memory page size is 4096 bytes Aug 04 23:04:15.123710 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: detected max file descriptor number: 2048 Aug 04 23:04:15.123710 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: lock engine: pthread robust mutexes Aug 04 23:04:15.123710 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: thunder lock: enabled Aug 04 23:04:15.123710 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 23:04:15.123710 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 23:04:15.163788 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: Python main interpreter initialized at 0x55cae9bdc9c0 Aug 04 23:04:15.163788 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: python threads support enabled Aug 04 23:04:15.163788 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: your server socket listen backlog is limited to 100 connections Aug 04 23:04:15.163788 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: your mercy for graceful operations on workers is 90 seconds Aug 04 23:04:15.164334 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 23:04:15.164334 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: *** Operational MODE: preforking *** Aug 04 23:04:15.166704 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: *** uWSGI is running in multiple interpreter mode *** Aug 04 23:04:15.166704 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: spawned uWSGI master process (pid: 115263) Aug 04 23:04:15.166704 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: spawned uWSGI worker 1 (pid: 115264, cores: 1) Aug 04 23:04:15.166704 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: spawned uWSGI worker 2 (pid: 115265, cores: 1) Aug 04 23:04:15.166704 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 23:04:15.164647 dv-cinder-852210-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 23:04:15.835877 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 23:04:15.843395 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 23:04:16.943705 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 23:04:16.943705 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: from cryptography.utils import int_from_bytes Aug 04 23:04:16.944387 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 23:04:16.944387 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: from cryptography.utils import int_from_bytes Aug 04 23:04:16.948939 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 23:04:16.948939 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: from cryptography.utils import int_from_bytes Aug 04 23:04:16.949371 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 23:04:16.949371 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: from cryptography.utils import int_from_bytes Aug 04 23:04:19.505354 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 23:04:19.506020 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 23:04:19.506112 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 23:04:19.506518 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 23:04:19.506777 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 23:04:19.507042 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 23:04:19.507399 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.507469 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 23:04:19.507546 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.507777 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.507882 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 23:04:19.508100 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.508202 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 23:04:19.508419 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 23:04:19.508522 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.508728 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.508830 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.509049 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.509141 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.509371 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.509464 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.509699 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.509794 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.509967 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.510075 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.510282 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.510413 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.510636 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-1-iscsi {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.510745 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.510960 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.511071 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.511270 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.511370 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.511558 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.511709 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.511877 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.512037 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.512178 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.512326 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-1-iscsi {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.512472 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.512614 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.513355 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.513469 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.513841 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.514122 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.514321 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.514511 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.514662 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.514810 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.514973 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.515121 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.515285 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.515437 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.515591 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.515731 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.515892 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.516032 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.516178 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.516326 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.516472 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.516630 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.516776 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.516929 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.517070 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.517294 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.517437 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.517581 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-1-iscsi {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.517728 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.517924 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.518078 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.518224 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.518389 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.518545 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.518706 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.518858 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.519010 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-1-iscsi {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.519161 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.519310 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.519459 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.519628 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.519776 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.519926 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.520068 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.520296 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.520467 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.520695 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.520849 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.521017 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.521232 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.521384 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.521526 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.521665 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.521810 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.521959 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.522099 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.522246 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.522485 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.522633 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.522794 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.522944 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.523094 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.523235 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.523374 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.523520 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.523678 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.523819 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.523967 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.524114 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.524255 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.524394 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.524556 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.524704 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.524850 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.524996 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.525147 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.525299 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.525454 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.525603 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.525746 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.525885 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.526031 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.526189 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.526351 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.526535 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.526674 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.526818 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.526973 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.527122 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.527270 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.527420 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.527566 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.527713 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.527866 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.528065 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.528206 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.528968 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.529356 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.529505 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.529662 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.529662 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.529939 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.530079 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.530225 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.530486 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.530644 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.530872 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.531040 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.531180 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.531409 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.531573 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.531717 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.531857 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.532002 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.532143 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.532281 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.532429 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.532569 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.532718 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.532869 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.533008 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.533155 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.533307 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.533448 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.533593 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.533744 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.533892 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.534041 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.534188 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.534335 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.534497 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.534647 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.534799 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.534951 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.535091 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.535231 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.535377 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.535523 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.535669 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.535823 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.535969 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.536109 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.536255 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.536395 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.536534 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.536692 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.536841 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.536987 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.537127 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.537267 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.537413 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.537564 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.537710 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.537851 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.538034 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.538181 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.538330 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.538518 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.538683 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.538824 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.538965 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.539116 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.539269 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.539410 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.539558 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.539715 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.539856 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.540002 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.540156 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.540296 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.540453 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.540678 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.540822 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.541047 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.541209 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.541349 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.541576 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.541723 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.541870 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.542022 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.542163 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.542309 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.542472 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.542636 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.542777 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.542924 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.543144 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.543287 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.543426 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.543577 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.543724 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.543886 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.544064 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.544208 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.544355 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.544495 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.544657 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.544798 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.544945 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.545086 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.545232 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.545372 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.545523 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.545680 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.545831 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.545980 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.546120 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.546259 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.546468 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.546637 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.546784 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.546932 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.547080 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.547233 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.547375 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.547524 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.547664 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.547803 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.547941 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.548135 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.548280 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.548434 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.548584 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.548724 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.548869 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.549009 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.549162 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.549303 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.549443 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.549582 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.549731 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.549881 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.550030 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.550179 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.550319 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.550504 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.550664 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.550884 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.551057 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.551219 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.551366 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.551512 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.551734 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.551880 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.552029 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.552176 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.552315 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.552475 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.552624 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:04:19.552773 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.552921 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.553060 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.553200 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.553338 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.553477 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.553625 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.553765 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.553904 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.554050 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.554191 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.554346 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.554560 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.554740 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.554882 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.555021 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.555168 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.555317 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.555456 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.555602 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.555750 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.555750 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.556022 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.556180 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.556321 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.556484 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.556634 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.556783 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.556933 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.557073 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.557220 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.557372 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.557512 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.557658 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.557797 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.557946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.558103 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.558286 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.558454 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.558597 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.558736 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.558736 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.559015 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.559015 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.559286 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.559432 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.559631 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.559631 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.560082 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.560082 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.560504 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.560703 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.560923 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.561152 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.561300 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.561448 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.561590 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.561748 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.561980 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.562128 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.562268 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.562463 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.562610 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.562750 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.562911 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.563053 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.563193 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.563340 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.563480 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.563619 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.563766 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.563906 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.564045 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.564185 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.564334 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.564474 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.564695 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.564846 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.564993 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.565132 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.565273 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.565420 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.565568 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.565714 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.565855 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.566000 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.566139 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.566302 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.566502 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.566656 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.566805 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.566952 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.567092 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.567239 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.567380 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.567526 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.567666 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.567805 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.567943 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.568096 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.568247 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.568431 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.568571 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.568728 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.568875 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.569023 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.569170 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.569310 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.569455 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.569599 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.569752 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.569891 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.570039 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.570196 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.570335 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.570538 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.570694 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.570880 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.571026 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.571184 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.571392 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.571544 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.571701 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.571848 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.572074 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.572236 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.572384 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.572530 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.572696 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.572856 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.573003 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.573148 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.573293 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.573451 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.573608 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.573767 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.573914 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.574059 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.574216 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.574394 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.574549 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.574708 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.574863 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.575009 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.575669 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.575834 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.575991 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.576137 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.576283 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.576435 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.576591 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.576754 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.576901 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.577054 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.577207 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.577353 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.577507 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.577660 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.577808 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.577808 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.578092 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.578238 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.578473 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.578645 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.578794 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.578940 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.579085 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.579230 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.579392 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.579553 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.579700 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.579846 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.579991 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.580136 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.580295 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.580441 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.580598 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.580750 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.580897 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.581055 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.581210 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.581356 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.581527 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.581673 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.581818 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.581972 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.582203 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.582387 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.582541 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.582698 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.582844 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.583003 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.583151 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.583302 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.583449 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.583594 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.583746 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.583906 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.584055 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.584200 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.584346 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.584492 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.584656 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.584804 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.584960 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.585108 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.585260 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.585406 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.585561 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.585707 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.585853 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.585999 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.586146 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.586292 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.586513 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.586671 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.586818 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.586964 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.587109 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.587262 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.587422 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.587569 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.587716 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.587861 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.588015 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.588170 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.588318 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.588525 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.588679 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.588826 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.588970 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.589124 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.589271 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.589427 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.589580 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.589739 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.589894 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.590048 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.590195 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.590349 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.590536 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.590693 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.590911 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.591582 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.591731 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.591884 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.592031 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.592196 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.592424 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.592578 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.592732 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.592879 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.593024 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.593188 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.593344 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.593499 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.593646 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.593792 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.593938 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.594090 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.594090 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.594484 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.594643 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.594798 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.594945 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.595090 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.595259 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.595406 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.595553 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.595699 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.595843 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.595989 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.596145 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.596292 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.596437 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.596589 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.596737 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.596891 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.597047 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.597222 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.597371 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.597548 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.597701 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.597908 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.598061 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.598208 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.598353 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.598596 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.598751 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.598911 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.599058 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.599216 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.599216 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.599513 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.599668 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.599824 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.599978 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.600131 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.600284 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.600438 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.600593 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.600740 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.600886 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.601031 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.601186 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.601331 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.601486 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.601640 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.601787 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.601934 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.602079 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.602224 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.602414 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.602570 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.602716 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.602871 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.603019 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.603180 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.603335 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.603482 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.603628 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.603772 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.603917 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.604072 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.604218 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.604364 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.604515 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.604662 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.604806 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.604970 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.605379 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.605526 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.605672 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.605817 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.605963 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.606118 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.606273 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.606501 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.606739 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.606888 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.607111 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.607290 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.607445 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.607605 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.607752 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.607897 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.608051 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.608199 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.608346 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.608492 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.608683 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.608836 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.608992 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.609147 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.609307 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.609465 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.609611 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.609757 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.609914 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.610068 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.610215 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.610382 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.610539 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.610686 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.610844 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.610999 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.611153 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.611301 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.611466 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.611613 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.611767 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.611914 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.612066 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.612221 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.612369 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.612528 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.612677 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.612829 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.612982 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.613129 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.613274 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.613439 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.613586 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.613738 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.613738 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.614015 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.614168 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.614323 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.614544 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.614692 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.614839 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.614984 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.614984 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.615290 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.615436 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.615583 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.615729 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.615882 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.616038 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.616185 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.616331 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.616489 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.616646 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.616793 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.616940 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.617093 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.617249 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.617395 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.617548 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.617695 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.617854 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.618011 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.618157 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.618406 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.618573 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.618772 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.618927 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.619079 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.619241 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.619399 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.619546 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.619693 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.619853 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.620000 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.620156 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.620304 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.620450 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.620606 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.620761 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.620908 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.621063 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.621209 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.621367 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.621520 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.621666 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.621813 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.621967 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.622193 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.622468 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.622678 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.622834 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.622995 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.623152 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.623307 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.623453 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.623619 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.623775 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.623933 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.624081 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.624226 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.624372 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.624518 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.624664 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.624818 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.624967 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.625113 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.625268 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.625425 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.625587 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.625735 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.625882 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.626030 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.626176 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.626322 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.626520 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.626670 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.626816 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.626963 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.627110 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.627256 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.627425 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.627573 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.627726 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.627880 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.628035 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.628183 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.628344 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.628503 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.628657 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.628849 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.629009 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.629170 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.629318 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.629492 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.629640 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.629786 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.629932 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.630088 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.630249 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.630420 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.630574 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.630721 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.630879 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.631035 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.631182 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.631347 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.631502 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.631649 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.631795 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.631950 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.632098 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.632254 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.632403 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.632549 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.632708 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.632856 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.633002 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.633148 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.633374 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.633533 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.633694 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.633841 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.633987 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.634133 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.634287 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.634465 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.634628 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.634777 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.634923 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.635069 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.635214 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.635371 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.635531 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.635679 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.635826 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.635985 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.636139 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.636295 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.636449 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.636597 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.636744 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.636898 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.636898 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.637186 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.637343 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.637490 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.638172 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.638329 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.638543 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.638687 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.638779 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.638861 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.638938 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.639027 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.639108 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.639201 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.639282 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.639360 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.639439 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.639517 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.639604 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.639684 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.639770 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.639850 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.639927 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.640011 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.640098 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.640178 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.640257 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.640334 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.640412 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.640490 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.640575 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.640575 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.640720 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.640806 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.640892 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.640972 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.641058 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.641138 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.641222 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.641301 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.641378 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.641464 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.641543 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.641629 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.641717 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.641804 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.641890 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.641977 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.642058 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.642157 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.642242 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.642327 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.642448 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.642545 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.642626 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.642723 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.642868 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.642963 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.643044 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.643131 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.643210 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.643295 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.643453 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.643624 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.643774 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.644003 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.644163 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.644317 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.644465 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.644638 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.644804 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.644954 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.645107 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.645254 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.645400 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.645546 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.645701 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.645847 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.645994 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.646160 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.646314 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.646533 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.646693 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.646849 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.646998 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.647144 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.647289 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.647435 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.647590 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.647737 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.647883 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.648041 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.648197 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.648352 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.648498 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.648644 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.648804 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.648994 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.649149 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.649308 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.649462 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.649616 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.649762 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.649908 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.650068 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.650225 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.650462 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.650616 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.650763 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.650932 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.651089 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.651246 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.651401 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.651548 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.651694 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.651840 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.651994 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.652159 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.652307 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.652460 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.652607 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.652760 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.652923 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.653071 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.653227 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.653455 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.654097 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.654244 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.654459 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.654625 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.654625 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.654914 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.655060 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.655213 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.655369 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.655516 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.655516 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.655793 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.655793 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.656087 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.656235 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.656382 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.656546 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.656693 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.656846 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.657002 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.657149 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.657295 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.657443 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.657590 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.657736 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.657890 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.658038 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.658184 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.658330 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.658526 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.658675 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.658836 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.658983 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.659172 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.659324 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.659470 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.659630 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.659778 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.659924 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.660083 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.660230 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.660376 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.660542 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.660699 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.660846 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.661004 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.661150 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.661298 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.661457 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.661604 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.661752 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.661905 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.662052 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.662199 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.662398 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.662554 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.662703 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.662850 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.663008 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.663170 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.663341 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.663497 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.663668 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.663833 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.663988 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.664145 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.664300 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.664494 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.664651 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.664846 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.665021 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.665021 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.665303 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.665460 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.665609 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.665757 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.665904 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.666067 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.666243 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.666425 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.666593 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.666742 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.666892 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.667047 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.667196 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.667356 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.667504 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.667652 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.667805 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.667955 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.668112 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.668268 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.668428 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.668575 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.668722 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.668912 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.669081 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.669282 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.669436 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.669584 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.669729 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.669907 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.670077 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.670227 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.670430 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.670608 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.670771 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.670962 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.671127 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.671276 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.671424 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.671580 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.671729 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.671885 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.672033 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.672181 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.672328 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.672475 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.672632 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.672788 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.672936 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.673092 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.673241 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.673397 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.673552 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.673708 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.673864 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.674019 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.674166 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.674314 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.674485 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.674657 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.674805 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.674953 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.675100 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.675248 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.675413 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.675570 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.675719 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.675867 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.676015 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.676162 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.676326 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.676476 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.676634 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.676782 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.676929 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.677077 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.677233 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.677383 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.677530 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.677685 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.677841 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.677988 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.678144 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.678304 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.678489 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.678648 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.678797 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.678954 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.679102 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.679299 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.679457 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.679604 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.679751 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.679911 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.680061 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.680216 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.680364 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.680526 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.680674 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.680829 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.680988 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.681137 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.681292 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.681440 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.681587 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.681744 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.681892 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.682040 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.682187 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.682341 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.682580 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.682732 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.682893 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.683041 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.683188 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.683336 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.683530 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.683681 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.683829 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.683975 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.684122 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.684270 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.684441 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.684701 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.684895 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.685045 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.685194 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.685342 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.685500 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.685659 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.685809 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.685963 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.686125 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.686286 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.686605 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.686605 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.686796 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.686880 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.686978 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.687076 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.687164 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.687244 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.687322 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.687399 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.687511 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.687683 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.687842 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.687992 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.688157 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.688314 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.688475 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.688633 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.688781 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.688930 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.689077 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.689232 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.690002 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.690166 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.690317 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.690519 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.690668 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.690826 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.691059 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.691218 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.691368 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.691368 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.691668 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.691816 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.691976 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.691976 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.692259 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.692407 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.692553 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.692711 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.692867 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.693022 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.693178 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.693326 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.693474 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.693630 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.693779 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.693934 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.694550 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.694711 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.694873 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.695038 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.695209 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.695366 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.695515 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.695662 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.695809 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.695969 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.696119 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.696268 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.696415 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.696563 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.696723 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.696872 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.697031 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.697180 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.697336 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.697484 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.697647 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.697796 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.697951 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.698099 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.698254 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.698526 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.698526 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.698840 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.698993 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.699140 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.699287 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.699489 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.699644 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.699792 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.699946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.700104 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.700799 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.700948 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.701096 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.701265 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.701414 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.701562 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.701722 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.701870 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.702028 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.702177 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.702331 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.702331 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.702650 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.702799 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.702946 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.703094 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.703253 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.703410 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.703559 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.703706 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.703861 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.703861 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.704156 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.704313 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.704468 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.704617 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.704765 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.704920 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.705084 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.705244 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.705400 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.705400 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.705682 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.705830 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.705984 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.706140 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.706288 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.706458 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.706606 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.706828 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.707008 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.707170 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.707318 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.707464 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.707618 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.707775 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.707931 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.708079 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.708226 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.708373 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.708519 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.708667 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.708823 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.708982 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.709129 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.709276 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.709431 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.709431 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.709766 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.709928 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.710076 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.710222 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.710425 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.710597 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.710746 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.710894 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.711052 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.711052 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.711330 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.711485 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.711633 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.711780 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.711928 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.712087 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.712234 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.712389 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.712537 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.712684 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.712831 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.712992 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.713149 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.713297 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.713444 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.713590 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.713736 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.713882 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.714038 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.714187 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.714334 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.714511 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.714659 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.714805 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.714975 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.715126 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.715280 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.715428 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.715587 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.715780 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.716560 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.716721 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.716878 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.717034 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.717184 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.717343 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.717503 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.717658 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.717658 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.717948 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.718096 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.718253 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.718437 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.718604 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.718753 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.718900 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.719047 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.719203 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.719359 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.719525 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.719714 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.719866 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.720014 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.720171 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.720319 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.720467 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.720614 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.720761 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.720908 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.721064 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.721214 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.721362 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.721519 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.721667 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.721823 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.721978 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.721978 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.722262 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.722431 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.722588 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.722746 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.722902 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.723058 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.723206 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.723353 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.723512 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.723669 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.723817 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.723970 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.724126 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.724275 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.724423 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.724580 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.724736 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.724891 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.725048 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.725214 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.725430 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.725593 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.725750 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.725899 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.726046 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.726201 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.726380 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.726555 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.726706 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.726861 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.727016 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.727016 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.727315 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.727476 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.727624 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.727772 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.727919 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.728144 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.728295 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.728442 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.728604 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.728754 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.728910 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.729067 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.729224 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.729372 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.729537 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.729733 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.729892 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.730049 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.730560 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.730711 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.730860 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.731019 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.731175 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.731336 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.731570 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.731735 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.731896 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.732053 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.732211 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.732360 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.732507 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.732655 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.732803 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.732950 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.733106 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.733261 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.733409 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.733569 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.733741 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.733890 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.734048 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.734196 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.734343 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.734522 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.734671 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.734831 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.734979 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.735127 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.735274 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.735421 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.735570 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.735741 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.735898 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.736047 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.736195 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.736349 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.736510 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.736666 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.736822 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.736970 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.737117 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.737264 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.737424 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.737584 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.737739 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.737887 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.738034 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.738184 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.738344 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.738523 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.738681 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.738830 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.738984 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.739132 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.739288 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.739437 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.739593 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.739740 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.739937 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.740098 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.740255 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.740404 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.740551 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.740699 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.740846 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.741005 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.741153 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.741308 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.741467 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.741622 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.741777 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.741933 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.742090 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.742245 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.742245 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.742585 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.742747 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.742896 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.743043 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.743189 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.743346 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.743495 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.743650 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.743798 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.743944 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.744090 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.744243 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.744389 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.744546 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.744694 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.744840 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.744986 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.745133 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.745300 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.745457 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.745606 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.745752 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.745911 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.746060 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.746216 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.746386 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.746552 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.746703 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.746849 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.747037 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.747218 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.747378 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.747528 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.747675 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.747823 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.747977 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.748138 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.748287 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.748435 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.748582 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.748738 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.748738 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.749027 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.749183 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.749342 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.749489 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.749636 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.749793 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.749985 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.750146 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.750296 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.750475 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.750624 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.750788 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.750937 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.751092 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.751240 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.751398 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.751553 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.751715 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.751863 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.752017 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.752170 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.752318 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.752471 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.752633 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.752783 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.752932 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.753079 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.753238 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.753394 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.753543 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.753690 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.753838 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.753985 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.754132 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.754292 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.754490 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.754592 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.754679 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.754761 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.754859 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.754954 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.755046 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.755129 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.755242 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.755313 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.755448 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.755539 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.755621 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.755700 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.755779 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.755858 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.756020 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.756104 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.756171 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.756248 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.756327 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.756405 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.756492 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.756579 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.756659 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.756745 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.756831 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.756919 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.757069 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.757244 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.757394 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.757541 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.757698 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.757856 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.758005 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.758153 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.758300 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.758527 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.758677 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.758837 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.758986 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.759143 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.759301 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.759449 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.759605 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.759752 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.759900 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.760086 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.760248 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.760405 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.760562 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.760710 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.760858 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.761013 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.761180 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.761330 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.761491 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.761640 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.761787 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.761936 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.762091 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.762247 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 23:04:19.762433 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.763199 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.763535 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.763863 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.764174 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.764483 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:04:19.764730 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 23:04:19.918217 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO dbcounter [None req-523b2b58-c137-4247-84f5-dd48df26faae None None] Registered counter for database nova_api Aug 04 23:04:19.922905 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO dbcounter [None req-399c207d-1d52-4a87-ada1-56ec8acc31df None None] Registered counter for database nova_api Aug 04 23:04:19.939288 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG oslo_db.sqlalchemy.engines [None req-523b2b58-c137-4247-84f5-dd48df26faae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 23:04:19.944060 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_db.sqlalchemy.engines [None req-399c207d-1d52-4a87-ada1-56ec8acc31df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 23:04:19.945854 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG dbcounter [-] [115264] Writer thread running {{(pid=115264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 23:04:19.951439 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG dbcounter [-] [115265] Writer thread running {{(pid=115265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 23:04:20.003089 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.context [None req-523b2b58-c137-4247-84f5-dd48df26faae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87c32cd0-6efe-4e80-b8c3-7af92af1b107(cell1) {{(pid=115264) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 23:04:20.007031 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG oslo_concurrency.lockutils [None req-523b2b58-c137-4247-84f5-dd48df26faae None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:04:20.007458 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG oslo_concurrency.lockutils [None req-523b2b58-c137-4247-84f5-dd48df26faae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:04:20.008469 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.context [None req-399c207d-1d52-4a87-ada1-56ec8acc31df None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87c32cd0-6efe-4e80-b8c3-7af92af1b107(cell1) {{(pid=115265) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 23:04:20.009038 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG oslo_concurrency.lockutils [None req-523b2b58-c137-4247-84f5-dd48df26faae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:04:20.009766 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG oslo_concurrency.lockutils [None req-523b2b58-c137-4247-84f5-dd48df26faae None None] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:04:20.010209 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG oslo_concurrency.lockutils [None req-523b2b58-c137-4247-84f5-dd48df26faae None None] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:04:20.012231 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG oslo_concurrency.lockutils [None req-523b2b58-c137-4247-84f5-dd48df26faae None None] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:04:20.012332 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-399c207d-1d52-4a87-ada1-56ec8acc31df None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:04:20.013493 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-399c207d-1d52-4a87-ada1-56ec8acc31df None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:04:20.014867 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO dbcounter [None req-523b2b58-c137-4247-84f5-dd48df26faae None None] Registered counter for database nova_cell0 Aug 04 23:04:20.015378 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-399c207d-1d52-4a87-ada1-56ec8acc31df None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:04:20.016121 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-399c207d-1d52-4a87-ada1-56ec8acc31df None None] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:04:20.016572 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-399c207d-1d52-4a87-ada1-56ec8acc31df None None] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:04:20.018621 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-399c207d-1d52-4a87-ada1-56ec8acc31df None None] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:04:20.020418 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO dbcounter [None req-523b2b58-c137-4247-84f5-dd48df26faae None None] Registered counter for database nova_cell1 Aug 04 23:04:20.020636 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO dbcounter [None req-399c207d-1d52-4a87-ada1-56ec8acc31df None None] Registered counter for database nova_cell0 Aug 04 23:04:20.026107 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO dbcounter [None req-399c207d-1d52-4a87-ada1-56ec8acc31df None None] Registered counter for database nova_cell1 Aug 04 23:04:20.029081 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG oslo_db.sqlalchemy.engines [None req-523b2b58-c137-4247-84f5-dd48df26faae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 23:04:20.030985 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG oslo_db.sqlalchemy.engines [None req-523b2b58-c137-4247-84f5-dd48df26faae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 23:04:20.034026 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_db.sqlalchemy.engines [None req-399c207d-1d52-4a87-ada1-56ec8acc31df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 23:04:20.034740 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG dbcounter [-] [115264] Writer thread running {{(pid=115264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 23:04:20.035137 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_db.sqlalchemy.engines [None req-399c207d-1d52-4a87-ada1-56ec8acc31df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 23:04:20.042896 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG dbcounter [-] [115265] Writer thread running {{(pid=115265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 23:04:20.043228 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG dbcounter [-] [115265] Writer thread running {{(pid=115265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 23:04:20.176067 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG dbcounter [-] [115264] Writer thread running {{(pid=115264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 23:04:20.184864 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO dbcounter [None req-523b2b58-c137-4247-84f5-dd48df26faae None None] Registered counter for database nova_cell0 Aug 04 23:04:20.189694 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO dbcounter [None req-399c207d-1d52-4a87-ada1-56ec8acc31df None None] Registered counter for database nova_cell0 Aug 04 23:04:20.194019 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG oslo_db.sqlalchemy.engines [None req-523b2b58-c137-4247-84f5-dd48df26faae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 23:04:20.198679 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_db.sqlalchemy.engines [None req-399c207d-1d52-4a87-ada1-56ec8acc31df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 23:04:20.198834 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG dbcounter [-] [115264] Writer thread running {{(pid=115264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 23:04:20.204039 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG dbcounter [-] [115265] Writer thread running {{(pid=115265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 23:04:20.542492 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: WARNING keystonemiddleware.auth_token [None req-399c207d-1d52-4a87-ada1-56ec8acc31df None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 23:04:20.543143 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: WARNING keystonemiddleware.auth_token [None req-523b2b58-c137-4247-84f5-dd48df26faae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 23:04:20.550611 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: WARNING keystonemiddleware.auth_token [None req-399c207d-1d52-4a87-ada1-56ec8acc31df None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 23:04:20.550940 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: WARNING keystonemiddleware.auth_token [None req-523b2b58-c137-4247-84f5-dd48df26faae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 23:04:20.895372 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: WARNING keystonemiddleware.auth_token [None req-523b2b58-c137-4247-84f5-dd48df26faae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 23:04:20.897544 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: WARNING keystonemiddleware.auth_token [None req-399c207d-1d52-4a87-ada1-56ec8acc31df None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 23:04:20.901333 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: WARNING keystonemiddleware.auth_token [None req-523b2b58-c137-4247-84f5-dd48df26faae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 23:04:20.904423 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: WARNING keystonemiddleware.auth_token [None req-399c207d-1d52-4a87-ada1-56ec8acc31df None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 23:04:20.907182 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cae9bdc9c0 pid: 115264 (default app) Aug 04 23:04:20.909259 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-523b2b58-c137-4247-84f5-dd48df26faae None None] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:04:20.909685 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cae9bdc9c0 pid: 115265 (default app) Aug 04 23:04:20.910479 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-523b2b58-c137-4247-84f5-dd48df26faae None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001744 Aug 04 23:04:20.910887 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Thu Aug 4 23:04:20 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:05:39.970979 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-399c207d-1d52-4a87-ada1-56ec8acc31df None None] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:05:39.972195 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-399c207d-1d52-4a87-ada1-56ec8acc31df None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002021 Aug 04 23:05:39.972601 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 931 bytes} [Thu Aug 4 23:05:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:05:39.984423 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG dbcounter [-] [115264] Writing DB stats nova_api:SELECT=3 {{(pid=115264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:05:39.985605 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG dbcounter [-] [115264] Writing DB stats nova_cell0:SELECT=3 {{(pid=115264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:05:39.986635 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG dbcounter [-] [115264] Writing DB stats nova_cell1:SELECT=3 {{(pid=115264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:05:39.987651 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG dbcounter [-] [115264] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:05:40.893541 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-f1350084-022e-4d7d-8bd8-fcd9458b9daf admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:05:40.929853 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-f1350084-022e-4d7d-8bd8-fcd9458b9daf admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.950417 Aug 04 23:05:40.931070 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 2/3] 10.222.0.33 () {60 vars in 1292 bytes} [Thu Aug 4 23:05:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:05:43.187548 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-399c207d-1d52-4a87-ada1-56ec8acc31df None None] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:05:43.188585 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-399c207d-1d52-4a87-ada1-56ec8acc31df None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 04 23:05:43.193731 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 2/4] 10.222.0.33 () {54 vars in 931 bytes} [Thu Aug 4 23:05:43 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:05:43.614228 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-4921c013-885d-4763-bf8e-9411c946a7dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "id": "c1", "rxtx_factor": 1.0, "swap": 0}} {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:05:43.634838 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 23:05:43.634838 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: warnings.warn(msg) Aug 04 23:05:43.664857 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-4921c013-885d-4763-bf8e-9411c946a7dc admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.469619 Aug 04 23:05:43.665434 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 3/5] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Aug 4 23:05:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 23:05:43.883752 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-2dd72395-3c57-4ddc-9b7b-349f75fdfbf8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:05:43.888242 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 23:05:43.888242 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: warnings.warn(msg) Aug 04 23:05:43.904048 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG dbcounter [-] [115265] Writing DB stats nova_api:SELECT=3 {{(pid=115265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:05:43.904691 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG dbcounter [-] [115265] Writing DB stats nova_cell1:SELECT=3 {{(pid=115265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:05:43.905612 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG dbcounter [-] [115265] Writing DB stats nova_cell0:SELECT=3 {{(pid=115265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:05:43.905922 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG dbcounter [-] [115265] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:05:43.955141 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-2dd72395-3c57-4ddc-9b7b-349f75fdfbf8 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281473 Aug 04 23:05:43.955743 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 3/6] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Aug 4 23:05:43 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:05:46.261288 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-4921c013-885d-4763-bf8e-9411c946a7dc admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:05:46.263086 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-4921c013-885d-4763-bf8e-9411c946a7dc admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002150 Aug 04 23:05:46.263870 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 4/7] 10.222.0.33 () {54 vars in 931 bytes} [Thu Aug 4 23:05:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:05:47.016472 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-1259b264-a5c3-4eba-a830-e338f2df4536 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "id": "d1", "os-flavor-access:is_public": true, "name": "ds512M", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 5}} {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:05:47.036428 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 23:05:47.036428 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: warnings.warn(msg) Aug 04 23:05:47.058129 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-1259b264-a5c3-4eba-a830-e338f2df4536 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.787305 Aug 04 23:05:47.059090 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 4/8] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Aug 4 23:05:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 23:05:47.072432 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-5837fe36-94e6-42d4-bcbb-ea93593badcd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:05:47.075510 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 23:05:47.075510 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: warnings.warn(msg) Aug 04 23:05:47.110685 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-5837fe36-94e6-42d4-bcbb-ea93593badcd admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043093 Aug 04 23:05:47.111272 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 5/9] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Aug 4 23:05:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:05:49.420545 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-1259b264-a5c3-4eba-a830-e338f2df4536 admin admin] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:05:49.421570 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-1259b264-a5c3-4eba-a830-e338f2df4536 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 04 23:05:49.422062 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 931 bytes} [Thu Aug 4 23:05:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:05:49.834964 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-4e8d5365-e4a6-4e8a-a7ae-4dc53a8876e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "disk": 10, "os-flavor-access:is_public": true, "ram": 1024, "rxtx_factor": 1.0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:05:49.857565 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-4e8d5365-e4a6-4e8a-a7ae-4dc53a8876e4 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.429447 Aug 04 23:05:49.858448 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 6/11] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Aug 4 23:05:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 23:05:49.871770 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-7eaa9fc4-5315-4621-9b1b-5b7b1d8d6fd2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:05:49.896444 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-7eaa9fc4-5315-4621-9b1b-5b7b1d8d6fd2 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029324 Aug 04 23:05:49.897046 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 6/12] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Aug 4 23:05:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:05:52.137395 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-4e8d5365-e4a6-4e8a-a7ae-4dc53a8876e4 admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:05:52.138477 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-4e8d5365-e4a6-4e8a-a7ae-4dc53a8876e4 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 04 23:05:52.138885 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 7/13] 10.222.0.33 () {54 vars in 931 bytes} [Thu Aug 4 23:05:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:05:52.569557 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-9bfde059-c502-40a8-8c08-1e18e5cea5e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds2G", "vcpus": 2, "ram": 2048, "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:05:52.589536 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-9bfde059-c502-40a8-8c08-1e18e5cea5e7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.444450 Aug 04 23:05:52.590087 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 7/14] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Aug 4 23:05:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 23:05:52.603126 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-9c96d676-e09b-4758-a813-7ac8a775d3e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:05:52.631891 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-9c96d676-e09b-4758-a813-7ac8a775d3e1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031299 Aug 04 23:05:52.634510 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 8/15] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Aug 4 23:05:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:05:54.929827 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-9bfde059-c502-40a8-8c08-1e18e5cea5e7 admin admin] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:05:54.931027 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-9bfde059-c502-40a8-8c08-1e18e5cea5e7 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001907 Aug 04 23:05:54.931518 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 8/16] 10.222.0.33 () {54 vars in 931 bytes} [Thu Aug 4 23:05:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:05:55.401261 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-a29faa3c-6ac7-4a51-b408-685aa92b6e92 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "ram": 4096, "disk": 20, "rxtx_factor": 1.0}} {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:05:55.431202 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-a29faa3c-6ac7-4a51-b408-685aa92b6e92 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.492143 Aug 04 23:05:55.432414 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 9/17] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Aug 4 23:05:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 23:05:55.443996 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-44fde4d6-1ea1-43cb-b11b-7aef95d9960c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:05:55.471828 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-44fde4d6-1ea1-43cb-b11b-7aef95d9960c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031512 Aug 04 23:05:55.486395 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 9/18] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Aug 4 23:05:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:05:57.896307 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-a29faa3c-6ac7-4a51-b408-685aa92b6e92 admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:05:57.897324 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-a29faa3c-6ac7-4a51-b408-685aa92b6e92 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 04 23:05:57.898314 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 10/19] 10.222.0.33 () {54 vars in 931 bytes} [Thu Aug 4 23:05:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:05:58.323438 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-2e4ece0a-67a8-47de-91ef-3f1aa27930cc admin admin] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:05:58.350230 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-2e4ece0a-67a8-47de-91ef-3f1aa27930cc admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.445328 Aug 04 23:05:58.351181 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 10/20] 10.222.0.33 () {60 vars in 1292 bytes} [Thu Aug 4 23:05:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:06:00.722929 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-a29faa3c-6ac7-4a51-b408-685aa92b6e92 admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:00.723972 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-a29faa3c-6ac7-4a51-b408-685aa92b6e92 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 04 23:06:00.724392 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 11/21] 10.222.0.33 () {54 vars in 931 bytes} [Thu Aug 4 23:06:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:06:01.182002 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-6899a38c-d9e4-401e-b1a7-59073ce1942f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "1", "disk": 1, "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:06:01.201347 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-6899a38c-d9e4-401e-b1a7-59073ce1942f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.470109 Aug 04 23:06:01.201904 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 11/22] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Aug 4 23:06:00 2022] POST /compute/v2.1/flavors => generated 402 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 23:06:01.213934 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-93fba0d5-546f-4f95-8aac-34a95d4bb56d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:06:01.237544 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-93fba0d5-546f-4f95-8aac-34a95d4bb56d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027326 Aug 04 23:06:01.238130 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 12/23] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Aug 4 23:06:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:06:03.578961 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-6899a38c-d9e4-401e-b1a7-59073ce1942f admin admin] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:03.579975 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-6899a38c-d9e4-401e-b1a7-59073ce1942f admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Aug 04 23:06:03.580374 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 12/24] 10.222.0.33 () {54 vars in 931 bytes} [Thu Aug 4 23:06:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:06:04.020362 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-914be178-2c7b-4d25-b6d8-d2ec3b01b99c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "disk": 20, "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "vcpus": 1, "os-flavor-access:is_public": true, "id": "2"}} {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:06:04.041799 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-914be178-2c7b-4d25-b6d8-d2ec3b01b99c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.455332 Aug 04 23:06:04.042386 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 13/25] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Aug 4 23:06:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 23:06:04.056010 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-00c734eb-8a86-4dd0-9609-fe0913f827bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:06:04.088267 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-00c734eb-8a86-4dd0-9609-fe0913f827bd admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036501 Aug 04 23:06:04.089271 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 13/26] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Aug 4 23:06:04 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:06:06.358812 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-914be178-2c7b-4d25-b6d8-d2ec3b01b99c admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:06.359787 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-914be178-2c7b-4d25-b6d8-d2ec3b01b99c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 04 23:06:06.360193 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 14/27] 10.222.0.33 () {54 vars in 931 bytes} [Thu Aug 4 23:06:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:06:06.876456 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-0954ea80-2bc3-4fb4-b80d-71849a52a199 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3"}} {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:06:06.895788 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-0954ea80-2bc3-4fb4-b80d-71849a52a199 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.529050 Aug 04 23:06:06.896352 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 14/28] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Aug 4 23:06:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 23:06:06.909503 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-823e2896-bd23-45d6-8f94-890641c8ec67 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:06:06.935577 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-823e2896-bd23-45d6-8f94-890641c8ec67 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029740 Aug 04 23:06:06.936192 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 15/29] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Aug 4 23:06:06 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:06:09.221828 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-0954ea80-2bc3-4fb4-b80d-71849a52a199 admin admin] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:09.222883 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-0954ea80-2bc3-4fb4-b80d-71849a52a199 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 04 23:06:09.223289 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 15/30] 10.222.0.33 () {54 vars in 931 bytes} [Thu Aug 4 23:06:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:06:09.653868 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-0f8d076b-8a36-4226-94a4-9f91d52dfefe admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "ram": 8192, "rxtx_factor": 1.0, "vcpus": 4, "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large"}} {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:06:09.674141 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-0f8d076b-8a36-4226-94a4-9f91d52dfefe admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.443653 Aug 04 23:06:09.674813 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 16/31] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Aug 4 23:06:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 23:06:09.690097 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-eae28a4d-fc67-4ca1-9cec-d9f53778c8f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:06:09.728165 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-eae28a4d-fc67-4ca1-9cec-d9f53778c8f0 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044152 Aug 04 23:06:09.728761 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 16/32] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Aug 4 23:06:09 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:06:11.993974 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-0f8d076b-8a36-4226-94a4-9f91d52dfefe admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:11.994994 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-0f8d076b-8a36-4226-94a4-9f91d52dfefe admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Aug 04 23:06:11.995395 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 17/33] 10.222.0.33 () {54 vars in 931 bytes} [Thu Aug 4 23:06:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:06:12.379193 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-73c288df-5083-40da-b57b-b26b03a81d70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "disk": 160, "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:06:12.399740 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-73c288df-5083-40da-b57b-b26b03a81d70 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.398211 Aug 04 23:06:12.400377 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 17/34] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Aug 4 23:06:12 2022] POST /compute/v2.1/flavors => generated 408 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 23:06:12.412851 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-4b8b6553-aaaa-4e1e-88a2-fab839e0c311 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:06:12.417874 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG dbcounter [-] [115264] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=115264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:06:12.446166 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-4b8b6553-aaaa-4e1e-88a2-fab839e0c311 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037519 Aug 04 23:06:12.446913 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 18/35] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Aug 4 23:06:12 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:06:38.468211 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-73c288df-5083-40da-b57b-b26b03a81d70 admin admin] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:38.469231 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-73c288df-5083-40da-b57b-b26b03a81d70 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 04 23:06:38.469675 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 18/36] 10.222.0.33 () {54 vars in 931 bytes} [Thu Aug 4 23:06:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:06:38.481538 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG dbcounter [-] [115264] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=115264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:06:38.922074 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-21f6bc53-ea3d-4d0f-8745-ab8257999ee6 admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:38.941532 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-21f6bc53-ea3d-4d0f-8745-ab8257999ee6 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.464448 Aug 04 23:06:38.942708 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 19/37] 10.222.0.33 () {60 vars in 1292 bytes} [Thu Aug 4 23:06:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:06:40.059887 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-73c288df-5083-40da-b57b-b26b03a81d70 admin admin] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:40.060897 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-73c288df-5083-40da-b57b-b26b03a81d70 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 04 23:06:40.061300 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 19/38] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Aug 4 23:06:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:06:40.614335 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-13729532-e3a3-40a3-998c-f956d137e200 admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:40.620058 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.wsgi [None req-13729532-e3a3-40a3-998c-f956d137e200 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 23:06:40.623328 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-13729532-e3a3-40a3-998c-f956d137e200 admin admin] Request method failure captured: Aug 04 23:06:40.623328 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 23:06:40.623328 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: Accept: application/json Aug 04 23:06:40.623328 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: Accept-Encoding: gzip, deflate Aug 04 23:06:40.623328 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: Connection: keep-alive Aug 04 23:06:40.623328 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: Content-Length: 0 Aug 04 23:06:40.623328 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: Host: 10.222.0.33 Aug 04 23:06:40.623328 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: Openstack-Api-Version: compute 2.90 Aug 04 23:06:40.623328 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: Openstack-System-Scope: None Aug 04 23:06:40.623328 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: User-Agent: python-novaclient Aug 04 23:06:40.623328 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Auth-Token: gAAAAABi7FD_3B2DVG2eeYzv_3N7xFMoZJwkhp7gKJUZTbQmWPw9g24En4dy91h-ohsP5pu0Dy7JgHMB65QLfWszo9xlUnqdP2ZKGV1h-BShISOQ4foLj-zPTZJhU5PNbkZARpQg1cQ1ZkQhgZ_mSiIUhnwyUS2Q-Z1Iuk8lHc0xxPo3PkJxpkc Aug 04 23:06:40.623328 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Domain-Id: None Aug 04 23:06:40.623328 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Domain-Name: None Aug 04 23:06:40.623328 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Identity-Status: Confirmed Aug 04 23:06:40.623328 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Is-Admin-Project: True Aug 04 23:06:40.623328 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 23:06:40.623328 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Project-Domain-Id: default Aug 04 23:06:40.623328 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Project-Domain-Name: Default Aug 04 23:06:40.623328 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Project-Id: 57180b6266444b6d9f05074139b8cde7 Aug 04 23:06:40.623328 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Project-Name: admin Aug 04 23:06:40.623328 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Role: admin,reader,member Aug 04 23:06:40.623328 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Roles: admin,reader,member Aug 04 23:06:40.624942 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/57180b6266444b6d9f05074139b8cde7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_57180b6266444b6d9f05074139b8cde7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/57180b6266444b6d9f05074139b8cde7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/57180b6266444b6d9f05074139b8cde7"}]}] Aug 04 23:06:40.624942 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Tenant: admin Aug 04 23:06:40.624942 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Tenant-Id: 57180b6266444b6d9f05074139b8cde7 Aug 04 23:06:40.624942 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Tenant-Name: admin Aug 04 23:06:40.624942 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-User: admin Aug 04 23:06:40.624942 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-User-Domain-Id: default Aug 04 23:06:40.624942 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-User-Domain-Name: Default Aug 04 23:06:40.624942 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-User-Id: 4ae73490baa943239b4d5f63b8bb98d1 Aug 04 23:06:40.624942 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-User-Name: admin Aug 04 23:06:40.624942 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: method: > Aug 04 23:06:40.624942 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: exception: Flavor 42 could not be found. Aug 04 23:06:40.624942 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: action_args: {'id': '42'} Aug 04 23:06:40.624942 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:06:40.624942 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:06:40.626080 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 23:06:40.626080 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 23:06:40.626080 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 23:06:40.626080 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 23:06:40.626080 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 23:06:40.626080 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 23:06:40.626080 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 23:06:40.626080 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 23:06:40.626080 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 23:06:40.626080 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:06:40.626080 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 23:06:40.626080 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 23:06:40.626080 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 23:06:40.626080 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Aug 04 23:06:40.626080 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:06:40.626080 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Aug 04 23:06:40.626080 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:06:40.626080 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:06:40.626080 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:06:40.627674 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:06:40.627674 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:06:40.627674 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:06:40.627674 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:06:40.627674 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 23:06:40.627674 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:06:40.627674 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 23:06:40.627674 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Aug 04 23:06:40.627674 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:06:40.627674 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Aug 04 23:06:40.627674 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:06:40.627674 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:06:40.627674 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:06:40.627674 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:06:40.627674 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:06:40.627674 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 23:06:40.627674 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Aug 04 23:06:40.627674 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-13729532-e3a3-40a3-998c-f956d137e200 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:06:40.629067 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-13729532-e3a3-40a3-998c-f956d137e200 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.420188 Aug 04 23:06:40.629067 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 20/39] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Aug 4 23:06:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 421 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 23:06:40.635243 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-bdb59581-5e63-4d89-9537-0dd33fdb7d99 admin admin] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:40.639341 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG dbcounter [-] [115265] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=115265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:06:40.659830 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-bdb59581-5e63-4d89-9537-0dd33fdb7d99 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028095 Aug 04 23:06:40.660421 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 20/40] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Aug 4 23:06:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:06:40.670968 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-704e4694-1ea4-44fb-aee9-5186fb1bf023 admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:40.696453 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-704e4694-1ea4-44fb-aee9-5186fb1bf023 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029040 Aug 04 23:06:40.697030 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 21/41] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Aug 4 23:06:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:06:40.707107 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-921dc2aa-3c26-41de-8810-7b2577efd85f admin admin] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:40.713977 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.wsgi [None req-921dc2aa-3c26-41de-8810-7b2577efd85f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 23:06:40.717287 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-921dc2aa-3c26-41de-8810-7b2577efd85f admin admin] Request method failure captured: Aug 04 23:06:40.717287 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 23:06:40.717287 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: Accept: application/json Aug 04 23:06:40.717287 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: Accept-Encoding: gzip, deflate Aug 04 23:06:40.717287 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: Connection: keep-alive Aug 04 23:06:40.717287 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: Content-Length: 0 Aug 04 23:06:40.717287 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: Host: 10.222.0.33 Aug 04 23:06:40.717287 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: Openstack-Api-Version: compute 2.90 Aug 04 23:06:40.717287 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: Openstack-System-Scope: None Aug 04 23:06:40.717287 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: User-Agent: python-novaclient Aug 04 23:06:40.717287 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Auth-Token: gAAAAABi7FD_3B2DVG2eeYzv_3N7xFMoZJwkhp7gKJUZTbQmWPw9g24En4dy91h-ohsP5pu0Dy7JgHMB65QLfWszo9xlUnqdP2ZKGV1h-BShISOQ4foLj-zPTZJhU5PNbkZARpQg1cQ1ZkQhgZ_mSiIUhnwyUS2Q-Z1Iuk8lHc0xxPo3PkJxpkc Aug 04 23:06:40.717287 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Domain-Id: None Aug 04 23:06:40.717287 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Domain-Name: None Aug 04 23:06:40.717287 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Identity-Status: Confirmed Aug 04 23:06:40.717287 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Is-Admin-Project: True Aug 04 23:06:40.717287 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 23:06:40.717287 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Project-Domain-Id: default Aug 04 23:06:40.717287 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Project-Domain-Name: Default Aug 04 23:06:40.717287 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Project-Id: 57180b6266444b6d9f05074139b8cde7 Aug 04 23:06:40.717287 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Project-Name: admin Aug 04 23:06:40.717287 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Role: admin,reader,member Aug 04 23:06:40.717287 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Roles: admin,reader,member Aug 04 23:06:40.718878 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/57180b6266444b6d9f05074139b8cde7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_57180b6266444b6d9f05074139b8cde7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/57180b6266444b6d9f05074139b8cde7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/57180b6266444b6d9f05074139b8cde7"}]}] Aug 04 23:06:40.718878 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Tenant: admin Aug 04 23:06:40.718878 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Tenant-Id: 57180b6266444b6d9f05074139b8cde7 Aug 04 23:06:40.718878 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Tenant-Name: admin Aug 04 23:06:40.718878 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-User: admin Aug 04 23:06:40.718878 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-User-Domain-Id: default Aug 04 23:06:40.718878 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-User-Domain-Name: Default Aug 04 23:06:40.718878 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-User-Id: 4ae73490baa943239b4d5f63b8bb98d1 Aug 04 23:06:40.718878 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-User-Name: admin Aug 04 23:06:40.718878 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: method: > Aug 04 23:06:40.718878 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: exception: Flavor 42 could not be found. Aug 04 23:06:40.718878 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: action_args: {'id': '42'} Aug 04 23:06:40.718878 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:06:40.718878 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:06:40.719883 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 23:06:40.719883 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 23:06:40.719883 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 23:06:40.719883 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 23:06:40.719883 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 23:06:40.719883 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 23:06:40.719883 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 23:06:40.719883 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 23:06:40.719883 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 23:06:40.719883 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:06:40.719883 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 23:06:40.719883 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 23:06:40.719883 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 23:06:40.719883 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Aug 04 23:06:40.719883 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:06:40.719883 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Aug 04 23:06:40.719883 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:06:40.719883 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:06:40.719883 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:06:40.721196 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:06:40.721196 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:06:40.721196 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:06:40.721196 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:06:40.721196 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 23:06:40.721196 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:06:40.721196 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 23:06:40.721196 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Aug 04 23:06:40.721196 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:06:40.721196 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Aug 04 23:06:40.721196 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:06:40.721196 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:06:40.721196 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:06:40.721196 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:06:40.721196 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:06:40.721196 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 23:06:40.721196 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Aug 04 23:06:40.721196 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-921dc2aa-3c26-41de-8810-7b2577efd85f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:06:40.722473 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-921dc2aa-3c26-41de-8810-7b2577efd85f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015698 Aug 04 23:06:40.722473 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 21/42] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Aug 4 23:06:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 23:06:41.761309 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-704e4694-1ea4-44fb-aee9-5186fb1bf023 admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:41.762349 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-704e4694-1ea4-44fb-aee9-5186fb1bf023 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Aug 04 23:06:41.762809 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 22/43] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Aug 4 23:06:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:06:42.328112 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-decb07a2-f43f-40ed-9a5f-5a819e110a28 admin admin] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:42.334003 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.wsgi [None req-decb07a2-f43f-40ed-9a5f-5a819e110a28 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 23:06:42.335682 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-decb07a2-f43f-40ed-9a5f-5a819e110a28 admin admin] Request method failure captured: Aug 04 23:06:42.335682 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 23:06:42.335682 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: Accept: application/json Aug 04 23:06:42.335682 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: Accept-Encoding: gzip, deflate Aug 04 23:06:42.335682 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: Connection: keep-alive Aug 04 23:06:42.335682 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: Content-Length: 0 Aug 04 23:06:42.335682 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: Host: 10.222.0.33 Aug 04 23:06:42.335682 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: Openstack-Api-Version: compute 2.90 Aug 04 23:06:42.335682 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: Openstack-System-Scope: None Aug 04 23:06:42.335682 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: User-Agent: python-novaclient Aug 04 23:06:42.335682 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Auth-Token: gAAAAABi7FEBfLYofXPJETuz2PV7LsO9um2q2hVXx8GE5warRzIplLpDBDTs8kUsyfka0f1aXMN7zyGSQ0EKv4WzNL3Xah1TmiFiVUGsSJTSDdoLpTFCMFVTOt5US8bEMC8N134qmjylxxmbTt3mFb24ym6xaaxEZuBTnTMQKFOzF7XJE-njkM0 Aug 04 23:06:42.335682 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Domain-Id: None Aug 04 23:06:42.335682 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Domain-Name: None Aug 04 23:06:42.335682 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Identity-Status: Confirmed Aug 04 23:06:42.335682 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Is-Admin-Project: True Aug 04 23:06:42.335682 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 23:06:42.335682 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Project-Domain-Id: default Aug 04 23:06:42.335682 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Project-Domain-Name: Default Aug 04 23:06:42.335682 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Project-Id: 57180b6266444b6d9f05074139b8cde7 Aug 04 23:06:42.335682 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Project-Name: admin Aug 04 23:06:42.335682 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Role: admin,reader,member Aug 04 23:06:42.335682 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Roles: admin,reader,member Aug 04 23:06:42.337345 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/57180b6266444b6d9f05074139b8cde7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_57180b6266444b6d9f05074139b8cde7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/57180b6266444b6d9f05074139b8cde7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/57180b6266444b6d9f05074139b8cde7"}]}] Aug 04 23:06:42.337345 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Tenant: admin Aug 04 23:06:42.337345 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Tenant-Id: 57180b6266444b6d9f05074139b8cde7 Aug 04 23:06:42.337345 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Tenant-Name: admin Aug 04 23:06:42.337345 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-User: admin Aug 04 23:06:42.337345 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-User-Domain-Id: default Aug 04 23:06:42.337345 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-User-Domain-Name: Default Aug 04 23:06:42.337345 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-User-Id: 4ae73490baa943239b4d5f63b8bb98d1 Aug 04 23:06:42.337345 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-User-Name: admin Aug 04 23:06:42.337345 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: method: > Aug 04 23:06:42.337345 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: exception: Flavor 84 could not be found. Aug 04 23:06:42.337345 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: action_args: {'id': '84'} Aug 04 23:06:42.337345 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:06:42.337345 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:06:42.338285 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 23:06:42.338285 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 23:06:42.338285 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 23:06:42.338285 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 23:06:42.338285 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 23:06:42.338285 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 23:06:42.338285 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 23:06:42.338285 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 23:06:42.338285 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 23:06:42.338285 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:06:42.338285 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 23:06:42.338285 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 23:06:42.338285 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 23:06:42.338285 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Aug 04 23:06:42.338285 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:06:42.338285 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Aug 04 23:06:42.338285 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:06:42.338285 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:06:42.338285 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:06:42.339455 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:06:42.339455 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:06:42.339455 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:06:42.339455 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:06:42.339455 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 23:06:42.339455 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:06:42.339455 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 23:06:42.339455 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Aug 04 23:06:42.339455 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:06:42.339455 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Aug 04 23:06:42.339455 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:06:42.339455 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:06:42.339455 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:06:42.339455 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:06:42.339455 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:06:42.339455 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 23:06:42.339455 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Aug 04 23:06:42.339455 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-decb07a2-f43f-40ed-9a5f-5a819e110a28 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:06:42.340472 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-decb07a2-f43f-40ed-9a5f-5a819e110a28 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.429053 Aug 04 23:06:42.340472 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 22/44] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Aug 4 23:06:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 430 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 23:06:42.348690 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-4bf193a7-32c8-4492-8771-bdc7877aa92e admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:42.368292 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-4bf193a7-32c8-4492-8771-bdc7877aa92e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024492 Aug 04 23:06:42.369137 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 23/45] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Aug 4 23:06:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:06:42.379951 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-dff181e4-20b7-4234-b4a0-319e87c9dcee admin admin] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:42.399480 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-dff181e4-20b7-4234-b4a0-319e87c9dcee admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023974 Aug 04 23:06:42.400048 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 23/46] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Aug 4 23:06:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:06:42.409781 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-a37f1105-ed8c-4f15-bf03-97544baccf2c admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:42.416274 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.wsgi [None req-a37f1105-ed8c-4f15-bf03-97544baccf2c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 23:06:42.417852 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-a37f1105-ed8c-4f15-bf03-97544baccf2c admin admin] Request method failure captured: Aug 04 23:06:42.417852 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 23:06:42.417852 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: Accept: application/json Aug 04 23:06:42.417852 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: Accept-Encoding: gzip, deflate Aug 04 23:06:42.417852 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: Connection: keep-alive Aug 04 23:06:42.417852 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: Content-Length: 0 Aug 04 23:06:42.417852 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: Host: 10.222.0.33 Aug 04 23:06:42.417852 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: Openstack-Api-Version: compute 2.90 Aug 04 23:06:42.417852 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: Openstack-System-Scope: None Aug 04 23:06:42.417852 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: User-Agent: python-novaclient Aug 04 23:06:42.417852 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Auth-Token: gAAAAABi7FEBfLYofXPJETuz2PV7LsO9um2q2hVXx8GE5warRzIplLpDBDTs8kUsyfka0f1aXMN7zyGSQ0EKv4WzNL3Xah1TmiFiVUGsSJTSDdoLpTFCMFVTOt5US8bEMC8N134qmjylxxmbTt3mFb24ym6xaaxEZuBTnTMQKFOzF7XJE-njkM0 Aug 04 23:06:42.417852 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Domain-Id: None Aug 04 23:06:42.417852 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Domain-Name: None Aug 04 23:06:42.417852 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Identity-Status: Confirmed Aug 04 23:06:42.417852 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Is-Admin-Project: True Aug 04 23:06:42.417852 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 23:06:42.417852 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Project-Domain-Id: default Aug 04 23:06:42.417852 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Project-Domain-Name: Default Aug 04 23:06:42.417852 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Project-Id: 57180b6266444b6d9f05074139b8cde7 Aug 04 23:06:42.417852 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Project-Name: admin Aug 04 23:06:42.417852 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Role: admin,reader,member Aug 04 23:06:42.417852 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Roles: admin,reader,member Aug 04 23:06:42.419449 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/57180b6266444b6d9f05074139b8cde7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_57180b6266444b6d9f05074139b8cde7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/57180b6266444b6d9f05074139b8cde7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/57180b6266444b6d9f05074139b8cde7"}]}] Aug 04 23:06:42.419449 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Tenant: admin Aug 04 23:06:42.419449 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Tenant-Id: 57180b6266444b6d9f05074139b8cde7 Aug 04 23:06:42.419449 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Tenant-Name: admin Aug 04 23:06:42.419449 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-User: admin Aug 04 23:06:42.419449 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-User-Domain-Id: default Aug 04 23:06:42.419449 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-User-Domain-Name: Default Aug 04 23:06:42.419449 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-User-Id: 4ae73490baa943239b4d5f63b8bb98d1 Aug 04 23:06:42.419449 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-User-Name: admin Aug 04 23:06:42.419449 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: method: > Aug 04 23:06:42.419449 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: exception: Flavor 84 could not be found. Aug 04 23:06:42.419449 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: action_args: {'id': '84'} Aug 04 23:06:42.419449 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:06:42.419449 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:06:42.420412 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 23:06:42.420412 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 23:06:42.420412 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 23:06:42.420412 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 23:06:42.420412 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 23:06:42.420412 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 23:06:42.420412 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 23:06:42.420412 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 23:06:42.420412 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 23:06:42.420412 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:06:42.420412 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 23:06:42.420412 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 23:06:42.420412 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 23:06:42.420412 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Aug 04 23:06:42.420412 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:06:42.420412 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Aug 04 23:06:42.420412 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:06:42.420412 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:06:42.420412 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:06:42.422117 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:06:42.422117 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:06:42.422117 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:06:42.422117 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:06:42.422117 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 23:06:42.422117 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:06:42.422117 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 23:06:42.422117 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Aug 04 23:06:42.422117 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:06:42.422117 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Aug 04 23:06:42.422117 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:06:42.422117 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:06:42.422117 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:06:42.422117 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:06:42.422117 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:06:42.422117 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 23:06:42.422117 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Aug 04 23:06:42.422117 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-a37f1105-ed8c-4f15-bf03-97544baccf2c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:06:42.423207 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-a37f1105-ed8c-4f15-bf03-97544baccf2c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013185 Aug 04 23:06:42.423207 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 24/47] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Aug 4 23:06:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 23:06:43.431892 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-dff181e4-20b7-4234-b4a0-319e87c9dcee admin admin] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:43.432911 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-dff181e4-20b7-4234-b4a0-319e87c9dcee admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 04 23:06:43.433316 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 24/48] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Aug 4 23:06:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:06:43.998039 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-2a026e8c-a3ff-429f-b3f7-eed3bcb9b57b admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:44.003858 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.wsgi [None req-2a026e8c-a3ff-429f-b3f7-eed3bcb9b57b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 23:06:44.005946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-2a026e8c-a3ff-429f-b3f7-eed3bcb9b57b admin admin] Request method failure captured: Aug 04 23:06:44.005946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 23:06:44.005946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: Accept: application/json Aug 04 23:06:44.005946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: Accept-Encoding: gzip, deflate Aug 04 23:06:44.005946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: Connection: keep-alive Aug 04 23:06:44.005946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: Content-Length: 0 Aug 04 23:06:44.005946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: Host: 10.222.0.33 Aug 04 23:06:44.005946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: Openstack-Api-Version: compute 2.90 Aug 04 23:06:44.005946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: Openstack-System-Scope: None Aug 04 23:06:44.005946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: User-Agent: python-novaclient Aug 04 23:06:44.005946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Auth-Token: gAAAAABi7FEDiKGViFKd_nM78W-s2hRCbX-Zn3BmVQvUhWVDeXvq28vkIYUcEwrIauDnHGFGTPZZEsQXyuvdF5Mfqp3f2x5Eckivw-feUCEvSgbZuham8a4oSU67kZhkX_fxgsHDLgkKdjWMlUITKumzzysi5DXCiNXHPt8Ig9At0PS6R4JWOqA Aug 04 23:06:44.005946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Domain-Id: None Aug 04 23:06:44.005946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Domain-Name: None Aug 04 23:06:44.005946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Identity-Status: Confirmed Aug 04 23:06:44.005946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Is-Admin-Project: True Aug 04 23:06:44.005946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 23:06:44.005946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Project-Domain-Id: default Aug 04 23:06:44.005946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Project-Domain-Name: Default Aug 04 23:06:44.005946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Project-Id: 57180b6266444b6d9f05074139b8cde7 Aug 04 23:06:44.005946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Project-Name: admin Aug 04 23:06:44.005946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Role: admin,reader,member Aug 04 23:06:44.005946 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Roles: admin,reader,member Aug 04 23:06:44.007538 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/57180b6266444b6d9f05074139b8cde7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_57180b6266444b6d9f05074139b8cde7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/57180b6266444b6d9f05074139b8cde7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/57180b6266444b6d9f05074139b8cde7"}]}] Aug 04 23:06:44.007538 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Tenant: admin Aug 04 23:06:44.007538 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Tenant-Id: 57180b6266444b6d9f05074139b8cde7 Aug 04 23:06:44.007538 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-Tenant-Name: admin Aug 04 23:06:44.007538 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-User: admin Aug 04 23:06:44.007538 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-User-Domain-Id: default Aug 04 23:06:44.007538 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-User-Domain-Name: Default Aug 04 23:06:44.007538 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-User-Id: 4ae73490baa943239b4d5f63b8bb98d1 Aug 04 23:06:44.007538 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: X-User-Name: admin Aug 04 23:06:44.007538 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: method: > Aug 04 23:06:44.007538 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: exception: Flavor 451 could not be found. Aug 04 23:06:44.007538 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: action_args: {'id': '451'} Aug 04 23:06:44.007538 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:06:44.007538 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:06:44.008535 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 23:06:44.008535 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 23:06:44.008535 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 23:06:44.008535 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 23:06:44.008535 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 23:06:44.008535 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 23:06:44.008535 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 23:06:44.008535 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 23:06:44.008535 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 23:06:44.008535 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:06:44.008535 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 23:06:44.008535 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 23:06:44.008535 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 23:06:44.008535 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Aug 04 23:06:44.008535 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:06:44.008535 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Aug 04 23:06:44.008535 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:06:44.008535 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:06:44.008535 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:06:44.009868 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:06:44.009868 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:06:44.009868 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:06:44.009868 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:06:44.009868 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 23:06:44.009868 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:06:44.009868 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 23:06:44.009868 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Aug 04 23:06:44.009868 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:06:44.009868 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Aug 04 23:06:44.009868 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:06:44.009868 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:06:44.009868 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:06:44.009868 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:06:44.009868 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:06:44.009868 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 23:06:44.009868 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: ERROR nova.api.openstack.wsgi Aug 04 23:06:44.009868 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-2a026e8c-a3ff-429f-b3f7-eed3bcb9b57b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:06:44.011200 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-2a026e8c-a3ff-429f-b3f7-eed3bcb9b57b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.425092 Aug 04 23:06:44.011200 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 25/49] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Aug 4 23:06:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 23:06:44.017232 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-fe4f5513-dc36-411b-9a84-287dc570b438 admin admin] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:44.032557 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-fe4f5513-dc36-411b-9a84-287dc570b438 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018873 Aug 04 23:06:44.033124 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 25/50] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Aug 4 23:06:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:06:44.043344 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-75a1655a-743e-4a26-af7c-c1b91d116370 admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:44.058945 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-75a1655a-743e-4a26-af7c-c1b91d116370 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019174 Aug 04 23:06:44.059501 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 26/51] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Aug 4 23:06:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:06:44.069238 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-813f70f0-0e75-4d60-9a40-652a79376da9 admin admin] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:44.074655 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.wsgi [None req-813f70f0-0e75-4d60-9a40-652a79376da9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 23:06:44.076139 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-813f70f0-0e75-4d60-9a40-652a79376da9 admin admin] Request method failure captured: Aug 04 23:06:44.076139 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 23:06:44.076139 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: Accept: application/json Aug 04 23:06:44.076139 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: Accept-Encoding: gzip, deflate Aug 04 23:06:44.076139 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: Connection: keep-alive Aug 04 23:06:44.076139 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: Content-Length: 0 Aug 04 23:06:44.076139 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: Host: 10.222.0.33 Aug 04 23:06:44.076139 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: Openstack-Api-Version: compute 2.90 Aug 04 23:06:44.076139 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: Openstack-System-Scope: None Aug 04 23:06:44.076139 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: User-Agent: python-novaclient Aug 04 23:06:44.076139 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Auth-Token: gAAAAABi7FEDiKGViFKd_nM78W-s2hRCbX-Zn3BmVQvUhWVDeXvq28vkIYUcEwrIauDnHGFGTPZZEsQXyuvdF5Mfqp3f2x5Eckivw-feUCEvSgbZuham8a4oSU67kZhkX_fxgsHDLgkKdjWMlUITKumzzysi5DXCiNXHPt8Ig9At0PS6R4JWOqA Aug 04 23:06:44.076139 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Domain-Id: None Aug 04 23:06:44.076139 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Domain-Name: None Aug 04 23:06:44.076139 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Identity-Status: Confirmed Aug 04 23:06:44.076139 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Is-Admin-Project: True Aug 04 23:06:44.076139 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 23:06:44.076139 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Project-Domain-Id: default Aug 04 23:06:44.076139 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Project-Domain-Name: Default Aug 04 23:06:44.076139 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Project-Id: 57180b6266444b6d9f05074139b8cde7 Aug 04 23:06:44.076139 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Project-Name: admin Aug 04 23:06:44.076139 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Role: admin,reader,member Aug 04 23:06:44.076139 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Roles: admin,reader,member Aug 04 23:06:44.077720 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/57180b6266444b6d9f05074139b8cde7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_57180b6266444b6d9f05074139b8cde7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/57180b6266444b6d9f05074139b8cde7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/57180b6266444b6d9f05074139b8cde7"}]}] Aug 04 23:06:44.077720 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Tenant: admin Aug 04 23:06:44.077720 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Tenant-Id: 57180b6266444b6d9f05074139b8cde7 Aug 04 23:06:44.077720 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-Tenant-Name: admin Aug 04 23:06:44.077720 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-User: admin Aug 04 23:06:44.077720 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-User-Domain-Id: default Aug 04 23:06:44.077720 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-User-Domain-Name: Default Aug 04 23:06:44.077720 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-User-Id: 4ae73490baa943239b4d5f63b8bb98d1 Aug 04 23:06:44.077720 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: X-User-Name: admin Aug 04 23:06:44.077720 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: method: > Aug 04 23:06:44.077720 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: exception: Flavor 451 could not be found. Aug 04 23:06:44.077720 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: action_args: {'id': '451'} Aug 04 23:06:44.077720 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:06:44.077720 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:06:44.078643 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 23:06:44.078643 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 23:06:44.078643 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 23:06:44.078643 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 23:06:44.078643 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 23:06:44.078643 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 23:06:44.078643 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 23:06:44.078643 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 23:06:44.078643 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 23:06:44.078643 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:06:44.078643 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 23:06:44.078643 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 23:06:44.078643 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 23:06:44.078643 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Aug 04 23:06:44.078643 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:06:44.078643 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Aug 04 23:06:44.078643 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:06:44.078643 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:06:44.078643 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:06:44.079709 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:06:44.079709 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:06:44.079709 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:06:44.079709 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:06:44.079709 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 23:06:44.079709 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:06:44.079709 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 23:06:44.079709 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Aug 04 23:06:44.079709 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:06:44.079709 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Aug 04 23:06:44.079709 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:06:44.079709 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:06:44.079709 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:06:44.079709 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:06:44.079709 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:06:44.079709 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 23:06:44.079709 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: ERROR nova.api.openstack.wsgi Aug 04 23:06:44.079709 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-813f70f0-0e75-4d60-9a40-652a79376da9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:06:44.080988 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-813f70f0-0e75-4d60-9a40-652a79376da9 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011967 Aug 04 23:06:44.080988 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 26/52] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Aug 4 23:06:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 23:06:45.091921 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-75a1655a-743e-4a26-af7c-c1b91d116370 admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:45.093023 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-75a1655a-743e-4a26-af7c-c1b91d116370 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 04 23:06:45.093427 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 27/53] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Aug 4 23:06:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:06:45.795714 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-1dbe10b5-072b-4934-891d-ea12e9682522 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:06:45.819921 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-1dbe10b5-072b-4934-891d-ea12e9682522 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.581256 Aug 04 23:06:45.820589 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 27/54] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Aug 4 23:06:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 23:06:46.821835 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-75a1655a-743e-4a26-af7c-c1b91d116370 admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:46.822860 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-75a1655a-743e-4a26-af7c-c1b91d116370 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 04 23:06:46.823260 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 28/55] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Aug 4 23:06:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:06:47.374694 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-31c82a8f-cb80-41ed-b680-d517864a540a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:06:47.398373 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-31c82a8f-cb80-41ed-b680-d517864a540a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.437816 Aug 04 23:06:47.399034 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 28/56] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Aug 4 23:06:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 23:06:48.404238 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-75a1655a-743e-4a26-af7c-c1b91d116370 admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:48.405295 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-75a1655a-743e-4a26-af7c-c1b91d116370 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 04 23:06:48.405708 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 29/57] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Aug 4 23:06:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:06:48.982920 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-6a396189-4fa7-4491-8e99-faf1256cea1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:06:49.002933 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-6a396189-4fa7-4491-8e99-faf1256cea1f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.457024 Aug 04 23:06:49.003492 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 29/58] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Aug 4 23:06:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 23:06:49.999833 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-75a1655a-743e-4a26-af7c-c1b91d116370 admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:50.000960 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-75a1655a-743e-4a26-af7c-c1b91d116370 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001682 Aug 04 23:06:50.001499 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 30/59] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Aug 4 23:06:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:06:50.586034 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-705f09bd-d9c5-48cf-b1ad-cd3d05778aee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:06:50.607020 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-705f09bd-d9c5-48cf-b1ad-cd3d05778aee admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.461368 Aug 04 23:06:50.607576 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 30/60] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Aug 4 23:06:50 2022] POST /compute/v2.1/flavors => generated 409 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 23:06:51.635955 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-75a1655a-743e-4a26-af7c-c1b91d116370 admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:51.636988 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-75a1655a-743e-4a26-af7c-c1b91d116370 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 04 23:06:51.637395 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 31/61] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Aug 4 23:06:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:06:52.203819 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-2dc41841-923c-4e8b-9fe4-2f917a43ddae admin admin] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:06:52.225603 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-2dc41841-923c-4e8b-9fe4-2f917a43ddae admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.447479 Aug 04 23:06:52.226203 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 31/62] 10.222.0.33 () {60 vars in 1202 bytes} [Thu Aug 4 23:06:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:07:45.667628 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-75a1655a-743e-4a26-af7c-c1b91d116370 admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:07:45.668637 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-75a1655a-743e-4a26-af7c-c1b91d116370 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 04 23:07:45.669045 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 32/63] 10.222.0.33 () {54 vars in 931 bytes} [Thu Aug 4 23:07:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:07:45.681347 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG dbcounter [-] [115265] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:07:46.112934 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-ce3bb9f1-29a1-401d-a54e-1f1d846cb9a9 admin admin] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:07:46.135632 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-ce3bb9f1-29a1-401d-a54e-1f1d846cb9a9 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.459028 Aug 04 23:07:46.136207 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 32/64] 10.222.0.33 () {60 vars in 1292 bytes} [Thu Aug 4 23:07:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:07:46.158832 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG dbcounter [-] [115264] Writing DB stats nova_api:SELECT=14 {{(pid=115264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:07:46.163060 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-0cb1d88e-5a3d-4a18-95fb-3a7b449561b7 admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:07:46.172193 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-0cb1d88e-5a3d-4a18-95fb-3a7b449561b7 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015800 Aug 04 23:07:46.173488 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 33/65] 10.222.0.33 () {60 vars in 1283 bytes} [Thu Aug 4 23:07:46 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:07:46.185972 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-220c0c26-990f-4659-a107-15e757d3b4b7 admin admin] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:07:46.195001 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-220c0c26-990f-4659-a107-15e757d3b4b7 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012669 Aug 04 23:07:46.195591 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 33/66] 10.222.0.33 () {60 vars in 1286 bytes} [Thu Aug 4 23:07:46 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:07:46.212602 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-1952a517-8541-454e-99cb-0bf5735981e3 admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:07:46.225122 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-1952a517-8541-454e-99cb-0bf5735981e3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019562 Aug 04 23:07:46.225848 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 34/67] 10.222.0.33 () {60 vars in 1286 bytes} [Thu Aug 4 23:07:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:07:46.239721 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-9c0e6986-d229-4c40-ac6e-8c241ee6fdbc admin admin] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:07:46.248243 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-9c0e6986-d229-4c40-ac6e-8c241ee6fdbc admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013449 Aug 04 23:07:46.248845 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 34/68] 10.222.0.33 () {60 vars in 1283 bytes} [Thu Aug 4 23:07:46 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:10:48.311920 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-1952a517-8541-454e-99cb-0bf5735981e3 admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:10:48.312930 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-1952a517-8541-454e-99cb-0bf5735981e3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 04 23:10:48.313332 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 35/69] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Aug 4 23:10:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:10:48.458178 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG dbcounter [-] [115265] Writing DB stats nova_api:SELECT=6 {{(pid=115265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:10:48.617380 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-088fe9f9-f53c-44fe-bf4f-1c0bc0b1a2c7 admin admin] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:10:48.619728 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 23:10:48.619728 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: warnings.warn(msg) Aug 04 23:10:48.620840 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-088fe9f9-f53c-44fe-bf4f-1c0bc0b1a2c7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:10:48.621322 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-088fe9f9-f53c-44fe-bf4f-1c0bc0b1a2c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:10:48.621781 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-088fe9f9-f53c-44fe-bf4f-1c0bc0b1a2c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:10:48.622520 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-088fe9f9-f53c-44fe-bf4f-1c0bc0b1a2c7 admin admin] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:10:48.622967 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-088fe9f9-f53c-44fe-bf4f-1c0bc0b1a2c7 admin admin] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:10:48.623381 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-088fe9f9-f53c-44fe-bf4f-1c0bc0b1a2c7 admin admin] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:10:48.658316 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-088fe9f9-f53c-44fe-bf4f-1c0bc0b1a2c7 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.201500 Aug 04 23:10:48.658904 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 35/70] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Aug 4 23:10:48 2022] GET /compute/v2.1/os-services => generated 791 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 23:10:49.496539 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-1952a517-8541-454e-99cb-0bf5735981e3 admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:10:49.497562 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-1952a517-8541-454e-99cb-0bf5735981e3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 04 23:10:49.497962 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 36/71] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Aug 4 23:10:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:10:49.696420 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-fa9fd816-b0e9-41dd-866d-9911904b908a admin admin] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:10:49.698837 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 23:10:49.698837 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: warnings.warn(msg) Aug 04 23:10:49.699937 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-fa9fd816-b0e9-41dd-866d-9911904b908a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:10:49.700405 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-fa9fd816-b0e9-41dd-866d-9911904b908a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:10:49.700827 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-fa9fd816-b0e9-41dd-866d-9911904b908a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:10:49.701528 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-fa9fd816-b0e9-41dd-866d-9911904b908a admin admin] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:10:49.701966 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-fa9fd816-b0e9-41dd-866d-9911904b908a admin admin] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:10:49.702391 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-fa9fd816-b0e9-41dd-866d-9911904b908a admin admin] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:10:49.722560 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-fa9fd816-b0e9-41dd-866d-9911904b908a admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081460 Aug 04 23:10:49.723056 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 36/72] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Aug 4 23:10:49 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 23:11:00.980614 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-1952a517-8541-454e-99cb-0bf5735981e3 admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:11:00.981621 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-1952a517-8541-454e-99cb-0bf5735981e3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 04 23:11:00.982014 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 37/73] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Aug 4 23:11:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:11:01.125382 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG dbcounter [-] [115265] Writing DB stats nova_cell0:SELECT=4 {{(pid=115265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:11:01.126094 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG dbcounter [-] [115265] Writing DB stats nova_cell1:SELECT=4 {{(pid=115265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:11:01.126793 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG dbcounter [-] [115265] Writing DB stats nova_api:SELECT=8 {{(pid=115265) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:11:01.176162 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-7187b9da-bee5-471d-8ec7-a7dd9df58a5e admin admin] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:11:01.178606 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 23:11:01.178606 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: warnings.warn(msg) Aug 04 23:11:01.179845 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-7187b9da-bee5-471d-8ec7-a7dd9df58a5e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:11:01.180330 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-7187b9da-bee5-471d-8ec7-a7dd9df58a5e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:11:01.180754 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-7187b9da-bee5-471d-8ec7-a7dd9df58a5e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:11:01.182002 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-7187b9da-bee5-471d-8ec7-a7dd9df58a5e admin admin] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:11:01.182546 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-7187b9da-bee5-471d-8ec7-a7dd9df58a5e admin admin] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:11:01.182969 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-7187b9da-bee5-471d-8ec7-a7dd9df58a5e admin admin] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:11:01.208265 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-7187b9da-bee5-471d-8ec7-a7dd9df58a5e admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087312 Aug 04 23:11:01.208824 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 37/74] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Aug 4 23:11:01 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:11:02.052598 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: DEBUG nova.api.openstack.wsgi [None req-1952a517-8541-454e-99cb-0bf5735981e3 admin admin] Calling method '>' {{(pid=115264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:11:02.053653 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: INFO nova.api.openstack.requestlog [None req-1952a517-8541-454e-99cb-0bf5735981e3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 04 23:11:02.054063 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: [pid: 115264|app: 0|req: 38/75] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Aug 4 23:11:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:11:02.262345 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG nova.api.openstack.wsgi [None req-6fcdf49b-c7ff-47b0-90dd-2fde960f11a8 admin admin] Calling method '>' {{(pid=115265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:11:02.264732 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 23:11:02.264732 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: warnings.warn(msg) Aug 04 23:11:02.265871 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-6fcdf49b-c7ff-47b0-90dd-2fde960f11a8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:11:02.266381 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-6fcdf49b-c7ff-47b0-90dd-2fde960f11a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:11:02.266821 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-6fcdf49b-c7ff-47b0-90dd-2fde960f11a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:11:02.267537 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-6fcdf49b-c7ff-47b0-90dd-2fde960f11a8 admin admin] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:11:02.267987 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-6fcdf49b-c7ff-47b0-90dd-2fde960f11a8 admin admin] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:11:02.268440 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: DEBUG oslo_concurrency.lockutils [None req-6fcdf49b-c7ff-47b0-90dd-2fde960f11a8 admin admin] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:11:02.290462 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: INFO nova.api.openstack.requestlog [None req-6fcdf49b-c7ff-47b0-90dd-2fde960f11a8 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084356 Aug 04 23:11:02.291031 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: [pid: 115265|app: 0|req: 38/76] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Aug 4 23:11:02 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:11:59.502981 dv-cinder-852210-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 04 23:11:59.504063 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: Thu Aug 4 23:11:59 2022 - graceful shutdown triggered... Aug 04 23:11:59.504516 dv-cinder-852210-1-iscsi devstack@n-api.service[115265]: Gracefully killing worker 2 (pid: 115265)... Aug 04 23:11:59.504988 dv-cinder-852210-1-iscsi devstack@n-api.service[115264]: Gracefully killing worker 1 (pid: 115264)... Aug 04 23:12:00.504173 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: worker 1 buried after 1 seconds Aug 04 23:12:00.504743 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: worker 2 buried after 1 seconds Aug 04 23:12:00.504743 dv-cinder-852210-1-iscsi devstack@n-api.service[115263]: goodbye to uWSGI. Aug 04 23:12:00.505844 dv-cinder-852210-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 04 23:12:00.506444 dv-cinder-852210-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 04 23:12:00.509783 dv-cinder-852210-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 23:12:00.518998 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 23:12:00.521589 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 23:12:00 2022] *** Aug 04 23:12:00.521737 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 23:12:00.521872 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 23:12:00.521988 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: nodename: dv-cinder-852210-1-iscsi Aug 04 23:12:00.522107 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: machine: x86_64 Aug 04 23:12:00.522227 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: clock source: unix Aug 04 23:12:00.522340 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: pcre jit disabled Aug 04 23:12:00.522475 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: detected number of CPU cores: 4 Aug 04 23:12:00.522585 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: current working directory: / Aug 04 23:12:00.522712 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: detected binary path: /usr/bin/uwsgi-core Aug 04 23:12:00.522831 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: your processes number limit is 47680 Aug 04 23:12:00.522950 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: your memory page size is 4096 bytes Aug 04 23:12:00.523072 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: detected max file descriptor number: 2048 Aug 04 23:12:00.523185 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: lock engine: pthread robust mutexes Aug 04 23:12:00.523459 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: thunder lock: enabled Aug 04 23:12:00.523756 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 23:12:00.523983 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 23:12:00.567544 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: Python main interpreter initialized at 0x5623888049c0 Aug 04 23:12:00.567544 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: python threads support enabled Aug 04 23:12:00.567544 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: your server socket listen backlog is limited to 100 connections Aug 04 23:12:00.567544 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: your mercy for graceful operations on workers is 90 seconds Aug 04 23:12:00.567951 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 23:12:00.567951 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: *** Operational MODE: preforking *** Aug 04 23:12:00.568248 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: *** uWSGI is running in multiple interpreter mode *** Aug 04 23:12:00.568248 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: spawned uWSGI master process (pid: 129767) Aug 04 23:12:00.568452 dv-cinder-852210-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 23:12:00.569012 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: spawned uWSGI worker 1 (pid: 129790, cores: 1) Aug 04 23:12:00.569516 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: spawned uWSGI worker 2 (pid: 129791, cores: 1) Aug 04 23:12:00.569806 dv-cinder-852210-1-iscsi devstack@n-api.service[129767]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 23:12:01.235411 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 23:12:01.246129 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 23:12:02.392396 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 23:12:02.392396 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: from cryptography.utils import int_from_bytes Aug 04 23:12:02.393077 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 23:12:02.393077 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: from cryptography.utils import int_from_bytes Aug 04 23:12:02.429121 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 23:12:02.429121 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: from cryptography.utils import int_from_bytes Aug 04 23:12:02.429699 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 23:12:02.429699 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: from cryptography.utils import int_from_bytes Aug 04 23:12:04.721837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 23:12:04.722443 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 23:12:04.722752 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 23:12:04.723007 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 23:12:04.723267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 23:12:04.723659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.724703 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.724703 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.724703 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.724957 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.725227 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.725556 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.725879 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.726209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.726495 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.726817 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.727745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-1-iscsi {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.728616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.728616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.728904 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.729230 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.729541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.729869 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.730192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.730726 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.732259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.732259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.732259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.732259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.732585 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.732785 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.733037 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.733351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.733675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.733993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.734420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-1-iscsi {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.734761 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.735068 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.735382 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.735802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.736245 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.736442 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.736767 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.737058 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.737366 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.737950 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.738107 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.738316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.738646 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.738950 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.739268 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.739578 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.739898 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.740204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.740514 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.740763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.741072 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.741395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.741718 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.742042 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.742316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.742570 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.743486 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.743812 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.744126 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.744434 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.744744 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.745056 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.745365 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.745672 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.745979 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.746287 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.746631 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.746947 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.747268 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.747576 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.747897 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.748299 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.748549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.748859 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.749201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.749521 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.749828 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.750148 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.750489 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.750896 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.751106 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.751412 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.751858 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.752066 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.752374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.752623 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.752927 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.753233 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.753551 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.753859 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.754169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.754520 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.754802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.755112 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.755418 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.755724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.756033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.756339 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.756645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.756950 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.757254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.757562 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.757883 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.758202 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.759120 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.759433 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.759738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.760046 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.760368 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.760677 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.760983 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.761313 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.761617 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.761923 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.762243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.762593 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.762887 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.763209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.763510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.763819 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.764137 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.764447 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.764797 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.765096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.765574 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.765886 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.766194 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.766524 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.766833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.767142 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.767533 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.767854 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.768167 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.768476 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.768784 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.769106 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.769448 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.769788 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.770132 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.770472 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.770820 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.771157 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.771477 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.771877 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.772110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.772441 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.772753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.773066 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.773380 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.773700 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.774066 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.774415 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.774738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.775058 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.775383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.775695 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.776014 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.776345 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.776671 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.776983 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.777326 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.777671 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.777990 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.778314 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.778682 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.778998 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.779313 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.779632 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.779954 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.780291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.780595 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.780917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.781232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.781545 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.781854 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.782165 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.782501 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.782837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.783154 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.783470 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.783784 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.784104 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.784419 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.784733 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.785045 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.785357 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.785662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.785968 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.786275 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.786615 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.786942 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.787266 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.787573 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.787908 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.788217 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.788527 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.788837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.789149 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.789533 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.789837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.790199 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.790556 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.790850 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.791179 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.791467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.791793 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.792105 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.792412 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.792730 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.793040 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.793352 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.793664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.793978 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.794303 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.794641 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.794954 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.796376 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.796376 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.796376 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.796376 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.797009 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.797009 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.797289 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.797447 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.797736 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.798042 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.798348 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.799396 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.799396 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.799396 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.799867 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.799867 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.800158 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.800440 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.800749 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.801055 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.801359 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.801663 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.802008 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.802313 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.802680 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.803013 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.803236 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 23:12:04.803722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.803880 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 23:12:04.804035 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.804035 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.804332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 23:12:04.804487 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.804641 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 23:12:04.804796 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.804943 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 23:12:04.805090 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.805876 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.806045 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.806201 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.806555 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.806718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.806878 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.807036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.807183 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.807336 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.807483 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.807629 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.807789 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.807938 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.808083 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.808331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.808484 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.810010 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.810131 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.810241 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.810330 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.810444 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.810527 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.810609 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-1-iscsi {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.810697 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.810798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.810871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.810949 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.811042 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.811131 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.811212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.811284 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.811361 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.811433 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.811503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.811590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.811662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.811741 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.811813 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.811813 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.811956 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.812057 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.812132 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.812252 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.812345 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.812564 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.812683 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.812886 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.812989 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.813193 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.813286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.813516 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.813615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.813827 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.813913 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.814139 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.814232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.814463 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.814550 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.814779 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.814872 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.815108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.815198 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-1-iscsi {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.815443 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.815547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.815759 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.815904 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.816073 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.816265 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.816432 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.816680 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.816860 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.817013 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.817170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.817327 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.817474 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.817646 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.817803 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.817952 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.818108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.818255 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.818459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.818617 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.818772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.818926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.819081 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.819265 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.819428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.819577 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.819735 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.819889 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.820037 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.820184 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.820344 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.820502 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.820649 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.820803 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.821594 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.821820 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.822023 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.822174 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.822321 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.822583 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.822740 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.822922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.823089 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.823250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.823399 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.823545 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.823701 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.823701 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.823701 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.824163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.824321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.824483 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.824637 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.824800 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.824948 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.825099 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.825246 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.825401 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.825559 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.825709 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.825862 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.826017 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.826172 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.826329 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.826516 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.826666 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.826814 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.826968 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.827122 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.827275 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.827434 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.827589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.827742 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.827889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.828044 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.828200 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.828374 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.829891 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.830004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.830100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.830176 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.830325 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.830442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.830516 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.830516 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.830659 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.830731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.830829 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.830904 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.830990 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.831063 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.831140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.831221 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.831221 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.831360 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.831497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.831579 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.831658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.831806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.831936 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.832228 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.832669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.833008 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.833319 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.833445 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.833639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.833742 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.833956 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.834056 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.834273 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.834511 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.834638 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.834860 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.834949 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.835197 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.835428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.835598 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.835762 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.835928 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.836079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.836236 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.836402 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.836583 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.836731 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.836893 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.837042 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.837244 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.837456 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.837608 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.837756 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.837913 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.838069 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.838224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.838476 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.838633 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.838794 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.838960 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.839115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.839272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.839431 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.839584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.839746 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.839899 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.840057 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.840212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.840368 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.840515 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.840676 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.840831 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.840831 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.841126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.841280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.841492 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.841654 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.841812 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.841999 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.842152 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.842341 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.842541 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.842771 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.842945 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.843102 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.843279 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.843439 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.843616 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.843778 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.843934 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.844127 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.844294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.844505 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.844678 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.844860 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.845060 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.845227 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.845381 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.845533 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.845695 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.845867 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.846028 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.846196 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.846350 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.846553 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.846708 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.846872 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.847033 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.847197 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.847350 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.847511 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.847672 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.847827 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.847999 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.848154 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.848307 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.848458 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.848618 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.848774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.848947 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.849107 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.849269 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.849430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.849584 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.849736 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.849903 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.850067 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.850221 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.850400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.850570 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.850724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.850896 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.851058 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.851219 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.851406 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.851564 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.851731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.851886 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.852049 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.852807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.853048 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.853220 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.853386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.853551 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.853713 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.853867 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.854030 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.854199 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 23:12:04.854199 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.854639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.854804 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.854978 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.854978 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.855271 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.855439 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.855593 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.855745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.855898 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.856052 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.856216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.856377 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.856531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.856690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.856851 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.857015 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.857185 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.857339 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.857504 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.857658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.857811 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.857964 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.858125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.858287 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.858466 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.858621 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.858786 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.858959 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.859123 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.859286 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.859440 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.859591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.859743 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.859910 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.860064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.860217 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.860378 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.860541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.860702 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.860865 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.860865 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.861188 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.861351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.861548 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.861845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.862021 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.862183 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.862345 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.862559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.862748 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.863026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.863026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.863346 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.863514 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.863677 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.863831 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.863994 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.864149 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.864311 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.864477 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.864477 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.864783 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.864965 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.865163 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.865325 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.865479 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.865653 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.865814 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.865978 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.866139 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.866293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.866470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.866636 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.866797 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.866959 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.867114 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.867274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.867436 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.867597 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.868409 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.868574 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.868737 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.868891 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.869052 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.869206 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.869373 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.869536 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.869691 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.869845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.870006 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.870160 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.870332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.870593 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.870760 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.871053 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.871215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.871376 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.871545 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.871698 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.871852 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.872013 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.872168 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.872335 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.872504 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.872677 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.872838 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.872992 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.873153 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.873334 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.873550 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.873712 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.873874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.874029 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.874183 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.874351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.874537 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.874702 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.874702 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.875016 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.875171 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.875334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.875488 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.875641 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.875801 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.875955 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.876119 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.876274 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.876427 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.876587 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.876741 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.876912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.877081 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.877235 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.877389 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.877541 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.877695 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.877856 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.877856 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.878165 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.878327 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.878517 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.878681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.878852 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.879021 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.879183 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.879344 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.879497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.879659 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.879822 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.879991 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.880146 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.880301 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.880484 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.880640 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.880872 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.881039 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.881192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.881346 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.881501 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.881662 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.881829 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.881983 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.882145 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.882308 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.882525 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.882525 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.882832 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.883004 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.883242 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.883471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.883631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.883798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.883961 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.884115 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.884274 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.884436 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.884593 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.884759 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.884921 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.885081 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.885245 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.885406 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.885562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.885562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.885882 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.886036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.886204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.886376 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.886538 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.886710 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.886872 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.887034 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.887196 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.887369 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.887537 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.887691 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.887844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.887998 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.888161 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.888314 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.888544 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.888708 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.888861 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.889021 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.889174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.889335 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.889511 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.889511 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.889822 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.889976 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.890136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.890290 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.890495 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.890652 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.890808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.890808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.890808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.891262 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.891417 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.891579 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.891735 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.891888 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.892049 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.892049 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.892351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.892517 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.892679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.892834 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.892986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.893149 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.893302 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.893471 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.893631 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.893792 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.893954 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.894117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.894271 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.894450 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.894617 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.894778 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.894942 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.895097 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.895250 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.895410 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.895574 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.895742 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.895912 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.896067 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.896228 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.896382 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.896534 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.896686 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.896847 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.897002 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.897163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.897324 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.897477 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.897639 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.897806 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.897968 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.898122 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.898283 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.898502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.898673 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.898835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.899012 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.899172 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.899326 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.899478 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.899646 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.899818 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.899981 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.900136 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.900289 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.900442 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.900604 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.900757 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.900918 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.901079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.901233 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.901385 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.901552 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.901707 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.901877 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.902038 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.902193 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.902373 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.902548 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.902703 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.902871 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.903033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.903187 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.903355 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.903525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.903686 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.903853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.904015 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.904176 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.904352 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.904512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.904665 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.904818 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.904972 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.905132 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.905298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.905461 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.905615 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.905775 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.905939 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.906106 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.906267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.906477 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.906637 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.906790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.906943 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.907109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.907263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.907416 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.907569 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.907737 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.907891 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.908068 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.908828 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.909000 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.909155 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.909310 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.909464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.909634 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.909789 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.909943 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.910098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.910259 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.910445 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.910617 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.910791 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.910954 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.911109 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.911264 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.911433 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.911596 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.911752 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.911907 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.912061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.912216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.912384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.912546 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.912720 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.912875 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.913029 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.913185 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.913353 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.913509 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.913671 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.913835 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.913989 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.914157 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.914327 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.914536 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.915219 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.915392 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.915719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.915951 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.916173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.916377 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.916631 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.916889 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.917058 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.917228 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.917383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.917538 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.917692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.917854 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.918024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.918198 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.918198 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.918537 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.918692 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.918846 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.919062 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.919222 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.919376 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.919538 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.919693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.919854 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.920103 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.920268 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.920430 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.920591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.920745 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.920899 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.921066 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.921229 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.921229 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.921530 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.921692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.921848 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.922011 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.922179 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.922333 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.922513 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.922680 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.922846 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.923001 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.923163 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.923364 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.923544 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.923701 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.923874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.924029 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.924201 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.924372 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.924540 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.924703 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.924869 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.925023 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.925185 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.925351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.925513 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.925676 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.925830 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.925984 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.926149 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.926317 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.926510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.926667 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.926821 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.926975 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.927138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.927293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.927455 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.927609 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.927763 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.927924 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.928093 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.928259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.928414 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.928569 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.928724 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.928878 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.929046 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.929211 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.929366 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.929522 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.929684 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.929838 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.930001 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.930167 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.930354 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.931164 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.931164 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.931469 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.931703 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.931888 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.932051 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.932214 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.932369 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.932532 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.932688 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.932849 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.933026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.933189 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.933344 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.933510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.933665 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.933827 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.933982 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.934144 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.934306 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.934574 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.934745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.934915 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.935081 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.935260 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.935426 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.935581 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.935742 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.935898 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.936052 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.936214 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.936369 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.936530 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.936685 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.936850 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.937014 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.937014 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.937325 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.937325 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.937618 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.937771 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.937940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.938094 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.938254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.938454 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.938626 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.938790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.938955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.939109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.939273 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.939435 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.939590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.939751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.939751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.940060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.940215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.940369 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.940523 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.940691 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.940845 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.940998 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.941153 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.941318 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.941480 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.941720 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.941878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.942032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.942186 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.942347 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.942529 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.942700 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.942856 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.943017 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.943179 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.943342 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.943508 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.943672 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.943828 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.943982 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.944144 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.944300 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.944462 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.944617 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.944771 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.944935 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.945090 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.945252 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.945420 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.945586 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.945747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.945949 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.946122 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.946280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.946470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.946628 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.946782 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.946937 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.946937 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.947229 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.947394 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.947596 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.947766 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.947929 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.948092 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.948260 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.948423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.948650 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.948820 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.948976 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.949131 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.949299 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.949456 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.949624 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.949798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.949962 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.949962 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.950277 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.950520 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.950678 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.950843 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.950997 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.951151 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.951315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.951469 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.951634 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.951797 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.951962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.951962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.952266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.952420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.952575 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.952575 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.952882 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.952882 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.953191 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.953345 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.953506 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.953668 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.953830 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.954008 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.954163 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.954324 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.954515 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.954679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.954852 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.955018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.955173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.955333 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.955487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.955641 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.955805 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.955988 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.956144 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.956298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.956459 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.956613 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.956777 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.956940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.957094 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.957255 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.957677 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.957841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.958005 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.958169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.958341 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.958522 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.958690 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.958848 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.959016 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.959178 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.959332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.959492 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.959647 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.959814 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.959971 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.960124 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.960285 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.960453 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.960608 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.960770 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.960925 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.961080 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.961234 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.961395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.961587 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.961756 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.961911 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.962073 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.962301 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.962536 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.962703 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.962860 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.963014 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.963177 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.963332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.963486 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.963654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.963817 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.963979 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.964135 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.964291 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.964453 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.964631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.964804 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.964959 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.964959 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.965263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.965426 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.965590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.965744 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.965898 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.966060 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.966215 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.966411 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.966584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.966739 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.966893 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.967047 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.967208 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.967208 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.967525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.967681 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.967834 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.967996 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.968159 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.968328 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.968483 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.968646 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.968809 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.968809 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.969121 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.969275 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.969430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.969584 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.969738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.969738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.970043 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.970198 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.970351 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.970568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.970723 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.970889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.971053 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.971215 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.971369 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.971524 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.971686 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.971888 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.972136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.972300 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.972465 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.972621 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.972794 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.972963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.973126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.973287 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.973448 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.973612 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.973774 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.973942 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.974096 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.974258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.974430 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.974599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.974768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.974943 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.974943 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.975253 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.975408 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.975570 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.975732 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.975897 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.976059 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.976214 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.976376 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.976538 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.976713 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.976870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.977035 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.977799 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.978040 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.978040 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.978396 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.978557 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.978713 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.978713 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.979007 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.979161 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.979328 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.979492 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.979708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.979708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.980016 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.980179 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.980349 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.980504 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.980659 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.980814 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.980969 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.981132 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.981294 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.981457 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.981620 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.981787 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.981949 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.982113 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.982268 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.982549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.982723 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.982895 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.983059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.983225 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.983380 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.983534 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.983687 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.983841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.984020 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.984176 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.984331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.984484 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.984645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.984807 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.984971 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.985144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.985300 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.985455 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.985617 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.985772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.985951 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.986107 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.986262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.986433 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.986606 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.986763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.986933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.987089 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.987245 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.987408 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.987571 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.987740 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.987895 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.988076 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.988241 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.988396 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.988557 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.988726 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.988889 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.989051 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.989213 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.989376 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.989540 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.989706 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.989861 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.990043 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.990199 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.990354 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.990556 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.990734 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.990897 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.991060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.991223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.991387 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.991556 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.991719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.991874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.992029 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.992202 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.992357 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.992522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.992685 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.993519 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.993677 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.993847 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.994004 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.994173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.994337 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.994549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.994717 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.994881 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.995071 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.995232 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.995396 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 23:12:04.995562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.995562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.995562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.995562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.995562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.995562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.995562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.995562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.996742 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.996742 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.996742 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.996742 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.996742 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.996742 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.996742 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.996742 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.997926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.997926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.997926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.997926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.997926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.997926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.997926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.997926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.999168 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.999168 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.999168 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.999168 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.999168 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.999168 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.999168 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:04.999168 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.000432 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.000432 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.000432 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.000432 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.000432 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.000432 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.000432 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.000432 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.001593 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.001593 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.001593 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.001593 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.001593 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.001593 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.001593 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.001593 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.002801 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.002801 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.002801 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.002801 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.002801 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.002801 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.004131 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.004131 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.004131 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.004131 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.004761 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.004761 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.005401 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.005401 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.005695 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.005857 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.006152 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.006496 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.006874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.007126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.007502 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.007758 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.008096 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.008542 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.008875 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.009204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.009527 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.009844 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.011038 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.011038 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.011386 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.011541 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.011738 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.012061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.012387 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.012721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.013031 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.013342 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.013656 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.013968 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.014274 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.014630 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.014945 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.015255 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.015578 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.015891 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.016490 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.017068 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.017262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.017486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.017808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.018128 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.018466 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.018798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.019107 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.019421 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.019741 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.020054 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.020363 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.021294 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.021294 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.021294 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.021793 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.021947 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.022179 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.022541 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.022854 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.023162 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.023465 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.023780 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.024126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.024428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.024738 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.025044 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.025357 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.025663 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.025976 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.026282 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.026626 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.026933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.027357 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.027535 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.027928 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.028166 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.028534 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.028861 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.029182 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.029508 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.029826 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.030140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.031684 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.031684 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.031684 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.032188 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.032188 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.032506 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.032722 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.033033 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.033343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.033653 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.033983 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.034298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.034645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.034960 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.035273 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.035586 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.035897 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.036212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.036524 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.036837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.037150 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.037559 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.037745 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.038118 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.038417 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.038715 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.039077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.039404 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.040332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.040654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.040975 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.041733 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.041733 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.042218 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.042454 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.042690 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.043031 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.043354 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.043668 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.044113 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.044432 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.044754 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.045081 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.045397 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.045724 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.046428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.046767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.047064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.047384 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.047729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.048075 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.048417 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.048727 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.049044 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.049361 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.049669 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.049984 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.050312 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.050653 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.050963 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.051272 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.051999 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.051999 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.052466 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.052466 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.052789 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.053057 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.053365 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.053671 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.053999 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.054282 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.054636 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.054943 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.055896 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.056391 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.056707 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.057017 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.057330 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.057638 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.058081 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.058308 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.058861 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.059198 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.059526 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.059855 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.060169 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.060501 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.060827 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.061151 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.061467 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.062198 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.062198 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.062714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.062886 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.063125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.063360 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.063677 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.064014 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.064345 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.064657 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.064992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.065315 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.065644 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.065966 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.066281 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.066659 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.066976 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.067291 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.067606 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.068130 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.068310 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.068542 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.069048 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.069373 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.069696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.070198 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.070463 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.070726 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.071596 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.072320 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.072320 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.072820 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.073027 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.073360 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.073695 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.074017 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.074334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.074688 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 23:12:05.074937 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 23:12:05.145448 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO dbcounter [None req-a5c28420-b63b-4cfb-9dfe-b7737e38fb9c None None] Registered counter for database nova_api Aug 04 23:12:05.167982 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_db.sqlalchemy.engines [None req-a5c28420-b63b-4cfb-9dfe-b7737e38fb9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 23:12:05.175026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writer thread running {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 23:12:05.228727 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO dbcounter [None req-e3ee4687-d1ef-40b3-a4dc-2b5fa230080f None None] Registered counter for database nova_api Aug 04 23:12:05.233027 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.context [None req-a5c28420-b63b-4cfb-9dfe-b7737e38fb9c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87c32cd0-6efe-4e80-b8c3-7af92af1b107(cell1) {{(pid=129790) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 23:12:05.237083 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5c28420-b63b-4cfb-9dfe-b7737e38fb9c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:12:05.237559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5c28420-b63b-4cfb-9dfe-b7737e38fb9c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:12:05.239200 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5c28420-b63b-4cfb-9dfe-b7737e38fb9c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:12:05.239932 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5c28420-b63b-4cfb-9dfe-b7737e38fb9c None None] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:12:05.240380 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5c28420-b63b-4cfb-9dfe-b7737e38fb9c None None] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:12:05.242430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5c28420-b63b-4cfb-9dfe-b7737e38fb9c None None] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:12:05.245302 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO dbcounter [None req-a5c28420-b63b-4cfb-9dfe-b7737e38fb9c None None] Registered counter for database nova_cell0 Aug 04 23:12:05.249362 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_db.sqlalchemy.engines [None req-e3ee4687-d1ef-40b3-a4dc-2b5fa230080f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 23:12:05.249516 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO dbcounter [None req-a5c28420-b63b-4cfb-9dfe-b7737e38fb9c None None] Registered counter for database nova_cell1 Aug 04 23:12:05.256493 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_db.sqlalchemy.engines [None req-a5c28420-b63b-4cfb-9dfe-b7737e38fb9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 23:12:05.256702 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writer thread running {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 23:12:05.259343 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_db.sqlalchemy.engines [None req-a5c28420-b63b-4cfb-9dfe-b7737e38fb9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 23:12:05.264859 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writer thread running {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 23:12:05.266903 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writer thread running {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 23:12:05.315038 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.context [None req-e3ee4687-d1ef-40b3-a4dc-2b5fa230080f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),87c32cd0-6efe-4e80-b8c3-7af92af1b107(cell1) {{(pid=129791) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 23:12:05.319077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e3ee4687-d1ef-40b3-a4dc-2b5fa230080f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:12:05.319551 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e3ee4687-d1ef-40b3-a4dc-2b5fa230080f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:12:05.321710 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e3ee4687-d1ef-40b3-a4dc-2b5fa230080f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:12:05.322457 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e3ee4687-d1ef-40b3-a4dc-2b5fa230080f None None] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:12:05.322902 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e3ee4687-d1ef-40b3-a4dc-2b5fa230080f None None] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:12:05.325238 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e3ee4687-d1ef-40b3-a4dc-2b5fa230080f None None] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:12:05.327528 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO dbcounter [None req-e3ee4687-d1ef-40b3-a4dc-2b5fa230080f None None] Registered counter for database nova_cell0 Aug 04 23:12:05.331560 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO dbcounter [None req-e3ee4687-d1ef-40b3-a4dc-2b5fa230080f None None] Registered counter for database nova_cell1 Aug 04 23:12:05.339030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_db.sqlalchemy.engines [None req-e3ee4687-d1ef-40b3-a4dc-2b5fa230080f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 23:12:05.340947 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_db.sqlalchemy.engines [None req-e3ee4687-d1ef-40b3-a4dc-2b5fa230080f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 23:12:05.347086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writer thread running {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 23:12:05.349127 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writer thread running {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 23:12:05.412534 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO dbcounter [None req-a5c28420-b63b-4cfb-9dfe-b7737e38fb9c None None] Registered counter for database nova_cell0 Aug 04 23:12:05.420252 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_db.sqlalchemy.engines [None req-a5c28420-b63b-4cfb-9dfe-b7737e38fb9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 23:12:05.424862 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writer thread running {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 23:12:05.496749 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO dbcounter [None req-e3ee4687-d1ef-40b3-a4dc-2b5fa230080f None None] Registered counter for database nova_cell0 Aug 04 23:12:05.503367 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_db.sqlalchemy.engines [None req-e3ee4687-d1ef-40b3-a4dc-2b5fa230080f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 23:12:05.508124 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writer thread running {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 23:12:05.747335 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: WARNING keystonemiddleware.auth_token [None req-a5c28420-b63b-4cfb-9dfe-b7737e38fb9c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 23:12:05.754744 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: WARNING keystonemiddleware.auth_token [None req-a5c28420-b63b-4cfb-9dfe-b7737e38fb9c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 23:12:05.834669 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: WARNING keystonemiddleware.auth_token [None req-e3ee4687-d1ef-40b3-a4dc-2b5fa230080f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 23:12:05.840551 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: WARNING keystonemiddleware.auth_token [None req-e3ee4687-d1ef-40b3-a4dc-2b5fa230080f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 23:12:06.099834 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: WARNING keystonemiddleware.auth_token [None req-a5c28420-b63b-4cfb-9dfe-b7737e38fb9c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 23:12:06.107301 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: WARNING keystonemiddleware.auth_token [None req-a5c28420-b63b-4cfb-9dfe-b7737e38fb9c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 23:12:06.113885 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5623888049c0 pid: 129790 (default app) Aug 04 23:12:06.192325 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: WARNING keystonemiddleware.auth_token [None req-e3ee4687-d1ef-40b3-a4dc-2b5fa230080f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 23:12:06.198536 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: WARNING keystonemiddleware.auth_token [None req-e3ee4687-d1ef-40b3-a4dc-2b5fa230080f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 23:12:06.205064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5623888049c0 pid: 129791 (default app) Aug 04 23:12:42.096683 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=3 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:12:42.098876 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=3 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:12:42.099992 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=3 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:12:42.100904 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=3 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:12:43.476563 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=3 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:12:43.479470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=3 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:12:43.480237 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=3 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:12:43.480960 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=3 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:12:44.229949 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-96e8e9ba-ff39-4553-870f-d4a6c552d24a tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] Action: 'create', calling method: .version_select at 0x7f6d27e37dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1839511528", "metadata": {"Type": "work"}}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:12:44.237909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-96e8e9ba-ff39-4553-870f-d4a6c552d24a tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] Request method failure captured: Aug 04 23:12:44.237909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 23:12:44.237909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:12:44.237909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:12:44.237909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:12:44.237909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 122 Aug 04 23:12:44.237909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:12:44.237909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:12:44.237909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:12:44.237909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:12:44.237909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FJpB_KI8K1UtE_kKdIvQfgBeFwudxTDYFE4Xz9jlgpMv0eNgxc65MHSl8mc8ZhR9pfaUNqSV4gVwOB9hA2JUE302PWgfS1oOCq_RBmmvt4d6-nn8yCiORKrIpgZa5DQLlHuhRCqB1A0GKqbQkn5ATNsC4DT5lkvg07xhnRpQNNv2KE Aug 04 23:12:44.237909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:12:44.237909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:12:44.237909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:12:44.237909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:12:44.237909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:12:44.237909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:12:44.237909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: 25c8c82c90a644db900e38e539cd7aef Aug 04 23:12:44.237909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-VolumesNegativeTest-2092376573 Aug 04 23:12:44.237909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:12:44.237909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:12:44.239374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/25c8c82c90a644db900e38e539cd7aef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_25c8c82c90a644db900e38e539cd7aef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/25c8c82c90a644db900e38e539cd7aef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/25c8c82c90a644db900e38e539cd7aef"}]}] Aug 04 23:12:44.239374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-VolumesNegativeTest-2092376573 Aug 04 23:12:44.239374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: 25c8c82c90a644db900e38e539cd7aef Aug 04 23:12:44.239374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-VolumesNegativeTest-2092376573 Aug 04 23:12:44.239374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-VolumesNegativeTest-2092376573-project Aug 04 23:12:44.239374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:12:44.239374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:12:44.239374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: 6ca9b8f7647646d7b9bf477e138a24fb Aug 04 23:12:44.239374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-VolumesNegativeTest-2092376573-project Aug 04 23:12:44.239374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Aug 04 23:12:44.239374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1839511528", "metadata": {"Type": "work"}}} Aug 04 23:12:44.239374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: Aug 04 23:12:44.239374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 23:12:44.240218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1839511528', 'metadata': {'Type': 'work'}}}} Aug 04 23:12:44.240218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:12:44.240218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:44.240218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 23:12:44.240218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 23:12:44.240218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 23:12:44.240218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise error Aug 04 23:12:44.240218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 04 23:12:44.240218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:44.240218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 23:12:44.240218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 23:12:44.240218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:44.240218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 23:12:44.240218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi '#$%' Aug 04 23:12:44.240218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:44.240218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:12:44.240218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:44.240218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:44.240218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:12:44.240218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:12:44.240218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:12:44.240218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:12:44.241705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 23:12:44.241705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 23:12:44.241705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:12:44.241705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:12:44.241705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 23:12:44.241705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 23:12:44.241705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 23:12:44.241705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 23:12:44.241705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 23:12:44.241705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 23:12:44.241705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 23:12:44.241705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:44.241705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:12:44.241705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:44.241705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:44.241705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:12:44.241705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:12:44.241705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 23:12:44.241705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 23:12:44.243713 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 23:12:44.243713 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:44.245503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-96e8e9ba-ff39-4553-870f-d4a6c552d24a tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:12:44.247064 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-96e8e9ba-ff39-4553-870f-d4a6c552d24a tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 2.171319 Aug 04 23:12:44.252631 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Aug 4 23:12:42 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 2178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 23:12:44.258861 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f74333c5-6d41-4431-b568-d82c9a871a3b tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] Action: 'create', calling method: .version_select at 0x7f6d27d438b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-896187341", "metadata": {"Type": "work"}}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:12:44.264031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f74333c5-6d41-4431-b568-d82c9a871a3b tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] Request method failure captured: Aug 04 23:12:44.264031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 23:12:44.264031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:12:44.264031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:12:44.264031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:12:44.264031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 119 Aug 04 23:12:44.264031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:12:44.264031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:12:44.264031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:12:44.264031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:12:44.264031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FJpB_KI8K1UtE_kKdIvQfgBeFwudxTDYFE4Xz9jlgpMv0eNgxc65MHSl8mc8ZhR9pfaUNqSV4gVwOB9hA2JUE302PWgfS1oOCq_RBmmvt4d6-nn8yCiORKrIpgZa5DQLlHuhRCqB1A0GKqbQkn5ATNsC4DT5lkvg07xhnRpQNNv2KE Aug 04 23:12:44.264031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:12:44.264031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:12:44.264031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:12:44.264031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:12:44.264031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:12:44.264031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:12:44.264031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: 25c8c82c90a644db900e38e539cd7aef Aug 04 23:12:44.264031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-VolumesNegativeTest-2092376573 Aug 04 23:12:44.264031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:12:44.264031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:12:44.265319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/25c8c82c90a644db900e38e539cd7aef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_25c8c82c90a644db900e38e539cd7aef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/25c8c82c90a644db900e38e539cd7aef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/25c8c82c90a644db900e38e539cd7aef"}]}] Aug 04 23:12:44.265319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-VolumesNegativeTest-2092376573 Aug 04 23:12:44.265319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: 25c8c82c90a644db900e38e539cd7aef Aug 04 23:12:44.265319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-VolumesNegativeTest-2092376573 Aug 04 23:12:44.265319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-VolumesNegativeTest-2092376573-project Aug 04 23:12:44.265319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:12:44.265319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:12:44.265319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: 6ca9b8f7647646d7b9bf477e138a24fb Aug 04 23:12:44.265319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-VolumesNegativeTest-2092376573-project Aug 04 23:12:44.265319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Aug 04 23:12:44.265319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-896187341", "metadata": {"Type": "work"}}} Aug 04 23:12:44.265319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: Aug 04 23:12:44.265319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 23:12:44.266086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-896187341', 'metadata': {'Type': 'work'}}}} Aug 04 23:12:44.266086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:12:44.266086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:44.266086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 23:12:44.266086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 23:12:44.266086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 23:12:44.266086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise error Aug 04 23:12:44.266086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 23:12:44.266086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:44.266086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 04 23:12:44.266086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 23:12:44.266086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:44.266086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 23:12:44.266086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi '0' Aug 04 23:12:44.266086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:44.266086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:12:44.266086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:44.266086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:44.266086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:12:44.266086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:12:44.266086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:12:44.266086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:12:44.267811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 23:12:44.267811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 23:12:44.267811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:12:44.267811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:12:44.267811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 23:12:44.267811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 23:12:44.267811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 23:12:44.267811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 23:12:44.267811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 23:12:44.267811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 23:12:44.267811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 23:12:44.267811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:44.267811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:12:44.267811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:44.267811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:44.267811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:12:44.267811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:12:44.267811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 23:12:44.267811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 23:12:44.270688 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 23:12:44.270688 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:44.271835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f74333c5-6d41-4431-b568-d82c9a871a3b tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:12:44.273362 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f74333c5-6d41-4431-b568-d82c9a871a3b tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.019060 Aug 04 23:12:44.280030 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 2/2] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Aug 4 23:12:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 23:12:44.285711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4cbeaddd-5729-45fb-8b02-d78575ddd546 tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] Action: 'create', calling method: .version_select at 0x7f6d27cf3940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-527269811", "metadata": {"Type": "work"}}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:12:44.291315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4cbeaddd-5729-45fb-8b02-d78575ddd546 tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] Request method failure captured: Aug 04 23:12:44.291315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 23:12:44.291315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:12:44.291315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:12:44.291315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:12:44.291315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 118 Aug 04 23:12:44.291315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:12:44.291315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:12:44.291315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:12:44.291315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:12:44.291315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FJpB_KI8K1UtE_kKdIvQfgBeFwudxTDYFE4Xz9jlgpMv0eNgxc65MHSl8mc8ZhR9pfaUNqSV4gVwOB9hA2JUE302PWgfS1oOCq_RBmmvt4d6-nn8yCiORKrIpgZa5DQLlHuhRCqB1A0GKqbQkn5ATNsC4DT5lkvg07xhnRpQNNv2KE Aug 04 23:12:44.291315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:12:44.291315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:12:44.291315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:12:44.291315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:12:44.291315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:12:44.291315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:12:44.291315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: 25c8c82c90a644db900e38e539cd7aef Aug 04 23:12:44.291315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-VolumesNegativeTest-2092376573 Aug 04 23:12:44.291315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:12:44.291315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:12:44.292639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/25c8c82c90a644db900e38e539cd7aef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_25c8c82c90a644db900e38e539cd7aef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/25c8c82c90a644db900e38e539cd7aef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/25c8c82c90a644db900e38e539cd7aef"}]}] Aug 04 23:12:44.292639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-VolumesNegativeTest-2092376573 Aug 04 23:12:44.292639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: 25c8c82c90a644db900e38e539cd7aef Aug 04 23:12:44.292639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-VolumesNegativeTest-2092376573 Aug 04 23:12:44.292639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-VolumesNegativeTest-2092376573-project Aug 04 23:12:44.292639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:12:44.292639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:12:44.292639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: 6ca9b8f7647646d7b9bf477e138a24fb Aug 04 23:12:44.292639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-VolumesNegativeTest-2092376573-project Aug 04 23:12:44.292639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Aug 04 23:12:44.292639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-527269811", "metadata": {"Type": "work"}}} Aug 04 23:12:44.292639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: Aug 04 23:12:44.292639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 23:12:44.293414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-527269811', 'metadata': {'Type': 'work'}}}} Aug 04 23:12:44.293414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:12:44.293414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:44.293414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 23:12:44.293414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 23:12:44.293414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 23:12:44.293414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise error Aug 04 23:12:44.293414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 04 23:12:44.293414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:44.293414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 23:12:44.293414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 23:12:44.293414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:44.293414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 23:12:44.293414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi '' Aug 04 23:12:44.293414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:44.293414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:12:44.293414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:44.293414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:44.293414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:12:44.293414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:12:44.293414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:12:44.293414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:12:44.294722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 23:12:44.294722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 23:12:44.294722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:12:44.294722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:12:44.294722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 23:12:44.294722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 23:12:44.294722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 23:12:44.294722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 23:12:44.294722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 23:12:44.294722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 23:12:44.294722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 23:12:44.294722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:44.294722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:12:44.294722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:44.294722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:44.294722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:12:44.294722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:12:44.294722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 23:12:44.294722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 23:12:44.295787 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 23:12:44.295787 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:44.297466 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4cbeaddd-5729-45fb-8b02-d78575ddd546 tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:12:44.298576 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4cbeaddd-5729-45fb-8b02-d78575ddd546 tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017260 Aug 04 23:12:44.299364 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 3/3] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Aug 4 23:12:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 23:12:44.310666 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-cb07cdf5-7c54-4bb8-9b22-1df42735f2bb tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] Calling method '.version_select at 0x7f6d27cf3670>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:12:44.587131 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5803968e-8c1c-455e-b801-24f6511cdf22 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Action: 'create', calling method: .version_select at 0x7f6d27e37dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1648527890"}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:12:45.191217 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-cb07cdf5-7c54-4bb8-9b22-1df42735f2bb tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] HTTP exception thrown: Volume tempest-invalid-290658372 could not be found. Aug 04 23:12:45.195236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-cb07cdf5-7c54-4bb8-9b22-1df42735f2bb tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] Request method failure captured: Aug 04 23:12:45.195236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-290658372 HTTP/1.1 Aug 04 23:12:45.195236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:12:45.195236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:12:45.195236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:12:45.195236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:12:45.195236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:12:45.195236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:12:45.195236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:12:45.195236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:12:45.195236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FJpB_KI8K1UtE_kKdIvQfgBeFwudxTDYFE4Xz9jlgpMv0eNgxc65MHSl8mc8ZhR9pfaUNqSV4gVwOB9hA2JUE302PWgfS1oOCq_RBmmvt4d6-nn8yCiORKrIpgZa5DQLlHuhRCqB1A0GKqbQkn5ATNsC4DT5lkvg07xhnRpQNNv2KE Aug 04 23:12:45.195236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:12:45.195236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:12:45.195236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:12:45.195236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:12:45.195236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:12:45.195236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:12:45.195236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: 25c8c82c90a644db900e38e539cd7aef Aug 04 23:12:45.195236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-VolumesNegativeTest-2092376573 Aug 04 23:12:45.195236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:12:45.195236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:12:45.197087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/25c8c82c90a644db900e38e539cd7aef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_25c8c82c90a644db900e38e539cd7aef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/25c8c82c90a644db900e38e539cd7aef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/25c8c82c90a644db900e38e539cd7aef"}]}] Aug 04 23:12:45.197087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-VolumesNegativeTest-2092376573 Aug 04 23:12:45.197087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: 25c8c82c90a644db900e38e539cd7aef Aug 04 23:12:45.197087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-VolumesNegativeTest-2092376573 Aug 04 23:12:45.197087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-VolumesNegativeTest-2092376573-project Aug 04 23:12:45.197087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:12:45.197087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:12:45.197087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: 6ca9b8f7647646d7b9bf477e138a24fb Aug 04 23:12:45.197087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-VolumesNegativeTest-2092376573-project Aug 04 23:12:45.197087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: Aug 04 23:12:45.197087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Volume tempest-invalid-290658372 could not be found. Aug 04 23:12:45.197087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': 'tempest-invalid-290658372'} Aug 04 23:12:45.197087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:12:45.198024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:45.198024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 23:12:45.198024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 23:12:45.198024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 23:12:45.198024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 23:12:45.198024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 23:12:45.198024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 23:12:45.198024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 23:12:45.198024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 23:12:45.198024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 23:12:45.198024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 23:12:45.198024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:12:45.198024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:12:45.198024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:12:45.198024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:12:45.198024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-290658372 could not be found. (HTTP 404) (Request-ID: req-77953641-0548-4d73-9ae6-87e4325ea978) Aug 04 23:12:45.198024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:45.198024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:12:45.198024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:45.202513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:45.202513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 23:12:45.202513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 23:12:45.202513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 23:12:45.202513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 23:12:45.202513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 23:12:45.202513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 23:12:45.202513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 23:12:45.202513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 23:12:45.202513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 23:12:45.202513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 23:12:45.202513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 23:12:45.202513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 23:12:45.202513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 23:12:45.202513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 23:12:45.202513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 23:12:45.202513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 23:12:45.202513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 23:12:45.202513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 23:12:45.204962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:12:45.204962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:12:45.204962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:12:45.204962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:12:45.204962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-290658372 could not be found. Aug 04 23:12:45.204962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:45.204962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:12:45.204962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:45.204962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:45.204962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:12:45.204962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:12:45.204962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:12:45.204962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:12:45.204962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 23:12:45.204962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 23:12:45.204962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:12:45.204962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:12:45.204962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 23:12:45.204962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:12:45.204962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-290658372 could not be found. Aug 04 23:12:45.210000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:45.210000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:12:45.210000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:45.210000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:45.210000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:12:45.210000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:12:45.210000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:12:45.210000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:12:45.210000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-290658372 could not be found. Aug 04 23:12:45.210000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:45.210000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-cb07cdf5-7c54-4bb8-9b22-1df42735f2bb tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] Returning 404 to user: Volume tempest-invalid-290658372 could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:12:45.210000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-cb07cdf5-7c54-4bb8-9b22-1df42735f2bb tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-290658372" status: 404 len: 98 microversion: 2.1 time: 0.892298 Aug 04 23:12:45.210000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 4/4] 10.222.0.33 () {58 vars in 1215 bytes} [Thu Aug 4 23:12:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-290658372 => generated 98 bytes in 897 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 23:12:45.215782 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f9d69941-d079-45e0-ae5e-81478b7d530e tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005680 Aug 04 23:12:45.216482 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 5/5] 10.222.0.33 () {58 vars in 1140 bytes} [Thu Aug 4 23:12:45 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 23:12:45.235975 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4957cc90-acd1-477e-8b55-08dbc25311be tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003805 Aug 04 23:12:45.237658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 6/6] 10.222.0.33 () {58 vars in 1137 bytes} [Thu Aug 4 23:12:45 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 23:12:45.247566 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2901d267-6564-4f71-b472-1ebf34662079 tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] Calling method '.version_select at 0x7f6d27c3fca0>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:12:46.511903 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-2901d267-6564-4f71-b472-1ebf34662079 tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] HTTP exception thrown: Volume 37c840f9-f449-4fbc-94a6-1794ded2eabc could not be found. Aug 04 23:12:46.514581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2901d267-6564-4f71-b472-1ebf34662079 tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] Request method failure captured: Aug 04 23:12:46.514581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: DELETE /compute/v2.1/os-volumes/37c840f9-f449-4fbc-94a6-1794ded2eabc HTTP/1.1 Aug 04 23:12:46.514581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:12:46.514581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:12:46.514581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:12:46.514581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:12:46.514581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:12:46.514581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:12:46.514581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:12:46.514581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:12:46.514581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FJpB_KI8K1UtE_kKdIvQfgBeFwudxTDYFE4Xz9jlgpMv0eNgxc65MHSl8mc8ZhR9pfaUNqSV4gVwOB9hA2JUE302PWgfS1oOCq_RBmmvt4d6-nn8yCiORKrIpgZa5DQLlHuhRCqB1A0GKqbQkn5ATNsC4DT5lkvg07xhnRpQNNv2KE Aug 04 23:12:46.514581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:12:46.514581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:12:46.514581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:12:46.514581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:12:46.514581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:12:46.514581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:12:46.514581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: 25c8c82c90a644db900e38e539cd7aef Aug 04 23:12:46.514581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-VolumesNegativeTest-2092376573 Aug 04 23:12:46.514581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:12:46.514581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:12:46.515945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/25c8c82c90a644db900e38e539cd7aef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_25c8c82c90a644db900e38e539cd7aef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/25c8c82c90a644db900e38e539cd7aef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/25c8c82c90a644db900e38e539cd7aef"}]}] Aug 04 23:12:46.515945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-VolumesNegativeTest-2092376573 Aug 04 23:12:46.515945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: 25c8c82c90a644db900e38e539cd7aef Aug 04 23:12:46.515945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-VolumesNegativeTest-2092376573 Aug 04 23:12:46.515945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-VolumesNegativeTest-2092376573-project Aug 04 23:12:46.515945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:12:46.515945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:12:46.515945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: 6ca9b8f7647646d7b9bf477e138a24fb Aug 04 23:12:46.515945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-VolumesNegativeTest-2092376573-project Aug 04 23:12:46.515945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: Aug 04 23:12:46.515945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Volume 37c840f9-f449-4fbc-94a6-1794ded2eabc could not be found. Aug 04 23:12:46.515945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': '37c840f9-f449-4fbc-94a6-1794ded2eabc'} Aug 04 23:12:46.515945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:12:46.516763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:46.516763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 23:12:46.516763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 23:12:46.516763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 23:12:46.516763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 23:12:46.516763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 23:12:46.516763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 23:12:46.516763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 23:12:46.516763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 23:12:46.516763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 23:12:46.516763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 23:12:46.516763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:12:46.516763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:12:46.516763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:12:46.516763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:12:46.516763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 37c840f9-f449-4fbc-94a6-1794ded2eabc could not be found. (HTTP 404) (Request-ID: req-26bc4fa0-a482-404a-a4ae-cfc3064f78ae) Aug 04 23:12:46.516763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:46.516763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:12:46.516763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:46.517906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:46.517906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 23:12:46.517906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 23:12:46.517906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 23:12:46.517906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 23:12:46.517906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 23:12:46.517906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 23:12:46.517906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 23:12:46.517906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 23:12:46.517906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 23:12:46.517906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 23:12:46.517906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 23:12:46.517906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 23:12:46.517906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 23:12:46.517906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 23:12:46.517906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 23:12:46.517906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 23:12:46.517906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 23:12:46.517906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 23:12:46.519026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:12:46.519026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:12:46.519026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:12:46.519026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:12:46.519026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 37c840f9-f449-4fbc-94a6-1794ded2eabc could not be found. Aug 04 23:12:46.519026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:46.519026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:12:46.519026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:46.519026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:46.519026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:12:46.519026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:12:46.519026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:12:46.519026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:12:46.519026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 23:12:46.519026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 23:12:46.519026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:12:46.519026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:12:46.519026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 23:12:46.519026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:12:46.520232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 37c840f9-f449-4fbc-94a6-1794ded2eabc could not be found. Aug 04 23:12:46.520232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:46.520232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:12:46.520232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:46.520232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:46.520232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:12:46.520232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:12:46.520232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:12:46.520232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:12:46.520232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 37c840f9-f449-4fbc-94a6-1794ded2eabc could not be found. Aug 04 23:12:46.520232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:46.520232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2901d267-6564-4f71-b472-1ebf34662079 tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] Returning 404 to user: Volume 37c840f9-f449-4fbc-94a6-1794ded2eabc could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:12:46.520232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2901d267-6564-4f71-b472-1ebf34662079 tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/37c840f9-f449-4fbc-94a6-1794ded2eabc" status: 404 len: 109 microversion: 2.1 time: 1.272463 Aug 04 23:12:46.523503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 7/7] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Aug 4 23:12:45 2022] DELETE /compute/v2.1/os-volumes/37c840f9-f449-4fbc-94a6-1794ded2eabc => generated 109 bytes in 1280 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:12:46.536519 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-46010298-1f1a-4c2d-b88e-9265a281cb2a tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] Calling method '.version_select at 0x7f6d27c3fd30>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:12:46.924027 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-46010298-1f1a-4c2d-b88e-9265a281cb2a tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] HTTP exception thrown: Volume 01861012-f2b3-45e7-9cd1-ff05061b60e8 could not be found. Aug 04 23:12:46.926258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-46010298-1f1a-4c2d-b88e-9265a281cb2a tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] Request method failure captured: Aug 04 23:12:46.926258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: GET /compute/v2.1/os-volumes/01861012-f2b3-45e7-9cd1-ff05061b60e8 HTTP/1.1 Aug 04 23:12:46.926258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:12:46.926258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:12:46.926258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:12:46.926258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:12:46.926258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:12:46.926258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:12:46.926258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:12:46.926258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:12:46.926258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FJpB_KI8K1UtE_kKdIvQfgBeFwudxTDYFE4Xz9jlgpMv0eNgxc65MHSl8mc8ZhR9pfaUNqSV4gVwOB9hA2JUE302PWgfS1oOCq_RBmmvt4d6-nn8yCiORKrIpgZa5DQLlHuhRCqB1A0GKqbQkn5ATNsC4DT5lkvg07xhnRpQNNv2KE Aug 04 23:12:46.926258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:12:46.926258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:12:46.926258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:12:46.926258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:12:46.926258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:12:46.926258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:12:46.926258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: 25c8c82c90a644db900e38e539cd7aef Aug 04 23:12:46.926258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-VolumesNegativeTest-2092376573 Aug 04 23:12:46.926258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:12:46.926258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:12:46.927629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/25c8c82c90a644db900e38e539cd7aef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_25c8c82c90a644db900e38e539cd7aef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/25c8c82c90a644db900e38e539cd7aef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/25c8c82c90a644db900e38e539cd7aef"}]}] Aug 04 23:12:46.927629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-VolumesNegativeTest-2092376573 Aug 04 23:12:46.927629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: 25c8c82c90a644db900e38e539cd7aef Aug 04 23:12:46.927629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-VolumesNegativeTest-2092376573 Aug 04 23:12:46.927629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-VolumesNegativeTest-2092376573-project Aug 04 23:12:46.927629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:12:46.927629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:12:46.927629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: 6ca9b8f7647646d7b9bf477e138a24fb Aug 04 23:12:46.927629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-VolumesNegativeTest-2092376573-project Aug 04 23:12:46.927629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: Aug 04 23:12:46.927629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Volume 01861012-f2b3-45e7-9cd1-ff05061b60e8 could not be found. Aug 04 23:12:46.927629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': '01861012-f2b3-45e7-9cd1-ff05061b60e8'} Aug 04 23:12:46.927629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:12:46.928430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:46.928430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 23:12:46.928430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 23:12:46.928430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 23:12:46.928430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 23:12:46.928430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 23:12:46.928430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 23:12:46.928430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 23:12:46.928430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 23:12:46.928430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 23:12:46.928430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 23:12:46.928430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:12:46.928430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:12:46.928430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:12:46.928430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:12:46.928430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 01861012-f2b3-45e7-9cd1-ff05061b60e8 could not be found. (HTTP 404) (Request-ID: req-40e2db1a-eee0-4adf-ac2a-7a00f34e720b) Aug 04 23:12:46.928430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:46.928430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:12:46.928430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:46.929560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:46.929560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 23:12:46.929560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 23:12:46.929560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 23:12:46.929560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 23:12:46.929560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 23:12:46.929560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 23:12:46.929560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 23:12:46.929560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 23:12:46.929560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 23:12:46.929560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 23:12:46.929560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 23:12:46.929560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 23:12:46.929560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 23:12:46.929560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 23:12:46.929560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 23:12:46.929560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 23:12:46.929560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 23:12:46.929560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 23:12:46.931288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:12:46.931288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:12:46.931288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:12:46.931288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:12:46.931288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 01861012-f2b3-45e7-9cd1-ff05061b60e8 could not be found. Aug 04 23:12:46.931288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:46.931288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:12:46.931288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:46.931288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:46.931288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:12:46.931288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:12:46.931288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:12:46.931288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:12:46.931288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 23:12:46.931288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 23:12:46.931288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:12:46.931288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:12:46.931288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 23:12:46.931288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:12:46.932645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 01861012-f2b3-45e7-9cd1-ff05061b60e8 could not be found. Aug 04 23:12:46.932645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:46.932645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:12:46.932645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:46.932645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:46.932645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:12:46.932645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:12:46.932645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:12:46.932645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:12:46.932645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 01861012-f2b3-45e7-9cd1-ff05061b60e8 could not be found. Aug 04 23:12:46.932645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:12:46.932645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-46010298-1f1a-4c2d-b88e-9265a281cb2a tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] Returning 404 to user: Volume 01861012-f2b3-45e7-9cd1-ff05061b60e8 could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:12:46.932645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-46010298-1f1a-4c2d-b88e-9265a281cb2a tempest-VolumesNegativeTest-2092376573 tempest-VolumesNegativeTest-2092376573-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/01861012-f2b3-45e7-9cd1-ff05061b60e8" status: 404 len: 109 microversion: 2.1 time: 0.402907 Aug 04 23:12:46.932645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 8/8] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Aug 4 23:12:46 2022] GET /compute/v2.1/os-volumes/01861012-f2b3-45e7-9cd1-ff05061b60e8 => generated 109 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:12:46.995859 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5803968e-8c1c-455e-b801-24f6511cdf22 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.548192 Aug 04 23:12:46.997882 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1/9] 10.222.0.33 () {60 vars in 1155 bytes} [Thu Aug 4 23:12:43 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3552 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 23:12:47.014790 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a6bb9f97-334c-4830-8606-d06088859b2a tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Calling method '.version_select at 0x7f6d27d1d790>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:12:47.132328 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a6bb9f97-334c-4830-8606-d06088859b2a tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/7366d0c3-3800-4b71-832f-be9f2983b29c" status: 200 len: 345 microversion: 2.1 time: 0.123610 Aug 04 23:12:47.139160 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 9/10] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Aug 4 23:12:47 2022] GET /compute/v2.1/os-volumes/7366d0c3-3800-4b71-832f-be9f2983b29c => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:12:48.147875 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a1cc329d-2f60-42d6-af46-bfca85c7c4f7 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Calling method '.version_select at 0x7f6d27cb2c10>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:12:48.297378 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a1cc329d-2f60-42d6-af46-bfca85c7c4f7 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/7366d0c3-3800-4b71-832f-be9f2983b29c" status: 200 len: 345 microversion: 2.1 time: 0.154722 Aug 04 23:12:48.298427 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 2/11] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Aug 4 23:12:48 2022] GET /compute/v2.1/os-volumes/7366d0c3-3800-4b71-832f-be9f2983b29c => generated 345 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:12:49.313731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6f36bb58-f386-4772-9268-45daa1b54802 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Calling method '.version_select at 0x7f6d27c3f0d0>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:12:49.442616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6f36bb58-f386-4772-9268-45daa1b54802 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/7366d0c3-3800-4b71-832f-be9f2983b29c" status: 200 len: 346 microversion: 2.1 time: 0.135011 Aug 04 23:12:49.443669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 10/12] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Aug 4 23:12:49 2022] GET /compute/v2.1/os-volumes/7366d0c3-3800-4b71-832f-be9f2983b29c => generated 346 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:12:49.468182 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2cdd7079-eb8a-481c-b411-3c2674b33b7f tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Action: 'create', calling method: .version_select at 0x7f6d27cc9280>, body: {"snapshot": {"volume_id": "7366d0c3-3800-4b71-832f-be9f2983b29c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1217876916"}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:12:49.879797 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2cdd7079-eb8a-481c-b411-3c2674b33b7f tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.426407 Aug 04 23:12:49.880157 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 3/13] 10.222.0.33 () {60 vars in 1162 bytes} [Thu Aug 4 23:12:49 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:12:49.900862 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-32f0ab0f-a4c4-4d37-84d5-382cd7c977cb tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Calling method '.version_select at 0x7f6d27cc74c0>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:12:50.082687 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-32f0ab0f-a4c4-4d37-84d5-382cd7c977cb tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760" status: 200 len: 287 microversion: 2.1 time: 0.195055 Aug 04 23:12:50.083753 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 4/14] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Aug 4 23:12:49 2022] GET /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760 => generated 287 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:12:50.096677 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8fac9574-5200-47e2-926c-c63097cb6f65 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Calling method '.version_select at 0x7f6d27cc9d30>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:12:50.223509 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8fac9574-5200-47e2-926c-c63097cb6f65 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.131096 Aug 04 23:12:50.224624 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 5/15] 10.222.0.33 () {58 vars in 1140 bytes} [Thu Aug 4 23:12:50 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:12:50.228224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-758d6c27-64e0-44a3-a69e-d445d5b5175a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Action: 'create', calling method: .version_select at 0x7f6d27c541f0>, body: {"keypair": {"name": "tempest-keypair-772314928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuXU3fcLqFY2ofZjCwhVQun3tOPdWWTQLWJUhDRqF+RWzrA1xUf6fzQQZ3avN0bLIvudn+c8gD5S2KMKxKTiGE1uyx81DNzmkF/9Lc7hjam6phhrLonsZJIX2UG80GsjQ=="}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:12:50.240537 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5a9c2db0-5730-4f10-a6dc-33116c9cc368 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Calling method '.version_select at 0x7f6d27cb2af0>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:12:50.317343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5a9c2db0-5730-4f10-a6dc-33116c9cc368 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760" status: 200 len: 287 microversion: 2.1 time: 0.085658 Aug 04 23:12:50.318193 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 6/16] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Aug 4 23:12:50 2022] GET /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:12:50.362016 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-758d6c27-64e0-44a3-a69e-d445d5b5175a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Getting quotas for project 0422afbb853d4ef2924edf221499971c. Resources: {'key_pairs'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:12:50.371500 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-758d6c27-64e0-44a3-a69e-d445d5b5175a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Getting quotas for user b2ceb35afcc046218bdce1ab4983d9f9 and project 0422afbb853d4ef2924edf221499971c. Resources: {'key_pairs'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:12:50.537321 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-758d6c27-64e0-44a3-a69e-d445d5b5175a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.925505 Aug 04 23:12:50.551490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 11/17] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Aug 4 23:12:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:12:51.331502 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2f751579-6c6b-4ad3-b1a0-f63baaaf4ac9 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Calling method '.version_select at 0x7f6d27cc71f0>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:12:51.417738 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2f751579-6c6b-4ad3-b1a0-f63baaaf4ac9 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760" status: 200 len: 287 microversion: 2.1 time: 0.090638 Aug 04 23:12:51.420193 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 7/18] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Aug 4 23:12:51 2022] GET /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760 => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:12:52.439910 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-49523029-2550-4417-81e8-9e5b1230c1dd tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Calling method '.version_select at 0x7f6d273a9670>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:12:52.579845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-49523029-2550-4417-81e8-9e5b1230c1dd tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760" status: 200 len: 287 microversion: 2.1 time: 0.148793 Aug 04 23:12:52.580540 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 12/19] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Aug 4 23:12:52 2022] GET /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760 => generated 287 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:12:53.600007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-bd2586be-8fe1-487e-987e-5f63058581c2 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Calling method '.version_select at 0x7f6d27cb2e50>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:12:53.648941 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-bd2586be-8fe1-487e-987e-5f63058581c2 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760" status: 200 len: 287 microversion: 2.1 time: 0.054282 Aug 04 23:12:53.649935 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 8/20] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Aug 4 23:12:53 2022] GET /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:12:54.661914 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c5e404cf-de27-4f74-be95-4640be9593e0 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Calling method '.version_select at 0x7f6d273a9d30>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:12:54.745469 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c5e404cf-de27-4f74-be95-4640be9593e0 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760" status: 200 len: 287 microversion: 2.1 time: 0.087666 Aug 04 23:12:54.746652 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 13/21] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Aug 4 23:12:54 2022] GET /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:12:55.761115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-407d89a4-8db6-4a77-863e-d21a9cf8b6f9 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Calling method '.version_select at 0x7f6d27cc9160>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:12:55.925543 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-407d89a4-8db6-4a77-863e-d21a9cf8b6f9 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760" status: 200 len: 287 microversion: 2.1 time: 0.171045 Aug 04 23:12:55.926470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 9/22] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Aug 4 23:12:55 2022] GET /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760 => generated 287 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:12:56.939150 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-91b5f5bc-f542-4749-844f-c0897922fd0d tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Calling method '.version_select at 0x7f6d273d5430>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:12:57.011802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-91b5f5bc-f542-4749-844f-c0897922fd0d tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760" status: 200 len: 287 microversion: 2.1 time: 0.076569 Aug 04 23:12:57.013084 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 14/23] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Aug 4 23:12:56 2022] GET /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:12:58.045586 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7d55e824-5a62-499d-8cc2-b63a1e8f1601 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Calling method '.version_select at 0x7f6d27cc99d0>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:12:58.211064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7d55e824-5a62-499d-8cc2-b63a1e8f1601 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760" status: 200 len: 288 microversion: 2.1 time: 0.190078 Aug 04 23:12:58.227658 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 10/24] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Aug 4 23:12:58 2022] GET /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760 => generated 288 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:12:58.227940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-fde04ab9-3325-4876-a5aa-b95324cb2a91 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Calling method '.version_select at 0x7f6d273a9dc0>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:12:58.352838 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-fde04ab9-3325-4876-a5aa-b95324cb2a91 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760" status: 202 len: 0 microversion: 2.1 time: 0.131346 Aug 04 23:12:58.359469 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 15/25] 10.222.0.33 () {58 vars in 1254 bytes} [Thu Aug 4 23:12:58 2022] DELETE /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:12:58.366407 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-43d7c68b-3590-4941-a0eb-b7b3a8da5160 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Calling method '.version_select at 0x7f6d27cc79d0>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:12:58.568306 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-43d7c68b-3590-4941-a0eb-b7b3a8da5160 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760" status: 200 len: 287 microversion: 2.1 time: 0.207267 Aug 04 23:12:58.569281 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 11/26] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Aug 4 23:12:58 2022] GET /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760 => generated 287 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:12:59.216383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2bee621d-74d0-4ded-9b7f-5a66956929a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1058981480", "imageRef": "e1e9d70e-b252-44e5-9ecd-bf73cbf00160", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:12:59.454675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.network.neutron [None req-2bee621d-74d0-4ded-9b7f-5a66956929a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] validate_networks() for [('7107f474-309d-4f6e-8900-fb5164d73cfb', None, None, None, None, None)] {{(pid=129790) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 23:12:59.585612 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f2c23182-7be3-4af9-974a-35702086ddbc tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Calling method '.version_select at 0x7f6d27cc9af0>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:12:59.740312 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-f2c23182-7be3-4af9-974a-35702086ddbc tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] HTTP exception thrown: Snapshot 3c544da1-5fde-472d-8a27-15e86d85f760 could not be found. Aug 04 23:12:59.749768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f2c23182-7be3-4af9-974a-35702086ddbc tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Request method failure captured: Aug 04 23:12:59.749768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: GET /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760 HTTP/1.1 Aug 04 23:12:59.749768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:12:59.749768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:12:59.749768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:12:59.749768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 0 Aug 04 23:12:59.749768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:12:59.749768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:12:59.749768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:12:59.749768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:12:59.749768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FJrEvNDasUrBzHXzMvab4HZKJr30dM56rXFbrQQOnVjyOLg4tuXfLSXI_9ZZLLTxBFQnecm_r6A0ai6NxfNN0ZqrP2P-n7uoW2HdnOclqEqeTGSI-6s986KatZBDzIX70PGREjrnJvegOFToj9TDHEYKtYCNwBx65yrZm_AUNZg5Gc Aug 04 23:12:59.749768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:12:59.749768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:12:59.749768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:12:59.749768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:12:59.749768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:12:59.749768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:12:59.749768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: a20ddc7bbdbf44d4a8d8692eb2e2d734 Aug 04 23:12:59.749768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-393532208 Aug 04 23:12:59.749768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:12:59.749768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:12:59.751007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a20ddc7bbdbf44d4a8d8692eb2e2d734"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a20ddc7bbdbf44d4a8d8692eb2e2d734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a20ddc7bbdbf44d4a8d8692eb2e2d734"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a20ddc7bbdbf44d4a8d8692eb2e2d734"}]}] Aug 04 23:12:59.751007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-VolumesSnapshotsTestJSON-393532208 Aug 04 23:12:59.751007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: a20ddc7bbdbf44d4a8d8692eb2e2d734 Aug 04 23:12:59.751007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-393532208 Aug 04 23:12:59.751007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-VolumesSnapshotsTestJSON-393532208-project Aug 04 23:12:59.751007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:12:59.751007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:12:59.751007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: 8940c98f690d401b997dddd3c1624afb Aug 04 23:12:59.751007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-VolumesSnapshotsTestJSON-393532208-project Aug 04 23:12:59.751007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: Aug 04 23:12:59.751007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Snapshot 3c544da1-5fde-472d-8a27-15e86d85f760 could not be found. Aug 04 23:12:59.751007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'id': '3c544da1-5fde-472d-8a27-15e86d85f760'} Aug 04 23:12:59.751007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:12:59.751747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:59.751747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 23:12:59.751747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 23:12:59.751747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 23:12:59.751747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 23:12:59.751747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 23:12:59.751747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 23:12:59.751747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 23:12:59.751747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 23:12:59.751747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 23:12:59.751747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 23:12:59.751747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:12:59.751747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:12:59.751747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:12:59.751747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:12:59.751747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3c544da1-5fde-472d-8a27-15e86d85f760 could not be found. (HTTP 404) (Request-ID: req-f21920fd-a4db-46d9-802c-8cfcffbdb0d3) Aug 04 23:12:59.751747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:12:59.751747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:12:59.752824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:12:59.752824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:59.752824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 04 23:12:59.752824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 04 23:12:59.752824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 23:12:59.752824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 23:12:59.752824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 04 23:12:59.752824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 04 23:12:59.752824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 23:12:59.752824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 23:12:59.752824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 23:12:59.752824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 23:12:59.752824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 23:12:59.752824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 23:12:59.752824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 23:12:59.752824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 23:12:59.752824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 23:12:59.752824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 23:12:59.752824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 23:12:59.754522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 23:12:59.754522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:12:59.754522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:12:59.754522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:12:59.754522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:12:59.754522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3c544da1-5fde-472d-8a27-15e86d85f760 could not be found. Aug 04 23:12:59.754522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:12:59.754522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:12:59.754522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:12:59.754522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:59.754522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:12:59.754522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:12:59.754522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:12:59.754522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:12:59.754522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 23:12:59.754522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 23:12:59.754522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:12:59.754522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:12:59.754522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 04 23:12:59.754522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:12:59.755487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3c544da1-5fde-472d-8a27-15e86d85f760 could not be found. Aug 04 23:12:59.755487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:12:59.755487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:12:59.755487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:12:59.755487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:12:59.755487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:12:59.755487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:12:59.755487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:12:59.755487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:12:59.755487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3c544da1-5fde-472d-8a27-15e86d85f760 could not be found. Aug 04 23:12:59.755487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:12:59.755487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f2c23182-7be3-4af9-974a-35702086ddbc tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Returning 404 to user: Snapshot 3c544da1-5fde-472d-8a27-15e86d85f760 could not be found. {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:12:59.755487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f2c23182-7be3-4af9-974a-35702086ddbc tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760" status: 404 len: 111 microversion: 2.1 time: 0.170620 Aug 04 23:12:59.755487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 12/27] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Aug 4 23:12:59 2022] GET /compute/v2.1/os-snapshots/3c544da1-5fde-472d-8a27-15e86d85f760 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:12:59.804958 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-12fcc33e-e059-469b-a1a5-50ceb24c502a tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Calling method '.version_select at 0x7f6d27cc9550>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:00.167399 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-12fcc33e-e059-469b-a1a5-50ceb24c502a tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/7366d0c3-3800-4b71-832f-be9f2983b29c" status: 202 len: 0 microversion: 2.1 time: 0.405244 Aug 04 23:13:00.168775 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 13/28] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Aug 4 23:12:59 2022] DELETE /compute/v2.1/os-volumes/7366d0c3-3800-4b71-832f-be9f2983b29c => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:13:00.208751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c0428b9e-694d-40b7-b3f7-638b712f6999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1208023639", "imageRef": "e1e9d70e-b252-44e5-9ecd-bf73cbf00160", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df517527-9f13-4f5f-b34b-4a2b6e5d80c8"}], "security_groups": [{"name": "tempest-securitygroup--720691255"}], "key_name": "tempest-keypair-772314928", "user_data": "}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:13:00.412162 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=4 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:13:00.689488 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.network.neutron [None req-c0428b9e-694d-40b7-b3f7-638b712f6999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] validate_networks() for [('df517527-9f13-4f5f-b34b-4a2b6e5d80c8', None, None, None, None, None)] {{(pid=129791) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 23:13:02.916262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-c0428b9e-694d-40b7-b3f7-638b712f6999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Flavor limits 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 23:13:02.917291 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-c0428b9e-694d-40b7-b3f7-638b712f6999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Image limits 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 23:13:02.918159 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-c0428b9e-694d-40b7-b3f7-638b712f6999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Flavor pref 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 23:13:02.918934 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-c0428b9e-694d-40b7-b3f7-638b712f6999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Image pref 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 23:13:02.919929 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-c0428b9e-694d-40b7-b3f7-638b712f6999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 23:13:02.957073 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c0428b9e-694d-40b7-b3f7-638b712f6999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:02.957579 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c0428b9e-694d-40b7-b3f7-638b712f6999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:02.960374 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c0428b9e-694d-40b7-b3f7-638b712f6999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:02.962303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c0428b9e-694d-40b7-b3f7-638b712f6999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:02.963546 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c0428b9e-694d-40b7-b3f7-638b712f6999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:02.964682 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c0428b9e-694d-40b7-b3f7-638b712f6999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:03.057347 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-c0428b9e-694d-40b7-b3f7-638b712f6999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Getting quotas for project 0422afbb853d4ef2924edf221499971c. Resources: {'ram', 'instances', 'cores'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:13:03.084123 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-2bee621d-74d0-4ded-9b7f-5a66956929a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Flavor limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 23:13:03.085075 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-2bee621d-74d0-4ded-9b7f-5a66956929a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Image limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 23:13:03.085840 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-2bee621d-74d0-4ded-9b7f-5a66956929a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Flavor pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 23:13:03.086698 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-2bee621d-74d0-4ded-9b7f-5a66956929a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Image pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 23:13:03.087312 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-2bee621d-74d0-4ded-9b7f-5a66956929a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 23:13:03.089242 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-c0428b9e-694d-40b7-b3f7-638b712f6999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Getting quotas for user b2ceb35afcc046218bdce1ab4983d9f9 and project 0422afbb853d4ef2924edf221499971c. Resources: {'ram', 'instances', 'cores'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:13:03.138139 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2bee621d-74d0-4ded-9b7f-5a66956929a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:03.138139 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2bee621d-74d0-4ded-9b7f-5a66956929a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:03.138139 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2bee621d-74d0-4ded-9b7f-5a66956929a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:03.138139 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2bee621d-74d0-4ded-9b7f-5a66956929a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:03.139552 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c0428b9e-694d-40b7-b3f7-638b712f6999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Going to run 1 instances... {{(pid=129791) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 23:13:03.144598 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2bee621d-74d0-4ded-9b7f-5a66956929a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:03.145139 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2bee621d-74d0-4ded-9b7f-5a66956929a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:03.176581 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c0428b9e-694d-40b7-b3f7-638b712f6999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1e9d70e-b252-44e5-9ecd-bf73cbf00160',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 23:13:03.245253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-2bee621d-74d0-4ded-9b7f-5a66956929a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Getting quotas for project f50215d0b0ec4a109e14979c183a52a3. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:13:03.268506 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-2bee621d-74d0-4ded-9b7f-5a66956929a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Getting quotas for user 51af2dbb470849a4a044f6f78eef2d45 and project f50215d0b0ec4a109e14979c183a52a3. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:13:03.314857 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2bee621d-74d0-4ded-9b7f-5a66956929a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Going to run 1 instances... {{(pid=129790) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 23:13:03.331879 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2bee621d-74d0-4ded-9b7f-5a66956929a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1e9d70e-b252-44e5-9ecd-bf73cbf00160',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129790) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 23:13:03.392368 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c0428b9e-694d-40b7-b3f7-638b712f6999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.219332 Aug 04 23:13:03.394470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 14/29] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Aug 4 23:13:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 3225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 23:13:03.429450 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-09119c00-a1f4-4308-bcc9-db9f947c3ff9 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Calling method '.version_select at 0x7f6d27344310>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:03.516875 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-09119c00-a1f4-4308-bcc9-db9f947c3ff9 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] HTTP exception thrown: Volume 7366d0c3-3800-4b71-832f-be9f2983b29c could not be found. Aug 04 23:13:03.519912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-09119c00-a1f4-4308-bcc9-db9f947c3ff9 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Request method failure captured: Aug 04 23:13:03.519912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: GET /compute/v2.1/os-volumes/7366d0c3-3800-4b71-832f-be9f2983b29c HTTP/1.1 Aug 04 23:13:03.519912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:13:03.519912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:13:03.519912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:13:03.519912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 0 Aug 04 23:13:03.519912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:13:03.519912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:13:03.519912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:13:03.519912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:13:03.519912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FJrEvNDasUrBzHXzMvab4HZKJr30dM56rXFbrQQOnVjyOLg4tuXfLSXI_9ZZLLTxBFQnecm_r6A0ai6NxfNN0ZqrP2P-n7uoW2HdnOclqEqeTGSI-6s986KatZBDzIX70PGREjrnJvegOFToj9TDHEYKtYCNwBx65yrZm_AUNZg5Gc Aug 04 23:13:03.519912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:13:03.519912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:13:03.519912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:13:03.519912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:13:03.519912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:13:03.519912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:13:03.519912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: a20ddc7bbdbf44d4a8d8692eb2e2d734 Aug 04 23:13:03.519912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-393532208 Aug 04 23:13:03.519912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:13:03.519912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:13:03.521212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a20ddc7bbdbf44d4a8d8692eb2e2d734"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a20ddc7bbdbf44d4a8d8692eb2e2d734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a20ddc7bbdbf44d4a8d8692eb2e2d734"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a20ddc7bbdbf44d4a8d8692eb2e2d734"}]}] Aug 04 23:13:03.521212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-VolumesSnapshotsTestJSON-393532208 Aug 04 23:13:03.521212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: a20ddc7bbdbf44d4a8d8692eb2e2d734 Aug 04 23:13:03.521212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-393532208 Aug 04 23:13:03.521212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-VolumesSnapshotsTestJSON-393532208-project Aug 04 23:13:03.521212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:13:03.521212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:13:03.521212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: 8940c98f690d401b997dddd3c1624afb Aug 04 23:13:03.521212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-VolumesSnapshotsTestJSON-393532208-project Aug 04 23:13:03.521212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: Aug 04 23:13:03.521212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Volume 7366d0c3-3800-4b71-832f-be9f2983b29c could not be found. Aug 04 23:13:03.521212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'id': '7366d0c3-3800-4b71-832f-be9f2983b29c'} Aug 04 23:13:03.521212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:13:03.522070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:13:03.522070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 23:13:03.522070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 23:13:03.522070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 23:13:03.522070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 23:13:03.522070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 23:13:03.522070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 23:13:03.522070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 23:13:03.522070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 23:13:03.522070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 23:13:03.522070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 23:13:03.522070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:13:03.522070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:13:03.522070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:13:03.522070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:13:03.522070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7366d0c3-3800-4b71-832f-be9f2983b29c could not be found. (HTTP 404) (Request-ID: req-3d6a47d4-3027-4be2-a971-c69da900ac47) Aug 04 23:13:03.522070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:13:03.522070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:13:03.522070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:13:03.523203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:13:03.523203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 23:13:03.523203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 23:13:03.523203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 23:13:03.523203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 23:13:03.523203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 23:13:03.523203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 23:13:03.523203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 23:13:03.523203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 23:13:03.523203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 23:13:03.523203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 23:13:03.523203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 23:13:03.523203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 23:13:03.523203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 23:13:03.523203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 23:13:03.523203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 23:13:03.523203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 23:13:03.523203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 23:13:03.523203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 23:13:03.524555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:13:03.524555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:13:03.524555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:13:03.524555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:13:03.524555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7366d0c3-3800-4b71-832f-be9f2983b29c could not be found. Aug 04 23:13:03.524555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:13:03.524555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:13:03.524555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:13:03.524555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:13:03.524555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:13:03.524555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:13:03.524555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:13:03.524555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:13:03.524555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 23:13:03.524555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 23:13:03.524555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:13:03.524555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:13:03.524555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 23:13:03.524555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:13:03.525654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7366d0c3-3800-4b71-832f-be9f2983b29c could not be found. Aug 04 23:13:03.525654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:13:03.525654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:13:03.525654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:13:03.525654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:13:03.525654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:13:03.525654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:13:03.525654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:13:03.525654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:13:03.525654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7366d0c3-3800-4b71-832f-be9f2983b29c could not be found. Aug 04 23:13:03.525654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:13:03.538116 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-09119c00-a1f4-4308-bcc9-db9f947c3ff9 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Returning 404 to user: Volume 7366d0c3-3800-4b71-832f-be9f2983b29c could not be found. {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:13:03.538765 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-09119c00-a1f4-4308-bcc9-db9f947c3ff9 tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/7366d0c3-3800-4b71-832f-be9f2983b29c" status: 404 len: 109 microversion: 2.1 time: 0.131906 Aug 04 23:13:03.539397 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 15/30] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Aug 4 23:13:03 2022] GET /compute/v2.1/os-volumes/7366d0c3-3800-4b71-832f-be9f2983b29c => generated 109 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:13:03.585652 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2bee621d-74d0-4ded-9b7f-5a66956929a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.800966 Aug 04 23:13:03.595588 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 16/31] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Aug 4 23:12:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 4811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 23:13:03.602405 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a9de93b9-7a04-4368-b7dc-a45ff306c8c7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:03.603696 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a9de93b9-7a04-4368-b7dc-a45ff306c8c7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:03.770161 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a9de93b9-7a04-4368-b7dc-a45ff306c8c7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:03.794330 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a9de93b9-7a04-4368-b7dc-a45ff306c8c7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1241 microversion: 2.1 time: 0.196559 Aug 04 23:13:03.796084 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 17/32] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:03 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1241 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:04.180140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b1a7eaf4-bded-484e-a06e-a11e2ec3768b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-891306469", "imageRef": "e1e9d70e-b252-44e5-9ecd-bf73cbf00160", "flavorRef": "452", "networks": [{"uuid": "afefec80-574b-4312-84e4-3ec615bff117"}]}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:13:04.300465 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.network.neutron [None req-b1a7eaf4-bded-484e-a06e-a11e2ec3768b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] validate_networks() for [('afefec80-574b-4312-84e4-3ec615bff117', None, None, None, None, None)] {{(pid=129791) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 23:13:04.721881 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-388089cf-59f7-4f12-80ee-aa3c989e1744 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Action: 'create', calling method: .version_select at 0x7f6d27310ca0>, body: {"keypair": {"name": "tempest-keypair-530975688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ17+8v3nQNrYYaChKLp4Srh/aNN5lCKJlhYlqfhMSpWIsvCw9ZkCWuZjb8buhSb8OnIy8Mymiq4ayimwvWXSaZzpKfhGoSC+xmXNKA4YI9lAJztwbP9y+2oj6T8JYr8Sg=="}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:13:04.810048 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-388089cf-59f7-4f12-80ee-aa3c989e1744 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Getting quotas for project 6b185a89edfd42a19bfbeff8d9c66e36. Resources: {'key_pairs'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:13:04.828242 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-388089cf-59f7-4f12-80ee-aa3c989e1744 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Getting quotas for user c01696724a7c4291ae29cc10da276ea6 and project 6b185a89edfd42a19bfbeff8d9c66e36. Resources: {'key_pairs'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:13:04.902141 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-388089cf-59f7-4f12-80ee-aa3c989e1744 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.104148 Aug 04 23:13:04.903351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 18/33] 10.222.0.33 () {62 vars in 1200 bytes} [Thu Aug 4 23:13:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1106 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 23:13:04.910681 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6b52a867-0b75-4566-8fc8-97191e0e01ec tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Calling method '.version_select at 0x7f6d262a6310>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:04.972100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-6b52a867-0b75-4566-8fc8-97191e0e01ec tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] HTTP exception thrown: Volume 7366d0c3-3800-4b71-832f-be9f2983b29c could not be found. Aug 04 23:13:04.974815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6b52a867-0b75-4566-8fc8-97191e0e01ec tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Request method failure captured: Aug 04 23:13:04.974815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: DELETE /compute/v2.1/os-volumes/7366d0c3-3800-4b71-832f-be9f2983b29c HTTP/1.1 Aug 04 23:13:04.974815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:13:04.974815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:13:04.974815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:13:04.974815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:13:04.974815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:13:04.974815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:13:04.974815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:13:04.974815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:13:04.974815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FJrEvNDasUrBzHXzMvab4HZKJr30dM56rXFbrQQOnVjyOLg4tuXfLSXI_9ZZLLTxBFQnecm_r6A0ai6NxfNN0ZqrP2P-n7uoW2HdnOclqEqeTGSI-6s986KatZBDzIX70PGREjrnJvegOFToj9TDHEYKtYCNwBx65yrZm_AUNZg5Gc Aug 04 23:13:04.974815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:13:04.974815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:13:04.974815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:13:04.974815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:13:04.974815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:13:04.974815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:13:04.974815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: a20ddc7bbdbf44d4a8d8692eb2e2d734 Aug 04 23:13:04.974815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-393532208 Aug 04 23:13:04.974815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:13:04.974815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:13:04.976254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a20ddc7bbdbf44d4a8d8692eb2e2d734"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a20ddc7bbdbf44d4a8d8692eb2e2d734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a20ddc7bbdbf44d4a8d8692eb2e2d734"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a20ddc7bbdbf44d4a8d8692eb2e2d734"}]}] Aug 04 23:13:04.976254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-VolumesSnapshotsTestJSON-393532208 Aug 04 23:13:04.976254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: a20ddc7bbdbf44d4a8d8692eb2e2d734 Aug 04 23:13:04.976254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-393532208 Aug 04 23:13:04.976254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-VolumesSnapshotsTestJSON-393532208-project Aug 04 23:13:04.976254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:13:04.976254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:13:04.976254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: 8940c98f690d401b997dddd3c1624afb Aug 04 23:13:04.976254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-VolumesSnapshotsTestJSON-393532208-project Aug 04 23:13:04.976254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: Aug 04 23:13:04.976254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Volume 7366d0c3-3800-4b71-832f-be9f2983b29c could not be found. Aug 04 23:13:04.976254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': '7366d0c3-3800-4b71-832f-be9f2983b29c'} Aug 04 23:13:04.976254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:13:04.977079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:13:04.977079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 23:13:04.977079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 23:13:04.977079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 23:13:04.977079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 23:13:04.977079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 23:13:04.977079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 23:13:04.977079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 23:13:04.977079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 23:13:04.977079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 23:13:04.977079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 23:13:04.977079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:13:04.977079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:13:04.977079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:13:04.977079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:13:04.977079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7366d0c3-3800-4b71-832f-be9f2983b29c could not be found. (HTTP 404) (Request-ID: req-0affd124-173f-491c-946a-15beb038a90d) Aug 04 23:13:04.977079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:13:04.977079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:13:04.977079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:13:04.978728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:13:04.978728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 23:13:04.978728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 23:13:04.978728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 23:13:04.978728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 23:13:04.978728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 23:13:04.978728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 23:13:04.978728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 23:13:04.978728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 23:13:04.978728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 23:13:04.978728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 23:13:04.978728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 23:13:04.978728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 23:13:04.978728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 23:13:04.978728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 23:13:04.978728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 23:13:04.978728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 23:13:04.978728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 23:13:04.978728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 23:13:04.979849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:13:04.979849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:13:04.979849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:13:04.979849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:13:04.979849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7366d0c3-3800-4b71-832f-be9f2983b29c could not be found. Aug 04 23:13:04.979849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:13:04.979849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:13:04.979849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:13:04.979849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:13:04.979849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:13:04.979849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:13:04.979849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:13:04.979849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:13:04.979849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 23:13:04.979849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 23:13:04.979849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:13:04.979849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:13:04.979849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 23:13:04.979849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:13:04.982185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7366d0c3-3800-4b71-832f-be9f2983b29c could not be found. Aug 04 23:13:04.982185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:13:04.982185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:13:04.982185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:13:04.982185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:13:04.982185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:13:04.982185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:13:04.982185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:13:04.982185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:13:04.982185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7366d0c3-3800-4b71-832f-be9f2983b29c could not be found. Aug 04 23:13:04.982185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:13:04.985068 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6b52a867-0b75-4566-8fc8-97191e0e01ec tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Returning 404 to user: Volume 7366d0c3-3800-4b71-832f-be9f2983b29c could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:13:04.986301 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6b52a867-0b75-4566-8fc8-97191e0e01ec tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/7366d0c3-3800-4b71-832f-be9f2983b29c" status: 404 len: 109 microversion: 2.1 time: 0.081764 Aug 04 23:13:04.987550 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 19/34] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Aug 4 23:13:04 2022] DELETE /compute/v2.1/os-volumes/7366d0c3-3800-4b71-832f-be9f2983b29c => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:13:04.995695 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d529a898-a5f7-4d04-a3e3-24d235de76bb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:04.996844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d529a898-a5f7-4d04-a3e3-24d235de76bb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:05.348896 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d529a898-a5f7-4d04-a3e3-24d235de76bb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:05.360581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d529a898-a5f7-4d04-a3e3-24d235de76bb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1222 microversion: 2.1 time: 0.371527 Aug 04 23:13:05.362932 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 20/35] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:04 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1222 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:05.382164 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-97b480c0-b4b3-41b0-b3d0-4c7dce5adfaf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:05.389701 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-97b480c0-b4b3-41b0-b3d0-4c7dce5adfaf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:05.876870 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-97b480c0-b4b3-41b0-b3d0-4c7dce5adfaf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:05.885986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-97b480c0-b4b3-41b0-b3d0-4c7dce5adfaf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1241 microversion: 2.1 time: 0.518759 Aug 04 23:13:05.909974 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 21/36] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:05 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1241 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:05.952081 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e74552d6-6ca5-4bd9-b035-d57f5143cb6c tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Calling method '.version_select at 0x7f6d262b54c0>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:06.037119 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-e74552d6-6ca5-4bd9-b035-d57f5143cb6c tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] HTTP exception thrown: Volume 7366d0c3-3800-4b71-832f-be9f2983b29c could not be found. Aug 04 23:13:06.041033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e74552d6-6ca5-4bd9-b035-d57f5143cb6c tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Request method failure captured: Aug 04 23:13:06.041033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: GET /compute/v2.1/os-volumes/7366d0c3-3800-4b71-832f-be9f2983b29c HTTP/1.1 Aug 04 23:13:06.041033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:13:06.041033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:13:06.041033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:13:06.041033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:13:06.041033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:13:06.041033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:13:06.041033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:13:06.041033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:13:06.041033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FJrEvNDasUrBzHXzMvab4HZKJr30dM56rXFbrQQOnVjyOLg4tuXfLSXI_9ZZLLTxBFQnecm_r6A0ai6NxfNN0ZqrP2P-n7uoW2HdnOclqEqeTGSI-6s986KatZBDzIX70PGREjrnJvegOFToj9TDHEYKtYCNwBx65yrZm_AUNZg5Gc Aug 04 23:13:06.041033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:13:06.041033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:13:06.041033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:13:06.041033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:13:06.041033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:13:06.041033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:13:06.041033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: a20ddc7bbdbf44d4a8d8692eb2e2d734 Aug 04 23:13:06.041033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-393532208 Aug 04 23:13:06.041033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:13:06.041033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:13:06.042505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a20ddc7bbdbf44d4a8d8692eb2e2d734"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a20ddc7bbdbf44d4a8d8692eb2e2d734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a20ddc7bbdbf44d4a8d8692eb2e2d734"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a20ddc7bbdbf44d4a8d8692eb2e2d734"}]}] Aug 04 23:13:06.042505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-VolumesSnapshotsTestJSON-393532208 Aug 04 23:13:06.042505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: a20ddc7bbdbf44d4a8d8692eb2e2d734 Aug 04 23:13:06.042505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-393532208 Aug 04 23:13:06.042505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-VolumesSnapshotsTestJSON-393532208-project Aug 04 23:13:06.042505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:13:06.042505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:13:06.042505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: 8940c98f690d401b997dddd3c1624afb Aug 04 23:13:06.042505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-VolumesSnapshotsTestJSON-393532208-project Aug 04 23:13:06.042505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: Aug 04 23:13:06.042505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Volume 7366d0c3-3800-4b71-832f-be9f2983b29c could not be found. Aug 04 23:13:06.042505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': '7366d0c3-3800-4b71-832f-be9f2983b29c'} Aug 04 23:13:06.042505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:13:06.043336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:13:06.043336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 23:13:06.043336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 23:13:06.043336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 23:13:06.043336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 23:13:06.043336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 23:13:06.043336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 23:13:06.043336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 23:13:06.043336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 23:13:06.043336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 23:13:06.043336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 23:13:06.043336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:13:06.043336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:13:06.043336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:13:06.043336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:13:06.043336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7366d0c3-3800-4b71-832f-be9f2983b29c could not be found. (HTTP 404) (Request-ID: req-177191aa-7820-4f75-a7af-f66cce41859f) Aug 04 23:13:06.043336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:13:06.043336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:13:06.043336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:13:06.044510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:13:06.044510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 23:13:06.044510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 23:13:06.044510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 23:13:06.044510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 23:13:06.044510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 23:13:06.044510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 23:13:06.044510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 23:13:06.044510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 23:13:06.044510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 23:13:06.044510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 23:13:06.044510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 23:13:06.044510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 23:13:06.044510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 23:13:06.044510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 23:13:06.044510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 23:13:06.044510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 23:13:06.044510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 23:13:06.044510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 23:13:06.046170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:13:06.046170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:13:06.046170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:13:06.046170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:13:06.046170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7366d0c3-3800-4b71-832f-be9f2983b29c could not be found. Aug 04 23:13:06.046170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:13:06.046170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:13:06.046170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:13:06.046170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:13:06.046170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:13:06.046170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:13:06.046170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:13:06.046170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:13:06.046170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 23:13:06.046170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 23:13:06.046170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:13:06.046170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:13:06.046170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 23:13:06.046170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:13:06.047383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7366d0c3-3800-4b71-832f-be9f2983b29c could not be found. Aug 04 23:13:06.047383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:13:06.047383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:13:06.047383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:13:06.047383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:13:06.047383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:13:06.047383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:13:06.047383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:13:06.047383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:13:06.047383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7366d0c3-3800-4b71-832f-be9f2983b29c could not be found. Aug 04 23:13:06.047383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:13:06.050647 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e74552d6-6ca5-4bd9-b035-d57f5143cb6c tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] Returning 404 to user: Volume 7366d0c3-3800-4b71-832f-be9f2983b29c could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:13:06.051743 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e74552d6-6ca5-4bd9-b035-d57f5143cb6c tempest-VolumesSnapshotsTestJSON-393532208 tempest-VolumesSnapshotsTestJSON-393532208-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/7366d0c3-3800-4b71-832f-be9f2983b29c" status: 404 len: 109 microversion: 2.1 time: 0.138286 Aug 04 23:13:06.061465 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 22/37] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Aug 4 23:13:05 2022] GET /compute/v2.1/os-volumes/7366d0c3-3800-4b71-832f-be9f2983b29c => generated 109 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:13:06.074019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-acb91910-abb3-49cc-bf0f-d1de4198f256 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1833017564", "imageRef": "e1e9d70e-b252-44e5-9ecd-bf73cbf00160", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:13:06.276357 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.network.neutron [None req-acb91910-abb3-49cc-bf0f-d1de4198f256 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] validate_networks() for [('7107f474-309d-4f6e-8900-fb5164d73cfb', None, None, None, None, None)] {{(pid=129790) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 23:13:06.811395 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-b1a7eaf4-bded-484e-a06e-a11e2ec3768b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Flavor limits 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 23:13:06.812011 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-b1a7eaf4-bded-484e-a06e-a11e2ec3768b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Image limits 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 23:13:06.812777 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-b1a7eaf4-bded-484e-a06e-a11e2ec3768b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Flavor pref 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 23:13:06.813287 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-b1a7eaf4-bded-484e-a06e-a11e2ec3768b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Image pref 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 23:13:06.813817 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-b1a7eaf4-bded-484e-a06e-a11e2ec3768b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 23:13:06.851960 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b1a7eaf4-bded-484e-a06e-a11e2ec3768b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:06.853550 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b1a7eaf4-bded-484e-a06e-a11e2ec3768b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:06.857756 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b1a7eaf4-bded-484e-a06e-a11e2ec3768b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:06.859014 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b1a7eaf4-bded-484e-a06e-a11e2ec3768b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:06.863669 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b1a7eaf4-bded-484e-a06e-a11e2ec3768b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:06.867214 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b1a7eaf4-bded-484e-a06e-a11e2ec3768b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:06.986570 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-b1a7eaf4-bded-484e-a06e-a11e2ec3768b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Getting quotas for project e946054af5c94e50b4a25431d601818b. Resources: {'ram', 'instances', 'cores'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:13:06.999904 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-b1a7eaf4-bded-484e-a06e-a11e2ec3768b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Getting quotas for user c59a46485dc348bcb1786a087b3cd2e9 and project e946054af5c94e50b4a25431d601818b. Resources: {'ram', 'instances', 'cores'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:13:07.033817 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b1a7eaf4-bded-484e-a06e-a11e2ec3768b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Going to run 1 instances... {{(pid=129791) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 23:13:07.039918 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b1a7eaf4-bded-484e-a06e-a11e2ec3768b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1e9d70e-b252-44e5-9ecd-bf73cbf00160',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 23:13:07.251669 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b1a7eaf4-bded-484e-a06e-a11e2ec3768b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.705985 Aug 04 23:13:07.253824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 16/38] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Aug 4 23:13:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 23:13:07.277193 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f48e090b-a51e-44a1-83de-d9809999a031 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:07.316162 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f48e090b-a51e-44a1-83de-d9809999a031 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:07.405584 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f48e090b-a51e-44a1-83de-d9809999a031 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:07.411518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f48e090b-a51e-44a1-83de-d9809999a031 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:07.414526 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f48e090b-a51e-44a1-83de-d9809999a031 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:07.417003 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f48e090b-a51e-44a1-83de-d9809999a031 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:07.422255 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f48e090b-a51e-44a1-83de-d9809999a031 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:07.424241 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f48e090b-a51e-44a1-83de-d9809999a031 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:08.166723 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f48e090b-a51e-44a1-83de-d9809999a031 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:08.201535 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f48e090b-a51e-44a1-83de-d9809999a031 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1245 microversion: 2.1 time: 0.941056 Aug 04 23:13:08.203065 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 17/39] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:07 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1245 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:08.220982 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-60416df4-a65c-4eb7-8b57-d3c0d0491ad2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:08.224266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-60416df4-a65c-4eb7-8b57-d3c0d0491ad2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:08.572676 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-acb91910-abb3-49cc-bf0f-d1de4198f256 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Flavor limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 23:13:08.573201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-acb91910-abb3-49cc-bf0f-d1de4198f256 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Image limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 23:13:08.574056 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-acb91910-abb3-49cc-bf0f-d1de4198f256 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Flavor pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 23:13:08.574577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-acb91910-abb3-49cc-bf0f-d1de4198f256 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Image pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 23:13:08.575183 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-acb91910-abb3-49cc-bf0f-d1de4198f256 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 23:13:08.601808 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-acb91910-abb3-49cc-bf0f-d1de4198f256 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:08.608601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-acb91910-abb3-49cc-bf0f-d1de4198f256 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:08.609942 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-acb91910-abb3-49cc-bf0f-d1de4198f256 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:08.615716 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-acb91910-abb3-49cc-bf0f-d1de4198f256 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:08.616495 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-acb91910-abb3-49cc-bf0f-d1de4198f256 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:08.617101 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-acb91910-abb3-49cc-bf0f-d1de4198f256 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:08.617230 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-60416df4-a65c-4eb7-8b57-d3c0d0491ad2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:08.634451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-60416df4-a65c-4eb7-8b57-d3c0d0491ad2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1214 microversion: 2.1 time: 0.429279 Aug 04 23:13:08.635676 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 18/40] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:08 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1214 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:08.719802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-acb91910-abb3-49cc-bf0f-d1de4198f256 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Getting quotas for project f50215d0b0ec4a109e14979c183a52a3. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:13:08.733098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-acb91910-abb3-49cc-bf0f-d1de4198f256 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Getting quotas for user 51af2dbb470849a4a044f6f78eef2d45 and project f50215d0b0ec4a109e14979c183a52a3. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:13:08.772802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-acb91910-abb3-49cc-bf0f-d1de4198f256 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Going to run 1 instances... {{(pid=129790) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 23:13:08.777562 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-acb91910-abb3-49cc-bf0f-d1de4198f256 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1e9d70e-b252-44e5-9ecd-bf73cbf00160',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129790) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 23:13:08.871159 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-acb91910-abb3-49cc-bf0f-d1de4198f256 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.807502 Aug 04 23:13:08.876264 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 23/41] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Aug 4 23:13:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 2814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 23:13:08.894348 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c2b0b802-fb37-428e-8416-43584f7190e0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:08.897673 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c2b0b802-fb37-428e-8416-43584f7190e0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:09.061977 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c2b0b802-fb37-428e-8416-43584f7190e0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:09.069615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c2b0b802-fb37-428e-8416-43584f7190e0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1222 microversion: 2.1 time: 0.185693 Aug 04 23:13:09.075917 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 19/42] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:08 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1222 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:09.228688 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-35200503-8612-49ff-ba42-0c6963de2ef9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:09.229485 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-35200503-8612-49ff-ba42-0c6963de2ef9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:09.246152 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-35200503-8612-49ff-ba42-0c6963de2ef9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:09.247819 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-35200503-8612-49ff-ba42-0c6963de2ef9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:09.248398 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-35200503-8612-49ff-ba42-0c6963de2ef9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:09.250299 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-35200503-8612-49ff-ba42-0c6963de2ef9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:09.254325 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-35200503-8612-49ff-ba42-0c6963de2ef9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:09.255342 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-35200503-8612-49ff-ba42-0c6963de2ef9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:09.656573 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a7027022-3f61-4bff-82ad-97738a1b977d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:09.657152 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a7027022-3f61-4bff-82ad-97738a1b977d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:09.671966 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a7027022-3f61-4bff-82ad-97738a1b977d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:09.676484 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a7027022-3f61-4bff-82ad-97738a1b977d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:09.676877 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a7027022-3f61-4bff-82ad-97738a1b977d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:09.677638 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a7027022-3f61-4bff-82ad-97738a1b977d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:09.678101 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a7027022-3f61-4bff-82ad-97738a1b977d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:09.682633 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a7027022-3f61-4bff-82ad-97738a1b977d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:10.024027 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-35200503-8612-49ff-ba42-0c6963de2ef9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:10.033792 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a7027022-3f61-4bff-82ad-97738a1b977d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:10.059655 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a7027022-3f61-4bff-82ad-97738a1b977d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1266 microversion: 2.1 time: 0.401717 Aug 04 23:13:10.067987 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 20/43] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:09 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1266 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:13:10.091475 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-35200503-8612-49ff-ba42-0c6963de2ef9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1301 microversion: 2.1 time: 0.864272 Aug 04 23:13:10.095821 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 24/44] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:09 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1301 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:10.101458 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-dbfa5d7f-b278-4f90-b007-1033af69f872 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:10.102279 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-dbfa5d7f-b278-4f90-b007-1033af69f872 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:10.183856 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dbfa5d7f-b278-4f90-b007-1033af69f872 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:10.184427 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dbfa5d7f-b278-4f90-b007-1033af69f872 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:10.184886 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dbfa5d7f-b278-4f90-b007-1033af69f872 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:10.201620 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dbfa5d7f-b278-4f90-b007-1033af69f872 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:10.215332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dbfa5d7f-b278-4f90-b007-1033af69f872 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:10.218229 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dbfa5d7f-b278-4f90-b007-1033af69f872 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:10.861114 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-dbfa5d7f-b278-4f90-b007-1033af69f872 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:10.876500 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-dbfa5d7f-b278-4f90-b007-1033af69f872 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1226 microversion: 2.1 time: 0.778999 Aug 04 23:13:10.888736 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 21/45] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:10 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1226 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:11.097695 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-009e29a3-a197-4615-817e-28e295e652af tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:11.110494 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-009e29a3-a197-4615-817e-28e295e652af tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:11.129614 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e284ace5-8f76-419e-98fe-4e62ee5ca3db tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:11.130306 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e284ace5-8f76-419e-98fe-4e62ee5ca3db tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:11.170649 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-009e29a3-a197-4615-817e-28e295e652af tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:11.171836 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-009e29a3-a197-4615-817e-28e295e652af tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:11.172630 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-009e29a3-a197-4615-817e-28e295e652af tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:11.173782 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-009e29a3-a197-4615-817e-28e295e652af tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:11.180766 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e284ace5-8f76-419e-98fe-4e62ee5ca3db tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:11.187028 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e284ace5-8f76-419e-98fe-4e62ee5ca3db tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:11.187901 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e284ace5-8f76-419e-98fe-4e62ee5ca3db tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:11.192304 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-009e29a3-a197-4615-817e-28e295e652af tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:11.193110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-009e29a3-a197-4615-817e-28e295e652af tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:11.204878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e284ace5-8f76-419e-98fe-4e62ee5ca3db tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:11.205807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e284ace5-8f76-419e-98fe-4e62ee5ca3db tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:11.217359 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e284ace5-8f76-419e-98fe-4e62ee5ca3db tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:11.651022 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e284ace5-8f76-419e-98fe-4e62ee5ca3db tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:11.675167 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e284ace5-8f76-419e-98fe-4e62ee5ca3db tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1299 microversion: 2.1 time: 0.552297 Aug 04 23:13:11.676350 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 22/46] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:11 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1299 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:11.720776 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-009e29a3-a197-4615-817e-28e295e652af tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:11.734799 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-009e29a3-a197-4615-817e-28e295e652af tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1272 microversion: 2.1 time: 0.642845 Aug 04 23:13:11.755000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 25/47] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:11 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1272 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:11.902810 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9ad8c9f3-aa25-447c-92ce-706b81a17eb9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:11.903452 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9ad8c9f3-aa25-447c-92ce-706b81a17eb9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:11.938031 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9ad8c9f3-aa25-447c-92ce-706b81a17eb9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:11.938663 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9ad8c9f3-aa25-447c-92ce-706b81a17eb9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:11.952061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9ad8c9f3-aa25-447c-92ce-706b81a17eb9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:11.953229 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9ad8c9f3-aa25-447c-92ce-706b81a17eb9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:11.953721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9ad8c9f3-aa25-447c-92ce-706b81a17eb9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:11.964751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9ad8c9f3-aa25-447c-92ce-706b81a17eb9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:12.716320 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6ad3e682-53b4-457d-bae8-0bba5955cc5d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:12.717725 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6ad3e682-53b4-457d-bae8-0bba5955cc5d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:12.720473 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=8 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:13:12.778734 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ad3e682-53b4-457d-bae8-0bba5955cc5d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:12.779837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ad3e682-53b4-457d-bae8-0bba5955cc5d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:12.780237 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ad3e682-53b4-457d-bae8-0bba5955cc5d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:12.786413 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ad3e682-53b4-457d-bae8-0bba5955cc5d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:12.787186 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ad3e682-53b4-457d-bae8-0bba5955cc5d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:12.788940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ad3e682-53b4-457d-bae8-0bba5955cc5d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:12.799371 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9ad8c9f3-aa25-447c-92ce-706b81a17eb9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:12.822253 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9ad8c9f3-aa25-447c-92ce-706b81a17eb9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1280 microversion: 2.1 time: 0.918284 Aug 04 23:13:12.827648 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 23/48] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:11 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1280 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:12.845229 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-bfef4eef-5520-45ff-8f06-3aaf1b1bb770 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:12.850023 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-bfef4eef-5520-45ff-8f06-3aaf1b1bb770 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:12.889363 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bfef4eef-5520-45ff-8f06-3aaf1b1bb770 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:12.893752 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bfef4eef-5520-45ff-8f06-3aaf1b1bb770 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:12.908879 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bfef4eef-5520-45ff-8f06-3aaf1b1bb770 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:12.912193 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bfef4eef-5520-45ff-8f06-3aaf1b1bb770 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:12.914341 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bfef4eef-5520-45ff-8f06-3aaf1b1bb770 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:12.918424 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bfef4eef-5520-45ff-8f06-3aaf1b1bb770 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:13.128397 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6ad3e682-53b4-457d-bae8-0bba5955cc5d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:13.141984 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6ad3e682-53b4-457d-bae8-0bba5955cc5d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1299 microversion: 2.1 time: 0.435014 Aug 04 23:13:13.145212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 26/49] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:12 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1299 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:13.753141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-bfef4eef-5520-45ff-8f06-3aaf1b1bb770 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:13.768665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-bfef4eef-5520-45ff-8f06-3aaf1b1bb770 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.933778 Aug 04 23:13:13.770658 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 24/50] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:12 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:13.860347 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-621b93d2-2f40-49cc-a0cb-3139aec60ff8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:13.860347 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-621b93d2-2f40-49cc-a0cb-3139aec60ff8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:13.887667 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-621b93d2-2f40-49cc-a0cb-3139aec60ff8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:13.888145 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-621b93d2-2f40-49cc-a0cb-3139aec60ff8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:13.898730 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-621b93d2-2f40-49cc-a0cb-3139aec60ff8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:13.902907 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-621b93d2-2f40-49cc-a0cb-3139aec60ff8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:13.903446 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-621b93d2-2f40-49cc-a0cb-3139aec60ff8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:13.903893 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-621b93d2-2f40-49cc-a0cb-3139aec60ff8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:14.174212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0faddaaf-fa4f-4a2f-8726-1c9c478264ed tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:14.176070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0faddaaf-fa4f-4a2f-8726-1c9c478264ed tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:14.202018 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0faddaaf-fa4f-4a2f-8726-1c9c478264ed tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:14.210613 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0faddaaf-fa4f-4a2f-8726-1c9c478264ed tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:14.211296 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0faddaaf-fa4f-4a2f-8726-1c9c478264ed tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:14.213669 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0faddaaf-fa4f-4a2f-8726-1c9c478264ed tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:14.215543 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0faddaaf-fa4f-4a2f-8726-1c9c478264ed tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:14.222835 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0faddaaf-fa4f-4a2f-8726-1c9c478264ed tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:14.363570 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-621b93d2-2f40-49cc-a0cb-3139aec60ff8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:14.376373 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-621b93d2-2f40-49cc-a0cb-3139aec60ff8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1280 microversion: 2.1 time: 0.522334 Aug 04 23:13:14.410198 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 27/51] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:13 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1280 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:14.598270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0faddaaf-fa4f-4a2f-8726-1c9c478264ed tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:14.608143 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0faddaaf-fa4f-4a2f-8726-1c9c478264ed tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1299 microversion: 2.1 time: 0.439214 Aug 04 23:13:14.624480 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 25/52] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:14 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1299 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:14.797295 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-01a09636-b884-4c07-8d2e-af5e56519565 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:14.798520 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-01a09636-b884-4c07-8d2e-af5e56519565 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:14.845600 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-01a09636-b884-4c07-8d2e-af5e56519565 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:14.848270 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-01a09636-b884-4c07-8d2e-af5e56519565 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:14.850421 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-01a09636-b884-4c07-8d2e-af5e56519565 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:14.854146 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-01a09636-b884-4c07-8d2e-af5e56519565 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:14.854834 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-01a09636-b884-4c07-8d2e-af5e56519565 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:14.855651 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-01a09636-b884-4c07-8d2e-af5e56519565 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:15.155246 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fe028d0b-0ce7-41fc-80b6-8a551cbbc750 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2087562488", "imageRef": "e1e9d70e-b252-44e5-9ecd-bf73cbf00160", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05e1cbeb-6971-4b4f-93b9-8471afd23a2d"}], "security_groups": [{"name": "tempest-securitygroup--1192736867"}], "key_name": "tempest-keypair-530975688", "user_data": "}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:13:16.406727 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.network.neutron [None req-fe028d0b-0ce7-41fc-80b6-8a551cbbc750 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] validate_networks() for [('05e1cbeb-6971-4b4f-93b9-8471afd23a2d', None, None, None, None, None)] {{(pid=129791) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 23:13:16.928076 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=4 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:13:17.177161 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-01a09636-b884-4c07-8d2e-af5e56519565 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:17.201523 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-01a09636-b884-4c07-8d2e-af5e56519565 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 2.411358 Aug 04 23:13:17.219783 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 28/53] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:14 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 2430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:17.232737 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3a46ee6c-f742-436f-93dd-c02fe391accd tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:17.233367 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3a46ee6c-f742-436f-93dd-c02fe391accd tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:17.252843 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a46ee6c-f742-436f-93dd-c02fe391accd tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:17.253354 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a46ee6c-f742-436f-93dd-c02fe391accd tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:17.253843 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a46ee6c-f742-436f-93dd-c02fe391accd tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:17.264805 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a46ee6c-f742-436f-93dd-c02fe391accd tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:17.269484 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a46ee6c-f742-436f-93dd-c02fe391accd tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:17.272289 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a46ee6c-f742-436f-93dd-c02fe391accd tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:17.887996 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3a46ee6c-f742-436f-93dd-c02fe391accd tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:17.903043 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3a46ee6c-f742-436f-93dd-c02fe391accd tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.670094 Aug 04 23:13:17.904276 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 29/54] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:17 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:17.914864 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5faf135a-6008-42bc-8125-d07bd4da96ae tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:17.917140 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5faf135a-6008-42bc-8125-d07bd4da96ae tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:17.936994 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5faf135a-6008-42bc-8125-d07bd4da96ae tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:17.937724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5faf135a-6008-42bc-8125-d07bd4da96ae tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:17.938394 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5faf135a-6008-42bc-8125-d07bd4da96ae tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:17.939321 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5faf135a-6008-42bc-8125-d07bd4da96ae tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:17.939959 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5faf135a-6008-42bc-8125-d07bd4da96ae tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:17.940614 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5faf135a-6008-42bc-8125-d07bd4da96ae tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:18.130286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-fe028d0b-0ce7-41fc-80b6-8a551cbbc750 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Flavor limits 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 23:13:18.130853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-fe028d0b-0ce7-41fc-80b6-8a551cbbc750 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Image limits 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 23:13:18.131261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-fe028d0b-0ce7-41fc-80b6-8a551cbbc750 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Flavor pref 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 23:13:18.131677 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-fe028d0b-0ce7-41fc-80b6-8a551cbbc750 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Image pref 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 23:13:18.132088 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-fe028d0b-0ce7-41fc-80b6-8a551cbbc750 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 23:13:18.162917 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fe028d0b-0ce7-41fc-80b6-8a551cbbc750 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:18.164777 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fe028d0b-0ce7-41fc-80b6-8a551cbbc750 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:18.168312 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fe028d0b-0ce7-41fc-80b6-8a551cbbc750 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:18.173698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fe028d0b-0ce7-41fc-80b6-8a551cbbc750 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:18.176597 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fe028d0b-0ce7-41fc-80b6-8a551cbbc750 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:18.177269 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fe028d0b-0ce7-41fc-80b6-8a551cbbc750 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:18.255512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-fe028d0b-0ce7-41fc-80b6-8a551cbbc750 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Getting quotas for project 6b185a89edfd42a19bfbeff8d9c66e36. Resources: {'ram', 'instances', 'cores'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:13:18.271761 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-fe028d0b-0ce7-41fc-80b6-8a551cbbc750 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Getting quotas for user c01696724a7c4291ae29cc10da276ea6 and project 6b185a89edfd42a19bfbeff8d9c66e36. Resources: {'ram', 'instances', 'cores'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:13:18.309480 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-fe028d0b-0ce7-41fc-80b6-8a551cbbc750 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Going to run 1 instances... {{(pid=129791) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 23:13:18.315512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-fe028d0b-0ce7-41fc-80b6-8a551cbbc750 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1e9d70e-b252-44e5-9ecd-bf73cbf00160',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 23:13:18.460312 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-fe028d0b-0ce7-41fc-80b6-8a551cbbc750 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.311430 Aug 04 23:13:18.470294 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 26/55] 10.222.0.33 () {62 vars in 1188 bytes} [Thu Aug 4 23:13:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 3322 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 04 23:13:18.486087 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6d839561-def8-474d-bf0f-e74f65ddc196 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:18.490763 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6d839561-def8-474d-bf0f-e74f65ddc196 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:18.509440 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6d839561-def8-474d-bf0f-e74f65ddc196 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:18.510374 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6d839561-def8-474d-bf0f-e74f65ddc196 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:18.512543 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6d839561-def8-474d-bf0f-e74f65ddc196 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:18.515808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6d839561-def8-474d-bf0f-e74f65ddc196 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:18.516936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6d839561-def8-474d-bf0f-e74f65ddc196 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:18.518541 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6d839561-def8-474d-bf0f-e74f65ddc196 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:18.647483 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5faf135a-6008-42bc-8125-d07bd4da96ae tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:18.673697 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5faf135a-6008-42bc-8125-d07bd4da96ae tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.766115 Aug 04 23:13:18.676798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 30/56] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:17 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:18.693259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0b370666-f5c4-4c44-bf19-58ca1c05805b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:18.709370 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0b370666-f5c4-4c44-bf19-58ca1c05805b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:18.729884 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=4 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:13:18.823836 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=22 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:13:19.432016 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0b370666-f5c4-4c44-bf19-58ca1c05805b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:19.457653 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0b370666-f5c4-4c44-bf19-58ca1c05805b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:19.464933 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0b370666-f5c4-4c44-bf19-58ca1c05805b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:19.467411 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0b370666-f5c4-4c44-bf19-58ca1c05805b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1281 microversion: 2.20 time: 0.787939 Aug 04 23:13:19.471591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 31/57] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:18 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1281 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:13:19.490473 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-55fb1b3e-46fa-4902-8490-653f2410c6cc tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:19.491435 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-55fb1b3e-46fa-4902-8490-653f2410c6cc tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:19.517765 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55fb1b3e-46fa-4902-8490-653f2410c6cc tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:19.518908 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55fb1b3e-46fa-4902-8490-653f2410c6cc tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:19.522892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55fb1b3e-46fa-4902-8490-653f2410c6cc tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:19.527881 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55fb1b3e-46fa-4902-8490-653f2410c6cc tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:19.531364 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55fb1b3e-46fa-4902-8490-653f2410c6cc tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:19.532073 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55fb1b3e-46fa-4902-8490-653f2410c6cc tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:20.406310 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6d839561-def8-474d-bf0f-e74f65ddc196 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:20.421285 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6d839561-def8-474d-bf0f-e74f65ddc196 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 1.946368 Aug 04 23:13:20.423516 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 27/58] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:18 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 1952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:20.431287 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-867b9dd7-e0e5-490a-8947-0d673fac6e0b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:20.432724 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-867b9dd7-e0e5-490a-8947-0d673fac6e0b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:20.453331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-867b9dd7-e0e5-490a-8947-0d673fac6e0b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:20.454056 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-867b9dd7-e0e5-490a-8947-0d673fac6e0b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:20.454615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-867b9dd7-e0e5-490a-8947-0d673fac6e0b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:20.459754 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-867b9dd7-e0e5-490a-8947-0d673fac6e0b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:20.463562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-867b9dd7-e0e5-490a-8947-0d673fac6e0b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:20.464232 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-867b9dd7-e0e5-490a-8947-0d673fac6e0b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:20.481796 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-55fb1b3e-46fa-4902-8490-653f2410c6cc tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:20.489827 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-55fb1b3e-46fa-4902-8490-653f2410c6cc tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 1.016950 Aug 04 23:13:20.498227 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 32/59] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:19 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:20.796142 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-f96163c6-f332-4e4f-976f-973f18282407 req-95fe9337-c525-4f42-9ef3-e46f4b3f9e3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faea55ff-7fe8-496e-a691-cbd9ce467f0a", "tag": "7c54c357-45ad-4b09-8da5-f5ebc9e3bd6b"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:13:20.848624 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-f96163c6-f332-4e4f-976f-973f18282407 req-95fe9337-c525-4f42-9ef3-e46f4b3f9e3e service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:20.849292 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-f96163c6-f332-4e4f-976f-973f18282407 req-95fe9337-c525-4f42-9ef3-e46f4b3f9e3e service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:20.849854 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-f96163c6-f332-4e4f-976f-973f18282407 req-95fe9337-c525-4f42-9ef3-e46f4b3f9e3e service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:20.929078 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-867b9dd7-e0e5-490a-8947-0d673fac6e0b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:20.936348 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-f96163c6-f332-4e4f-976f-973f18282407 req-95fe9337-c525-4f42-9ef3-e46f4b3f9e3e service nova] Creating event network-changed:7c54c357-45ad-4b09-8da5-f5ebc9e3bd6b for instance faea55ff-7fe8-496e-a691-cbd9ce467f0a on hv-cinder-85221 Aug 04 23:13:20.937029 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-f96163c6-f332-4e4f-976f-973f18282407 req-95fe9337-c525-4f42-9ef3-e46f4b3f9e3e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=129790) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 04 23:13:20.937439 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-f96163c6-f332-4e4f-976f-973f18282407 req-95fe9337-c525-4f42-9ef3-e46f4b3f9e3e service nova] Acquired lock "compute-rpcapi-router" {{(pid=129790) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 04 23:13:20.947573 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c743a6a6-8c5b-4fa5-ad7f-b03b8ae70aa5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:20.947573 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c743a6a6-8c5b-4fa5-ad7f-b03b8ae70aa5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:20.947573 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c743a6a6-8c5b-4fa5-ad7f-b03b8ae70aa5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:20.947573 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c743a6a6-8c5b-4fa5-ad7f-b03b8ae70aa5 None None] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:20.947573 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c743a6a6-8c5b-4fa5-ad7f-b03b8ae70aa5 None None] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:20.948246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c743a6a6-8c5b-4fa5-ad7f-b03b8ae70aa5 None None] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:20.949312 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-867b9dd7-e0e5-490a-8947-0d673fac6e0b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.515863 Aug 04 23:13:20.950202 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 28/60] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:20 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:20.956177 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-766bf2a8-86d8-45f1-a99c-d90ab8d6fa4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:20.957153 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-766bf2a8-86d8-45f1-a99c-d90ab8d6fa4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:20.965621 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-766bf2a8-86d8-45f1-a99c-d90ab8d6fa4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:20.966527 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-766bf2a8-86d8-45f1-a99c-d90ab8d6fa4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:20.968142 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-766bf2a8-86d8-45f1-a99c-d90ab8d6fa4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:20.969128 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-766bf2a8-86d8-45f1-a99c-d90ab8d6fa4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:20.969957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-766bf2a8-86d8-45f1-a99c-d90ab8d6fa4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:20.970713 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-766bf2a8-86d8-45f1-a99c-d90ab8d6fa4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:21.010962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.compute.rpcapi [None req-c743a6a6-8c5b-4fa5-ad7f-b03b8ae70aa5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 23:13:21.012471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c743a6a6-8c5b-4fa5-ad7f-b03b8ae70aa5 None None] Releasing lock "compute-rpcapi-router" {{(pid=129790) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 04 23:13:21.046889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c743a6a6-8c5b-4fa5-ad7f-b03b8ae70aa5 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.533571 Aug 04 23:13:21.047208 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 33/61] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:13:21.075753 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-766bf2a8-86d8-45f1-a99c-d90ab8d6fa4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:21.088245 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-766bf2a8-86d8-45f1-a99c-d90ab8d6fa4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:21.090449 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-766bf2a8-86d8-45f1-a99c-d90ab8d6fa4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:21.092273 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-766bf2a8-86d8-45f1-a99c-d90ab8d6fa4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1333 microversion: 2.20 time: 0.140472 Aug 04 23:13:21.093652 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 29/62] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:20 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1333 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:13:21.447493 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1945f32f-dc7d-4662-bb4e-3c24b25dc956 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:21.448197 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1945f32f-dc7d-4662-bb4e-3c24b25dc956 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:21.461520 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1945f32f-dc7d-4662-bb4e-3c24b25dc956 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:21.463425 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1945f32f-dc7d-4662-bb4e-3c24b25dc956 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:21.464992 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1945f32f-dc7d-4662-bb4e-3c24b25dc956 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:21.468061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1945f32f-dc7d-4662-bb4e-3c24b25dc956 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:21.468884 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1945f32f-dc7d-4662-bb4e-3c24b25dc956 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:21.469549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1945f32f-dc7d-4662-bb4e-3c24b25dc956 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:21.517786 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7edb451a-f354-4cde-911a-444299148bc5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:21.525923 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7edb451a-f354-4cde-911a-444299148bc5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:21.549690 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7edb451a-f354-4cde-911a-444299148bc5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:21.550206 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7edb451a-f354-4cde-911a-444299148bc5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:21.555738 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7edb451a-f354-4cde-911a-444299148bc5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:21.562408 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7edb451a-f354-4cde-911a-444299148bc5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:21.564961 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7edb451a-f354-4cde-911a-444299148bc5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:21.566872 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7edb451a-f354-4cde-911a-444299148bc5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:23.045075 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7edb451a-f354-4cde-911a-444299148bc5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:23.060131 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1945f32f-dc7d-4662-bb4e-3c24b25dc956 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:23.070032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1945f32f-dc7d-4662-bb4e-3c24b25dc956 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 1.626900 Aug 04 23:13:23.073512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7edb451a-f354-4cde-911a-444299148bc5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 1.562044 Aug 04 23:13:23.087658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 34/63] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:21 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:23.088082 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 30/64] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:21 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:23.098904 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0abd3095-468d-4c77-ae40-9d1dc682090f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:23.119369 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0abd3095-468d-4c77-ae40-9d1dc682090f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:23.131426 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0abd3095-468d-4c77-ae40-9d1dc682090f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:23.132273 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0abd3095-468d-4c77-ae40-9d1dc682090f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:23.137841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0abd3095-468d-4c77-ae40-9d1dc682090f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:23.139135 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0abd3095-468d-4c77-ae40-9d1dc682090f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:23.139891 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0abd3095-468d-4c77-ae40-9d1dc682090f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:23.140661 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0abd3095-468d-4c77-ae40-9d1dc682090f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:23.650524 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-14a9f818-1740-4fe6-afa5-08a5afad74ff req-d80b5d57-40a8-43db-b028-82773fc3d726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "852287f5-010e-4d74-a6ef-a4bf2f47c477", "tag": "f5be5be8-6bc4-4f6a-910d-b8fbf2981502"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:13:23.683936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:13:23.688889 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-14a9f818-1740-4fe6-afa5-08a5afad74ff req-d80b5d57-40a8-43db-b028-82773fc3d726 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:23.690984 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-14a9f818-1740-4fe6-afa5-08a5afad74ff req-d80b5d57-40a8-43db-b028-82773fc3d726 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:23.694029 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-14a9f818-1740-4fe6-afa5-08a5afad74ff req-d80b5d57-40a8-43db-b028-82773fc3d726 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:23.699938 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0abd3095-468d-4c77-ae40-9d1dc682090f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:23.742071 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0abd3095-468d-4c77-ae40-9d1dc682090f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.647351 Aug 04 23:13:23.756610 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 35/65] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:23 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:23.778661 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-87549644-e3a3-4583-836a-e7adef70da7e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:23.783118 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-87549644-e3a3-4583-836a-e7adef70da7e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:23.785884 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=73 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:13:23.799694 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87549644-e3a3-4583-836a-e7adef70da7e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:23.800177 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87549644-e3a3-4583-836a-e7adef70da7e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:23.800608 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87549644-e3a3-4583-836a-e7adef70da7e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:23.801315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87549644-e3a3-4583-836a-e7adef70da7e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:23.802938 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87549644-e3a3-4583-836a-e7adef70da7e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:23.811111 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87549644-e3a3-4583-836a-e7adef70da7e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:23.813360 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-14a9f818-1740-4fe6-afa5-08a5afad74ff req-d80b5d57-40a8-43db-b028-82773fc3d726 service nova] Creating event network-changed:f5be5be8-6bc4-4f6a-910d-b8fbf2981502 for instance 852287f5-010e-4d74-a6ef-a4bf2f47c477 on hv-cinder-85221 Aug 04 23:13:23.816868 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-14a9f818-1740-4fe6-afa5-08a5afad74ff req-d80b5d57-40a8-43db-b028-82773fc3d726 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=129791) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 04 23:13:23.817323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-14a9f818-1740-4fe6-afa5-08a5afad74ff req-d80b5d57-40a8-43db-b028-82773fc3d726 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129791) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 04 23:13:23.835331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-390fd8c2-343b-495d-ab16-f87c19800cbf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:23.837921 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-390fd8c2-343b-495d-ab16-f87c19800cbf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:23.838622 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-390fd8c2-343b-495d-ab16-f87c19800cbf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:23.844435 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-390fd8c2-343b-495d-ab16-f87c19800cbf None None] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:23.853513 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-390fd8c2-343b-495d-ab16-f87c19800cbf None None] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:23.854770 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-390fd8c2-343b-495d-ab16-f87c19800cbf None None] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:23.880758 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.compute.rpcapi [None req-390fd8c2-343b-495d-ab16-f87c19800cbf None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 23:13:23.882030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-390fd8c2-343b-495d-ab16-f87c19800cbf None None] Releasing lock "compute-rpcapi-router" {{(pid=129791) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 04 23:13:23.923053 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-390fd8c2-343b-495d-ab16-f87c19800cbf None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.833401 Aug 04 23:13:23.924284 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 31/66] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:13:24.007777 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-87549644-e3a3-4583-836a-e7adef70da7e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:24.031989 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-87549644-e3a3-4583-836a-e7adef70da7e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:24.039962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-87549644-e3a3-4583-836a-e7adef70da7e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:24.041339 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-87549644-e3a3-4583-836a-e7adef70da7e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1339 microversion: 2.20 time: 0.283357 Aug 04 23:13:24.044196 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 36/67] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:23 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1339 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:13:24.102811 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2cc59a4d-3aa6-4b07-b006-0361adbe86e9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:24.104729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2cc59a4d-3aa6-4b07-b006-0361adbe86e9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:24.113807 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0659ad44-54da-463f-a162-5602b8360105 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:24.114522 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0659ad44-54da-463f-a162-5602b8360105 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:24.126630 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2cc59a4d-3aa6-4b07-b006-0361adbe86e9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:24.127510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0659ad44-54da-463f-a162-5602b8360105 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:24.128012 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0659ad44-54da-463f-a162-5602b8360105 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:24.128310 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2cc59a4d-3aa6-4b07-b006-0361adbe86e9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:24.128498 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0659ad44-54da-463f-a162-5602b8360105 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:24.129217 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2cc59a4d-3aa6-4b07-b006-0361adbe86e9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:24.129345 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0659ad44-54da-463f-a162-5602b8360105 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:24.129669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0659ad44-54da-463f-a162-5602b8360105 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:24.131138 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0659ad44-54da-463f-a162-5602b8360105 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:24.133723 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2cc59a4d-3aa6-4b07-b006-0361adbe86e9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:24.136287 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2cc59a4d-3aa6-4b07-b006-0361adbe86e9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:24.136860 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2cc59a4d-3aa6-4b07-b006-0361adbe86e9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:24.680645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2cc59a4d-3aa6-4b07-b006-0361adbe86e9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:24.693492 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2cc59a4d-3aa6-4b07-b006-0361adbe86e9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.596479 Aug 04 23:13:24.694093 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 32/68] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:24 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:24.769474 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-622e2304-6ff4-430a-816d-5015d709ae19 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:24.771681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-622e2304-6ff4-430a-816d-5015d709ae19 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:24.782893 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-622e2304-6ff4-430a-816d-5015d709ae19 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:24.783723 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-622e2304-6ff4-430a-816d-5015d709ae19 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:24.784681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-622e2304-6ff4-430a-816d-5015d709ae19 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:24.786709 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-622e2304-6ff4-430a-816d-5015d709ae19 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:24.787485 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-622e2304-6ff4-430a-816d-5015d709ae19 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:24.788076 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-622e2304-6ff4-430a-816d-5015d709ae19 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:24.816917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0659ad44-54da-463f-a162-5602b8360105 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:24.832350 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0659ad44-54da-463f-a162-5602b8360105 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.720234 Aug 04 23:13:24.835429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 37/69] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:24 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:25.074477 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-918ba26a-e29c-4970-9269-2b98d87be4ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:25.076448 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-918ba26a-e29c-4970-9269-2b98d87be4ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:25.095897 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-918ba26a-e29c-4970-9269-2b98d87be4ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:25.096812 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-918ba26a-e29c-4970-9269-2b98d87be4ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:25.098845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-918ba26a-e29c-4970-9269-2b98d87be4ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:25.101373 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-918ba26a-e29c-4970-9269-2b98d87be4ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:25.125113 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-918ba26a-e29c-4970-9269-2b98d87be4ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:25.127083 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-918ba26a-e29c-4970-9269-2b98d87be4ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:25.302025 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-918ba26a-e29c-4970-9269-2b98d87be4ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:25.322965 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-918ba26a-e29c-4970-9269-2b98d87be4ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:25.328962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-918ba26a-e29c-4970-9269-2b98d87be4ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:25.332637 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-918ba26a-e29c-4970-9269-2b98d87be4ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1339 microversion: 2.20 time: 0.265233 Aug 04 23:13:25.336745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 38/70] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:25 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1339 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:13:25.523456 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-622e2304-6ff4-430a-816d-5015d709ae19 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:25.533010 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-622e2304-6ff4-430a-816d-5015d709ae19 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.769712 Aug 04 23:13:25.534722 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 33/71] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:24 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:25.723799 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b2a83531-4aba-45f2-aede-1bb033525e96 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:25.725574 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b2a83531-4aba-45f2-aede-1bb033525e96 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:25.733382 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b2a83531-4aba-45f2-aede-1bb033525e96 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:25.734886 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b2a83531-4aba-45f2-aede-1bb033525e96 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:25.735694 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b2a83531-4aba-45f2-aede-1bb033525e96 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:25.737033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b2a83531-4aba-45f2-aede-1bb033525e96 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:25.737739 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b2a83531-4aba-45f2-aede-1bb033525e96 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:25.738313 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b2a83531-4aba-45f2-aede-1bb033525e96 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:25.857905 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6ce08e50-6135-4234-be85-ede6e825656e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:25.859420 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6ce08e50-6135-4234-be85-ede6e825656e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:25.872705 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ce08e50-6135-4234-be85-ede6e825656e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:25.873505 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ce08e50-6135-4234-be85-ede6e825656e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:25.874676 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ce08e50-6135-4234-be85-ede6e825656e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:25.876732 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ce08e50-6135-4234-be85-ede6e825656e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:25.878742 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ce08e50-6135-4234-be85-ede6e825656e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:25.881258 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ce08e50-6135-4234-be85-ede6e825656e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:26.096649 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b2a83531-4aba-45f2-aede-1bb033525e96 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:26.110224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b2a83531-4aba-45f2-aede-1bb033525e96 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.391611 Aug 04 23:13:26.111726 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 39/72] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:25 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:26.116784 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-325aa413-47c2-44f0-9cd3-281e5727c608 req-48e91d59-2bbd-4295-9527-3b0a143b6a71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b9e29c3-d35b-4e35-90fb-6184265d0ecf", "tag": "a99ad26c-475b-45a9-a064-2c729edd77f1"}, {"name": "network-changed", "server_uuid": "2cd10c30-2a58-4afa-b3c3-2da74e98b7d9", "tag": "f0661d6e-dd49-44fb-9a40-a031958d1e11"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:13:26.140448 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-325aa413-47c2-44f0-9cd3-281e5727c608 req-48e91d59-2bbd-4295-9527-3b0a143b6a71 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:26.141120 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-325aa413-47c2-44f0-9cd3-281e5727c608 req-48e91d59-2bbd-4295-9527-3b0a143b6a71 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:26.141577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-325aa413-47c2-44f0-9cd3-281e5727c608 req-48e91d59-2bbd-4295-9527-3b0a143b6a71 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:26.159255 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6ce08e50-6135-4234-be85-ede6e825656e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:26.168191 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6ce08e50-6135-4234-be85-ede6e825656e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.315271 Aug 04 23:13:26.168783 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 34/73] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:25 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:26.172947 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-325aa413-47c2-44f0-9cd3-281e5727c608 req-48e91d59-2bbd-4295-9527-3b0a143b6a71 service nova] Creating event network-changed:a99ad26c-475b-45a9-a064-2c729edd77f1 for instance 9b9e29c3-d35b-4e35-90fb-6184265d0ecf on hv-cinder-85221 Aug 04 23:13:26.173900 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-325aa413-47c2-44f0-9cd3-281e5727c608 req-48e91d59-2bbd-4295-9527-3b0a143b6a71 service nova] Creating event network-changed:f0661d6e-dd49-44fb-9a40-a031958d1e11 for instance 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 on hv-cinder-85221 Aug 04 23:13:26.185896 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-325aa413-47c2-44f0-9cd3-281e5727c608 req-48e91d59-2bbd-4295-9527-3b0a143b6a71 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072438 Aug 04 23:13:26.186750 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 40/74] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:13:26.363009 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-856b5602-104e-4019-aac2-8aa63abdb144 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:26.363481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-856b5602-104e-4019-aac2-8aa63abdb144 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:26.374702 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-856b5602-104e-4019-aac2-8aa63abdb144 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:26.375872 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-856b5602-104e-4019-aac2-8aa63abdb144 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:26.376730 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-856b5602-104e-4019-aac2-8aa63abdb144 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:26.378249 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-856b5602-104e-4019-aac2-8aa63abdb144 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:26.379070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-856b5602-104e-4019-aac2-8aa63abdb144 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:26.380369 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-856b5602-104e-4019-aac2-8aa63abdb144 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:26.559085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-72ee7a09-94e8-4a2e-ba5b-cf38ee4d540d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:26.559895 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-72ee7a09-94e8-4a2e-ba5b-cf38ee4d540d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:26.569178 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72ee7a09-94e8-4a2e-ba5b-cf38ee4d540d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:26.572800 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72ee7a09-94e8-4a2e-ba5b-cf38ee4d540d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:26.574887 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72ee7a09-94e8-4a2e-ba5b-cf38ee4d540d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:26.578171 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72ee7a09-94e8-4a2e-ba5b-cf38ee4d540d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:26.578856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72ee7a09-94e8-4a2e-ba5b-cf38ee4d540d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:26.580180 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72ee7a09-94e8-4a2e-ba5b-cf38ee4d540d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:26.598623 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-856b5602-104e-4019-aac2-8aa63abdb144 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:26.613270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-856b5602-104e-4019-aac2-8aa63abdb144 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:26.629686 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-856b5602-104e-4019-aac2-8aa63abdb144 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:26.635056 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-856b5602-104e-4019-aac2-8aa63abdb144 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.276035 Aug 04 23:13:26.639437 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 35/75] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:26 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:13:26.861032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-72ee7a09-94e8-4a2e-ba5b-cf38ee4d540d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:26.865401 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:13:26.877503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-72ee7a09-94e8-4a2e-ba5b-cf38ee4d540d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.323638 Aug 04 23:13:26.879260 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 41/76] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:26 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:13:27.132132 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-49ebee7c-97a0-435b-aab5-609b18c5a479 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:27.132747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-49ebee7c-97a0-435b-aab5-609b18c5a479 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:27.144541 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-49ebee7c-97a0-435b-aab5-609b18c5a479 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:27.145210 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-49ebee7c-97a0-435b-aab5-609b18c5a479 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:27.145875 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-49ebee7c-97a0-435b-aab5-609b18c5a479 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:27.146795 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-49ebee7c-97a0-435b-aab5-609b18c5a479 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:27.147480 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-49ebee7c-97a0-435b-aab5-609b18c5a479 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:27.148125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-49ebee7c-97a0-435b-aab5-609b18c5a479 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:27.195422 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a301a57a-7535-4e57-a957-a091154123fb tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:27.197225 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a301a57a-7535-4e57-a957-a091154123fb tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:27.215153 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a301a57a-7535-4e57-a957-a091154123fb tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:27.216460 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a301a57a-7535-4e57-a957-a091154123fb tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:27.218238 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a301a57a-7535-4e57-a957-a091154123fb tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:27.220671 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a301a57a-7535-4e57-a957-a091154123fb tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:27.221907 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a301a57a-7535-4e57-a957-a091154123fb tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:27.223175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a301a57a-7535-4e57-a957-a091154123fb tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:27.442451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-49ebee7c-97a0-435b-aab5-609b18c5a479 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:27.452009 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-49ebee7c-97a0-435b-aab5-609b18c5a479 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.323901 Aug 04 23:13:27.453226 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 36/77] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:27 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:27.535902 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a301a57a-7535-4e57-a957-a091154123fb tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:27.547606 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a301a57a-7535-4e57-a957-a091154123fb tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.356820 Aug 04 23:13:27.549641 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 42/78] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:27 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:27.667146 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e69a1b0c-0e9c-4611-b8ff-259d35579c8a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:27.670850 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e69a1b0c-0e9c-4611-b8ff-259d35579c8a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:27.680543 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e69a1b0c-0e9c-4611-b8ff-259d35579c8a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:27.681523 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e69a1b0c-0e9c-4611-b8ff-259d35579c8a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:27.682604 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e69a1b0c-0e9c-4611-b8ff-259d35579c8a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:27.683812 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e69a1b0c-0e9c-4611-b8ff-259d35579c8a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:27.684673 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e69a1b0c-0e9c-4611-b8ff-259d35579c8a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:27.685286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e69a1b0c-0e9c-4611-b8ff-259d35579c8a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:27.891260 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e69a1b0c-0e9c-4611-b8ff-259d35579c8a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:27.898678 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d21663ad-ae9e-4a5b-b478-b47ecf0fdd5d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:27.902293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d21663ad-ae9e-4a5b-b478-b47ecf0fdd5d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:27.908724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d21663ad-ae9e-4a5b-b478-b47ecf0fdd5d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:27.908891 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e69a1b0c-0e9c-4611-b8ff-259d35579c8a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:27.909703 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d21663ad-ae9e-4a5b-b478-b47ecf0fdd5d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:27.910262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e69a1b0c-0e9c-4611-b8ff-259d35579c8a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:27.910684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d21663ad-ae9e-4a5b-b478-b47ecf0fdd5d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:27.911426 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e69a1b0c-0e9c-4611-b8ff-259d35579c8a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.251202 Aug 04 23:13:27.911792 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d21663ad-ae9e-4a5b-b478-b47ecf0fdd5d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:27.912248 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 37/79] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:27 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:13:27.923007 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d21663ad-ae9e-4a5b-b478-b47ecf0fdd5d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:27.923643 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d21663ad-ae9e-4a5b-b478-b47ecf0fdd5d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:28.083835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d21663ad-ae9e-4a5b-b478-b47ecf0fdd5d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:28.097407 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d21663ad-ae9e-4a5b-b478-b47ecf0fdd5d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.202415 Aug 04 23:13:28.098141 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 43/80] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:27 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:28.477272 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2a879f0c-b327-4c46-840b-6cf7496d5ac5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:28.479860 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2a879f0c-b327-4c46-840b-6cf7496d5ac5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:28.482392 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=22 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:13:28.489494 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a879f0c-b327-4c46-840b-6cf7496d5ac5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:28.490105 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a879f0c-b327-4c46-840b-6cf7496d5ac5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:28.490949 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a879f0c-b327-4c46-840b-6cf7496d5ac5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:28.491750 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a879f0c-b327-4c46-840b-6cf7496d5ac5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:28.492445 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a879f0c-b327-4c46-840b-6cf7496d5ac5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:28.493087 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a879f0c-b327-4c46-840b-6cf7496d5ac5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:28.571131 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9bbe6614-4691-46e4-a1ab-5e2fac98523b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:28.572750 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9bbe6614-4691-46e4-a1ab-5e2fac98523b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:28.584538 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9bbe6614-4691-46e4-a1ab-5e2fac98523b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:28.585436 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9bbe6614-4691-46e4-a1ab-5e2fac98523b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:28.588075 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9bbe6614-4691-46e4-a1ab-5e2fac98523b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:28.591930 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9bbe6614-4691-46e4-a1ab-5e2fac98523b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:28.595743 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9bbe6614-4691-46e4-a1ab-5e2fac98523b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:28.596356 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9bbe6614-4691-46e4-a1ab-5e2fac98523b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:28.683176 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2a879f0c-b327-4c46-840b-6cf7496d5ac5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:28.698558 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2a879f0c-b327-4c46-840b-6cf7496d5ac5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.221678 Aug 04 23:13:28.699572 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 38/81] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:28 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:28.850526 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9bbe6614-4691-46e4-a1ab-5e2fac98523b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:28.859317 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9bbe6614-4691-46e4-a1ab-5e2fac98523b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.293237 Aug 04 23:13:28.859928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 44/82] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:28 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:13:28.938620 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5c466f3d-3bb3-4dca-bcf5-103ed86b721f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:28.939607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5c466f3d-3bb3-4dca-bcf5-103ed86b721f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:28.945873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c466f3d-3bb3-4dca-bcf5-103ed86b721f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:28.946418 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c466f3d-3bb3-4dca-bcf5-103ed86b721f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:28.946944 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c466f3d-3bb3-4dca-bcf5-103ed86b721f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:28.947652 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c466f3d-3bb3-4dca-bcf5-103ed86b721f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:28.948774 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c466f3d-3bb3-4dca-bcf5-103ed86b721f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:28.949205 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c466f3d-3bb3-4dca-bcf5-103ed86b721f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:29.120106 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-02a5e844-61b3-4ff7-85be-490731c107f4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:29.121081 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-02a5e844-61b3-4ff7-85be-490731c107f4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:29.133292 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-02a5e844-61b3-4ff7-85be-490731c107f4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:29.135638 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-02a5e844-61b3-4ff7-85be-490731c107f4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:29.136316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-02a5e844-61b3-4ff7-85be-490731c107f4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:29.138379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-02a5e844-61b3-4ff7-85be-490731c107f4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:29.141211 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-02a5e844-61b3-4ff7-85be-490731c107f4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:29.141956 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-02a5e844-61b3-4ff7-85be-490731c107f4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:29.450854 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=2 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:13:29.568680 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5c466f3d-3bb3-4dca-bcf5-103ed86b721f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:29.581644 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5c466f3d-3bb3-4dca-bcf5-103ed86b721f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:29.583382 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5c466f3d-3bb3-4dca-bcf5-103ed86b721f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:29.595795 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5c466f3d-3bb3-4dca-bcf5-103ed86b721f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.661446 Aug 04 23:13:29.596661 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 39/83] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:28 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:13:29.657258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-02a5e844-61b3-4ff7-85be-490731c107f4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:29.665743 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-02a5e844-61b3-4ff7-85be-490731c107f4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.550962 Aug 04 23:13:29.666402 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 45/84] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:29 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:29.721267 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b3d5c890-2da1-4cb8-91ea-f335df44487d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:29.721887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b3d5c890-2da1-4cb8-91ea-f335df44487d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:29.736494 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b3d5c890-2da1-4cb8-91ea-f335df44487d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:29.737511 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b3d5c890-2da1-4cb8-91ea-f335df44487d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:29.739219 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b3d5c890-2da1-4cb8-91ea-f335df44487d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:29.741105 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b3d5c890-2da1-4cb8-91ea-f335df44487d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:29.744522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b3d5c890-2da1-4cb8-91ea-f335df44487d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:29.745174 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b3d5c890-2da1-4cb8-91ea-f335df44487d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:29.881712 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ede0c86f-525d-4c14-b851-37aacef45c3b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:29.882789 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ede0c86f-525d-4c14-b851-37aacef45c3b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:29.901285 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ede0c86f-525d-4c14-b851-37aacef45c3b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:29.903653 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ede0c86f-525d-4c14-b851-37aacef45c3b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:29.905889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ede0c86f-525d-4c14-b851-37aacef45c3b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:29.907287 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ede0c86f-525d-4c14-b851-37aacef45c3b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:29.909832 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ede0c86f-525d-4c14-b851-37aacef45c3b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:29.911157 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ede0c86f-525d-4c14-b851-37aacef45c3b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:30.146126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b3d5c890-2da1-4cb8-91ea-f335df44487d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:30.155096 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b3d5c890-2da1-4cb8-91ea-f335df44487d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.438468 Aug 04 23:13:30.166606 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 40/85] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:29 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:30.263394 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ede0c86f-525d-4c14-b851-37aacef45c3b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:30.279501 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ede0c86f-525d-4c14-b851-37aacef45c3b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.394356 Aug 04 23:13:30.280819 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 46/86] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:29 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:30.437808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-ea47c142-425a-4f33-9ceb-1849d186574d req-89a7746f-8438-44ed-8b44-da5663d60769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2013d923-81bb-4002-976d-64d3722b15d2", "tag": "bae5f1bd-b332-4fbe-8c3e-7f38e098b71d"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:13:30.454400 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-ea47c142-425a-4f33-9ceb-1849d186574d req-89a7746f-8438-44ed-8b44-da5663d60769 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:30.456031 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-ea47c142-425a-4f33-9ceb-1849d186574d req-89a7746f-8438-44ed-8b44-da5663d60769 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:30.456693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-ea47c142-425a-4f33-9ceb-1849d186574d req-89a7746f-8438-44ed-8b44-da5663d60769 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:30.476113 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-ea47c142-425a-4f33-9ceb-1849d186574d req-89a7746f-8438-44ed-8b44-da5663d60769 service nova] Creating event network-changed:bae5f1bd-b332-4fbe-8c3e-7f38e098b71d for instance 2013d923-81bb-4002-976d-64d3722b15d2 on hv-cinder-85221 Aug 04 23:13:30.484497 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-ea47c142-425a-4f33-9ceb-1849d186574d req-89a7746f-8438-44ed-8b44-da5663d60769 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049680 Aug 04 23:13:30.485857 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 41/87] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:13:30.619597 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2fa6e63f-70fa-40ce-8a6f-66da0ac74a28 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:30.620224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2fa6e63f-70fa-40ce-8a6f-66da0ac74a28 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:30.626194 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fa6e63f-70fa-40ce-8a6f-66da0ac74a28 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:30.626759 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fa6e63f-70fa-40ce-8a6f-66da0ac74a28 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:30.627185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fa6e63f-70fa-40ce-8a6f-66da0ac74a28 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:30.628026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fa6e63f-70fa-40ce-8a6f-66da0ac74a28 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:30.628491 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fa6e63f-70fa-40ce-8a6f-66da0ac74a28 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:30.628914 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fa6e63f-70fa-40ce-8a6f-66da0ac74a28 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:30.692773 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2da33cb0-b066-46e7-ab69-cf5f408a61fe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:30.693651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2da33cb0-b066-46e7-ab69-cf5f408a61fe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:30.722165 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2da33cb0-b066-46e7-ab69-cf5f408a61fe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:30.723023 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2da33cb0-b066-46e7-ab69-cf5f408a61fe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:30.725124 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2da33cb0-b066-46e7-ab69-cf5f408a61fe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:30.727306 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2da33cb0-b066-46e7-ab69-cf5f408a61fe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:30.728705 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2da33cb0-b066-46e7-ab69-cf5f408a61fe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:30.747918 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2da33cb0-b066-46e7-ab69-cf5f408a61fe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:30.930508 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2fa6e63f-70fa-40ce-8a6f-66da0ac74a28 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:30.954807 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2fa6e63f-70fa-40ce-8a6f-66da0ac74a28 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:30.957244 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2fa6e63f-70fa-40ce-8a6f-66da0ac74a28 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:30.965302 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2fa6e63f-70fa-40ce-8a6f-66da0ac74a28 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.350588 Aug 04 23:13:30.965905 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 47/88] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:30 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:13:30.993737 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2da33cb0-b066-46e7-ab69-cf5f408a61fe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:31.002518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2da33cb0-b066-46e7-ab69-cf5f408a61fe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.319009 Aug 04 23:13:31.011317 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 42/89] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:30 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:31.181528 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a3d1ed18-4d70-4674-92fa-b07900782157 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:31.182322 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a3d1ed18-4d70-4674-92fa-b07900782157 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:31.185218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=2 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:13:31.192884 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a3d1ed18-4d70-4674-92fa-b07900782157 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:31.193781 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a3d1ed18-4d70-4674-92fa-b07900782157 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:31.194506 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a3d1ed18-4d70-4674-92fa-b07900782157 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:31.195394 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a3d1ed18-4d70-4674-92fa-b07900782157 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:31.196033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a3d1ed18-4d70-4674-92fa-b07900782157 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:31.197330 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a3d1ed18-4d70-4674-92fa-b07900782157 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:31.301180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-cc4a77ce-388f-401d-a5d9-3dbf896346b2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:31.301890 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-cc4a77ce-388f-401d-a5d9-3dbf896346b2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:31.309911 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc4a77ce-388f-401d-a5d9-3dbf896346b2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:31.313092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc4a77ce-388f-401d-a5d9-3dbf896346b2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:31.313694 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc4a77ce-388f-401d-a5d9-3dbf896346b2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:31.317127 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc4a77ce-388f-401d-a5d9-3dbf896346b2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:31.317858 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc4a77ce-388f-401d-a5d9-3dbf896346b2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:31.318631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc4a77ce-388f-401d-a5d9-3dbf896346b2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:31.397888 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a3d1ed18-4d70-4674-92fa-b07900782157 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:31.417373 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a3d1ed18-4d70-4674-92fa-b07900782157 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.240976 Aug 04 23:13:31.425966 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 48/90] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:31 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:31.525210 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cc4a77ce-388f-401d-a5d9-3dbf896346b2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:31.536203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-cc4a77ce-388f-401d-a5d9-3dbf896346b2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.239145 Aug 04 23:13:31.536951 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 43/91] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:31 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:13:32.007132 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-23bdf932-cd0b-4471-9e9c-db137d810110 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:32.007960 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-23bdf932-cd0b-4471-9e9c-db137d810110 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:32.014958 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-23bdf932-cd0b-4471-9e9c-db137d810110 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:32.015438 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-23bdf932-cd0b-4471-9e9c-db137d810110 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:32.015888 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-23bdf932-cd0b-4471-9e9c-db137d810110 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:32.016560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-23bdf932-cd0b-4471-9e9c-db137d810110 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:32.017004 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-23bdf932-cd0b-4471-9e9c-db137d810110 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:32.017833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-23bdf932-cd0b-4471-9e9c-db137d810110 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:32.027170 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b1b7fd8a-547b-4522-b93d-e3fd61a0b8be tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:32.027793 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b1b7fd8a-547b-4522-b93d-e3fd61a0b8be tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:32.033648 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b1b7fd8a-547b-4522-b93d-e3fd61a0b8be tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:32.034126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b1b7fd8a-547b-4522-b93d-e3fd61a0b8be tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:32.034586 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b1b7fd8a-547b-4522-b93d-e3fd61a0b8be tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:32.035467 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b1b7fd8a-547b-4522-b93d-e3fd61a0b8be tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:32.036081 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b1b7fd8a-547b-4522-b93d-e3fd61a0b8be tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:32.036504 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b1b7fd8a-547b-4522-b93d-e3fd61a0b8be tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:32.234969 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-23bdf932-cd0b-4471-9e9c-db137d810110 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:32.238385 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b1b7fd8a-547b-4522-b93d-e3fd61a0b8be tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:32.246211 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-23bdf932-cd0b-4471-9e9c-db137d810110 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:32.247396 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b1b7fd8a-547b-4522-b93d-e3fd61a0b8be tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.226594 Aug 04 23:13:32.247977 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 44/92] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:32 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:32.248184 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-23bdf932-cd0b-4471-9e9c-db137d810110 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:32.249480 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-23bdf932-cd0b-4471-9e9c-db137d810110 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.246281 Aug 04 23:13:32.255189 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 49/93] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:32 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:13:32.442714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-35192405-6aad-413d-8d90-9a20f38328e0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:32.443324 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-35192405-6aad-413d-8d90-9a20f38328e0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:32.450027 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35192405-6aad-413d-8d90-9a20f38328e0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:32.450538 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35192405-6aad-413d-8d90-9a20f38328e0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:32.450968 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35192405-6aad-413d-8d90-9a20f38328e0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:32.451663 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35192405-6aad-413d-8d90-9a20f38328e0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:32.452108 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35192405-6aad-413d-8d90-9a20f38328e0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:32.452528 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35192405-6aad-413d-8d90-9a20f38328e0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:32.557730 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-de22b878-e588-43d3-80db-37b567c8c4e3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:32.558348 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-de22b878-e588-43d3-80db-37b567c8c4e3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:32.564973 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de22b878-e588-43d3-80db-37b567c8c4e3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:32.565347 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de22b878-e588-43d3-80db-37b567c8c4e3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:32.566091 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de22b878-e588-43d3-80db-37b567c8c4e3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:32.566826 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de22b878-e588-43d3-80db-37b567c8c4e3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:32.567282 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de22b878-e588-43d3-80db-37b567c8c4e3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:32.567702 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de22b878-e588-43d3-80db-37b567c8c4e3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:32.595321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-35192405-6aad-413d-8d90-9a20f38328e0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:32.605302 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-35192405-6aad-413d-8d90-9a20f38328e0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.166285 Aug 04 23:13:32.620300 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 45/94] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:32 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:32.717549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-de22b878-e588-43d3-80db-37b567c8c4e3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:32.725085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-de22b878-e588-43d3-80db-37b567c8c4e3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.172182 Aug 04 23:13:32.725596 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 50/95] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:32 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:13:33.268723 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ac116696-b5b1-440f-8462-1f673fd2b3eb tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:33.269569 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ac116696-b5b1-440f-8462-1f673fd2b3eb tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:33.275461 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a8f17896-b6e6-4b9e-a234-76bb3835d7b4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:33.276015 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac116696-b5b1-440f-8462-1f673fd2b3eb tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:33.276759 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac116696-b5b1-440f-8462-1f673fd2b3eb tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:33.277084 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a8f17896-b6e6-4b9e-a234-76bb3835d7b4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:33.277485 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac116696-b5b1-440f-8462-1f673fd2b3eb tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:33.278245 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac116696-b5b1-440f-8462-1f673fd2b3eb tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:33.279208 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac116696-b5b1-440f-8462-1f673fd2b3eb tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:33.279853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac116696-b5b1-440f-8462-1f673fd2b3eb tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:33.286513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8f17896-b6e6-4b9e-a234-76bb3835d7b4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:33.287122 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8f17896-b6e6-4b9e-a234-76bb3835d7b4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:33.288060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8f17896-b6e6-4b9e-a234-76bb3835d7b4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:33.288951 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8f17896-b6e6-4b9e-a234-76bb3835d7b4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:33.289800 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8f17896-b6e6-4b9e-a234-76bb3835d7b4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:33.290586 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8f17896-b6e6-4b9e-a234-76bb3835d7b4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:33.520847 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ac116696-b5b1-440f-8462-1f673fd2b3eb tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:33.525402 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a8f17896-b6e6-4b9e-a234-76bb3835d7b4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:33.529434 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ac116696-b5b1-440f-8462-1f673fd2b3eb tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.264754 Aug 04 23:13:33.530099 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 46/96] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:33 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:33.533441 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a8f17896-b6e6-4b9e-a234-76bb3835d7b4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:33.535004 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a8f17896-b6e6-4b9e-a234-76bb3835d7b4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:33.536141 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a8f17896-b6e6-4b9e-a234-76bb3835d7b4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.267179 Aug 04 23:13:33.536684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 51/97] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:33 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:13:33.628035 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e5b6e9eb-a519-4564-82fa-289da7e86e86 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:33.628681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e5b6e9eb-a519-4564-82fa-289da7e86e86 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:33.636494 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e5b6e9eb-a519-4564-82fa-289da7e86e86 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:33.637400 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e5b6e9eb-a519-4564-82fa-289da7e86e86 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:33.637400 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e5b6e9eb-a519-4564-82fa-289da7e86e86 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:33.638068 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e5b6e9eb-a519-4564-82fa-289da7e86e86 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:33.638548 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e5b6e9eb-a519-4564-82fa-289da7e86e86 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:33.639153 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e5b6e9eb-a519-4564-82fa-289da7e86e86 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:33.747062 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-33a15d74-e48a-4db1-aaf5-033f8578001d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:33.747841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-33a15d74-e48a-4db1-aaf5-033f8578001d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:33.758484 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-33a15d74-e48a-4db1-aaf5-033f8578001d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:33.759656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-33a15d74-e48a-4db1-aaf5-033f8578001d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:33.760811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-33a15d74-e48a-4db1-aaf5-033f8578001d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:33.761706 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-33a15d74-e48a-4db1-aaf5-033f8578001d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:33.762159 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-33a15d74-e48a-4db1-aaf5-033f8578001d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:33.762609 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-33a15d74-e48a-4db1-aaf5-033f8578001d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:33.792018 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e5b6e9eb-a519-4564-82fa-289da7e86e86 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:33.799843 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e5b6e9eb-a519-4564-82fa-289da7e86e86 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.175590 Aug 04 23:13:33.800512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 47/98] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:33 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:33.915828 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-33a15d74-e48a-4db1-aaf5-033f8578001d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:33.925110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-33a15d74-e48a-4db1-aaf5-033f8578001d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.183044 Aug 04 23:13:33.925757 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 52/99] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:33 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:13:34.551096 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1df526f9-ec98-4f5e-9f36-cd444142b3a4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:34.551981 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1df526f9-ec98-4f5e-9f36-cd444142b3a4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:34.553725 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=4 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:13:34.559062 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-81fceee6-2d13-4a53-ba1b-2a4d4d9387cc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:34.559625 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1df526f9-ec98-4f5e-9f36-cd444142b3a4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:34.559721 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-81fceee6-2d13-4a53-ba1b-2a4d4d9387cc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:34.559804 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1df526f9-ec98-4f5e-9f36-cd444142b3a4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:34.560189 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1df526f9-ec98-4f5e-9f36-cd444142b3a4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:34.561080 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1df526f9-ec98-4f5e-9f36-cd444142b3a4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:34.561727 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1df526f9-ec98-4f5e-9f36-cd444142b3a4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:34.562101 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1df526f9-ec98-4f5e-9f36-cd444142b3a4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:34.566141 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81fceee6-2d13-4a53-ba1b-2a4d4d9387cc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:34.566619 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81fceee6-2d13-4a53-ba1b-2a4d4d9387cc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:34.567237 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81fceee6-2d13-4a53-ba1b-2a4d4d9387cc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:34.567974 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81fceee6-2d13-4a53-ba1b-2a4d4d9387cc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:34.568416 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81fceee6-2d13-4a53-ba1b-2a4d4d9387cc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:34.568790 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81fceee6-2d13-4a53-ba1b-2a4d4d9387cc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:34.816811 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1df526f9-ec98-4f5e-9f36-cd444142b3a4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:34.819219 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:13:34.823163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-81fceee6-2d13-4a53-ba1b-2a4d4d9387cc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:34.831438 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1df526f9-ec98-4f5e-9f36-cd444142b3a4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.284147 Aug 04 23:13:34.834333 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 48/100] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:34 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:34.842756 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-81fceee6-2d13-4a53-ba1b-2a4d4d9387cc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:34.844292 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-81fceee6-2d13-4a53-ba1b-2a4d4d9387cc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:34.845400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-81fceee6-2d13-4a53-ba1b-2a4d4d9387cc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.290337 Aug 04 23:13:34.846185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 53/101] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:34 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:13:34.851086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b4abbbdd-a73d-4178-a305-caee53f71a1f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:34.852032 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b4abbbdd-a73d-4178-a305-caee53f71a1f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:34.859369 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b4abbbdd-a73d-4178-a305-caee53f71a1f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:34.860323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b4abbbdd-a73d-4178-a305-caee53f71a1f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:34.861031 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b4abbbdd-a73d-4178-a305-caee53f71a1f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:34.862072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b4abbbdd-a73d-4178-a305-caee53f71a1f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:34.862574 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b4abbbdd-a73d-4178-a305-caee53f71a1f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:34.862994 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b4abbbdd-a73d-4178-a305-caee53f71a1f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:34.946933 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-135a588b-4c3b-4b89-ac31-3b102744b53d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:34.947867 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-135a588b-4c3b-4b89-ac31-3b102744b53d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:34.960355 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-135a588b-4c3b-4b89-ac31-3b102744b53d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:34.961969 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-135a588b-4c3b-4b89-ac31-3b102744b53d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:34.962496 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-135a588b-4c3b-4b89-ac31-3b102744b53d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:34.967758 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-135a588b-4c3b-4b89-ac31-3b102744b53d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:34.968189 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-135a588b-4c3b-4b89-ac31-3b102744b53d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:34.968625 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-135a588b-4c3b-4b89-ac31-3b102744b53d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:35.031269 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b4abbbdd-a73d-4178-a305-caee53f71a1f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:35.041050 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b4abbbdd-a73d-4178-a305-caee53f71a1f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.204151 Aug 04 23:13:35.043079 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 49/102] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:34 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:35.124572 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-135a588b-4c3b-4b89-ac31-3b102744b53d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:35.132341 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-135a588b-4c3b-4b89-ac31-3b102744b53d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.189354 Aug 04 23:13:35.133042 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 54/103] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:34 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:13:35.860357 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-cc7092e1-9e26-4878-8617-21605fa90604 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:35.861201 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-cc7092e1-9e26-4878-8617-21605fa90604 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:35.868151 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc7092e1-9e26-4878-8617-21605fa90604 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:35.868775 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc7092e1-9e26-4878-8617-21605fa90604 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:35.869908 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc7092e1-9e26-4878-8617-21605fa90604 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:35.870885 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc7092e1-9e26-4878-8617-21605fa90604 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:35.871346 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc7092e1-9e26-4878-8617-21605fa90604 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:35.872011 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc7092e1-9e26-4878-8617-21605fa90604 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:35.873762 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a139002c-bb8e-49cf-b94d-45e2787d4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:35.875336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a139002c-bb8e-49cf-b94d-45e2787d4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:35.882423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a139002c-bb8e-49cf-b94d-45e2787d4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:35.883364 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a139002c-bb8e-49cf-b94d-45e2787d4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:35.883963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a139002c-bb8e-49cf-b94d-45e2787d4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:35.885150 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a139002c-bb8e-49cf-b94d-45e2787d4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:35.885866 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a139002c-bb8e-49cf-b94d-45e2787d4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:35.886474 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a139002c-bb8e-49cf-b94d-45e2787d4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:36.094751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cc7092e1-9e26-4878-8617-21605fa90604 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:36.095473 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a139002c-bb8e-49cf-b94d-45e2787d4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:36.104251 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a139002c-bb8e-49cf-b94d-45e2787d4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:36.108857 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a139002c-bb8e-49cf-b94d-45e2787d4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:36.108857 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a139002c-bb8e-49cf-b94d-45e2787d4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.241027 Aug 04 23:13:36.108857 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 55/104] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:35 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:13:36.110828 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-cc7092e1-9e26-4878-8617-21605fa90604 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.254112 Aug 04 23:13:36.111941 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 50/105] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:35 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:36.119200 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8a3f84a9-b6a5-41a8-abfd-795c25a3baa9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:36.120186 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8a3f84a9-b6a5-41a8-abfd-795c25a3baa9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:36.126719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a3f84a9-b6a5-41a8-abfd-795c25a3baa9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:36.127208 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a3f84a9-b6a5-41a8-abfd-795c25a3baa9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:36.127643 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a3f84a9-b6a5-41a8-abfd-795c25a3baa9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:36.128523 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a3f84a9-b6a5-41a8-abfd-795c25a3baa9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:36.129112 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a3f84a9-b6a5-41a8-abfd-795c25a3baa9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:36.129682 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a3f84a9-b6a5-41a8-abfd-795c25a3baa9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:36.155828 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a5ea30b8-8044-4891-804e-8f44f7cd69e7 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:36.157439 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a5ea30b8-8044-4891-804e-8f44f7cd69e7 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:36.165332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5ea30b8-8044-4891-804e-8f44f7cd69e7 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:36.166228 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5ea30b8-8044-4891-804e-8f44f7cd69e7 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:36.166853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5ea30b8-8044-4891-804e-8f44f7cd69e7 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:36.167640 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5ea30b8-8044-4891-804e-8f44f7cd69e7 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:36.168164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5ea30b8-8044-4891-804e-8f44f7cd69e7 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:36.168719 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5ea30b8-8044-4891-804e-8f44f7cd69e7 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:36.378807 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8a3f84a9-b6a5-41a8-abfd-795c25a3baa9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:36.379033 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a5ea30b8-8044-4891-804e-8f44f7cd69e7 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:36.387701 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a5ea30b8-8044-4891-804e-8f44f7cd69e7 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.238193 Aug 04 23:13:36.389114 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 51/106] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:36 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:13:36.398021 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8a3f84a9-b6a5-41a8-abfd-795c25a3baa9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.286026 Aug 04 23:13:36.398998 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 56/107] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:36 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:37.129725 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6c2031de-6dc5-45e2-b472-fe92cf0aac82 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:37.131077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6c2031de-6dc5-45e2-b472-fe92cf0aac82 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:37.141391 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-abdfe52d-3ad3-44a7-8700-439520a8b6f0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:37.142011 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-abdfe52d-3ad3-44a7-8700-439520a8b6f0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:37.150211 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6c2031de-6dc5-45e2-b472-fe92cf0aac82 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:37.150795 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6c2031de-6dc5-45e2-b472-fe92cf0aac82 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:37.151214 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6c2031de-6dc5-45e2-b472-fe92cf0aac82 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:37.151918 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6c2031de-6dc5-45e2-b472-fe92cf0aac82 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:37.152444 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6c2031de-6dc5-45e2-b472-fe92cf0aac82 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:37.152842 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6c2031de-6dc5-45e2-b472-fe92cf0aac82 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:37.155531 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-abdfe52d-3ad3-44a7-8700-439520a8b6f0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:37.156348 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-abdfe52d-3ad3-44a7-8700-439520a8b6f0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:37.157350 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-abdfe52d-3ad3-44a7-8700-439520a8b6f0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:37.158284 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-abdfe52d-3ad3-44a7-8700-439520a8b6f0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:37.158974 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-abdfe52d-3ad3-44a7-8700-439520a8b6f0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:37.159641 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-abdfe52d-3ad3-44a7-8700-439520a8b6f0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:37.445980 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-abdfe52d-3ad3-44a7-8700-439520a8b6f0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:37.449347 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6c2031de-6dc5-45e2-b472-fe92cf0aac82 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:37.458832 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-abdfe52d-3ad3-44a7-8700-439520a8b6f0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.318427 Aug 04 23:13:37.459434 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6c2031de-6dc5-45e2-b472-fe92cf0aac82 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:37.460501 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 57/108] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:37 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:37.461206 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6c2031de-6dc5-45e2-b472-fe92cf0aac82 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:37.463060 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6c2031de-6dc5-45e2-b472-fe92cf0aac82 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.336666 Aug 04 23:13:37.463624 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 52/109] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:37 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:13:37.467914 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2c7578fd-fc6d-41fa-a614-9e134a19d20d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:37.469681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-43a7ba0f-887b-4b92-9879-d34f8abca77c tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:37.470299 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-43a7ba0f-887b-4b92-9879-d34f8abca77c tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:37.473119 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2c7578fd-fc6d-41fa-a614-9e134a19d20d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:37.490112 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-43a7ba0f-887b-4b92-9879-d34f8abca77c tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:37.490112 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-43a7ba0f-887b-4b92-9879-d34f8abca77c tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:37.490112 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-43a7ba0f-887b-4b92-9879-d34f8abca77c tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:37.490112 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-43a7ba0f-887b-4b92-9879-d34f8abca77c tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:37.490472 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c7578fd-fc6d-41fa-a614-9e134a19d20d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:37.490472 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c7578fd-fc6d-41fa-a614-9e134a19d20d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:37.490472 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c7578fd-fc6d-41fa-a614-9e134a19d20d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:37.490690 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-43a7ba0f-887b-4b92-9879-d34f8abca77c tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:37.490690 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-43a7ba0f-887b-4b92-9879-d34f8abca77c tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:37.491253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c7578fd-fc6d-41fa-a614-9e134a19d20d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:37.491781 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c7578fd-fc6d-41fa-a614-9e134a19d20d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:37.492272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c7578fd-fc6d-41fa-a614-9e134a19d20d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:37.518240 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:13:37.749152 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-43a7ba0f-887b-4b92-9879-d34f8abca77c tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:37.765538 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-43a7ba0f-887b-4b92-9879-d34f8abca77c tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.300657 Aug 04 23:13:37.768205 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 53/110] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:37 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:37.776199 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2c7578fd-fc6d-41fa-a614-9e134a19d20d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:37.796850 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2c7578fd-fc6d-41fa-a614-9e134a19d20d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.332606 Aug 04 23:13:37.797559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 58/111] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:37 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:38.481924 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8db46dec-c279-4851-bc29-6647ebd286d6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:38.482634 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8db46dec-c279-4851-bc29-6647ebd286d6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:38.485447 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b414107c-77ed-49f9-ab9d-3613de16638c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:38.486063 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b414107c-77ed-49f9-ab9d-3613de16638c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:38.489147 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8db46dec-c279-4851-bc29-6647ebd286d6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:38.489731 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8db46dec-c279-4851-bc29-6647ebd286d6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:38.490351 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8db46dec-c279-4851-bc29-6647ebd286d6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:38.490351 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8db46dec-c279-4851-bc29-6647ebd286d6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:38.490351 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8db46dec-c279-4851-bc29-6647ebd286d6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:38.490351 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8db46dec-c279-4851-bc29-6647ebd286d6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:38.493419 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b414107c-77ed-49f9-ab9d-3613de16638c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:38.494752 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b414107c-77ed-49f9-ab9d-3613de16638c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:38.494877 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b414107c-77ed-49f9-ab9d-3613de16638c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:38.495948 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b414107c-77ed-49f9-ab9d-3613de16638c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:38.496606 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b414107c-77ed-49f9-ab9d-3613de16638c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:38.497097 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b414107c-77ed-49f9-ab9d-3613de16638c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:38.708175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b414107c-77ed-49f9-ab9d-3613de16638c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:38.711494 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8db46dec-c279-4851-bc29-6647ebd286d6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:38.718830 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b414107c-77ed-49f9-ab9d-3613de16638c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:38.720259 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8db46dec-c279-4851-bc29-6647ebd286d6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.242929 Aug 04 23:13:38.720405 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b414107c-77ed-49f9-ab9d-3613de16638c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:38.721593 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b414107c-77ed-49f9-ab9d-3613de16638c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.240397 Aug 04 23:13:38.721824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 54/112] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:38 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:38.722648 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 59/113] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:38 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:13:38.788620 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e5d1668b-8a90-43bc-a0c6-98cf03a7b84e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:38.789179 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e5d1668b-8a90-43bc-a0c6-98cf03a7b84e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:38.795794 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e5d1668b-8a90-43bc-a0c6-98cf03a7b84e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:38.796270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e5d1668b-8a90-43bc-a0c6-98cf03a7b84e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:38.796694 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e5d1668b-8a90-43bc-a0c6-98cf03a7b84e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:38.797376 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e5d1668b-8a90-43bc-a0c6-98cf03a7b84e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:38.797838 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e5d1668b-8a90-43bc-a0c6-98cf03a7b84e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:38.798423 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e5d1668b-8a90-43bc-a0c6-98cf03a7b84e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:38.824169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-98045d07-06b8-40e0-b992-c0291148f8b7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:38.839557 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-98045d07-06b8-40e0-b992-c0291148f8b7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:38.848341 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-98045d07-06b8-40e0-b992-c0291148f8b7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:38.849084 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-98045d07-06b8-40e0-b992-c0291148f8b7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:38.851897 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-98045d07-06b8-40e0-b992-c0291148f8b7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:38.853856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-98045d07-06b8-40e0-b992-c0291148f8b7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:38.854703 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-98045d07-06b8-40e0-b992-c0291148f8b7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:38.855455 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-98045d07-06b8-40e0-b992-c0291148f8b7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:39.002292 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e5d1668b-8a90-43bc-a0c6-98cf03a7b84e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:39.010150 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e5d1668b-8a90-43bc-a0c6-98cf03a7b84e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.225196 Aug 04 23:13:39.011995 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 55/114] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:38 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:39.040369 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-98045d07-06b8-40e0-b992-c0291148f8b7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:39.048035 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-98045d07-06b8-40e0-b992-c0291148f8b7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.231146 Aug 04 23:13:39.048601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 60/115] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:38 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:39.741226 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-47d6737e-b8f3-4450-b421-bdafad490108 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:39.742017 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-47d6737e-b8f3-4450-b421-bdafad490108 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:39.748874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-47d6737e-b8f3-4450-b421-bdafad490108 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:39.749143 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8bf9dd3d-88b8-4a38-ad83-8ead82dd9c06 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:39.749689 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-47d6737e-b8f3-4450-b421-bdafad490108 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:39.749816 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8bf9dd3d-88b8-4a38-ad83-8ead82dd9c06 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:39.750056 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-47d6737e-b8f3-4450-b421-bdafad490108 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:39.750548 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-47d6737e-b8f3-4450-b421-bdafad490108 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:39.750921 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-47d6737e-b8f3-4450-b421-bdafad490108 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:39.751333 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-47d6737e-b8f3-4450-b421-bdafad490108 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:39.756329 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8bf9dd3d-88b8-4a38-ad83-8ead82dd9c06 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:39.756814 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8bf9dd3d-88b8-4a38-ad83-8ead82dd9c06 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:39.757242 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8bf9dd3d-88b8-4a38-ad83-8ead82dd9c06 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:39.757937 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8bf9dd3d-88b8-4a38-ad83-8ead82dd9c06 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:39.758409 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8bf9dd3d-88b8-4a38-ad83-8ead82dd9c06 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:39.758827 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8bf9dd3d-88b8-4a38-ad83-8ead82dd9c06 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:39.951049 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-47d6737e-b8f3-4450-b421-bdafad490108 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:39.958707 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-47d6737e-b8f3-4450-b421-bdafad490108 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.221303 Aug 04 23:13:39.967036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 56/116] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:39 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:13:39.969836 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8bf9dd3d-88b8-4a38-ad83-8ead82dd9c06 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:39.977841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8bf9dd3d-88b8-4a38-ad83-8ead82dd9c06 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:39.979896 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8bf9dd3d-88b8-4a38-ad83-8ead82dd9c06 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:39.981004 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8bf9dd3d-88b8-4a38-ad83-8ead82dd9c06 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.236900 Aug 04 23:13:39.981557 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 61/117] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:39 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:13:40.031877 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a553342a-638e-493b-be6e-04411162cad2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:40.032488 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a553342a-638e-493b-be6e-04411162cad2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:40.038525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a553342a-638e-493b-be6e-04411162cad2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:40.039004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a553342a-638e-493b-be6e-04411162cad2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:40.039435 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a553342a-638e-493b-be6e-04411162cad2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:40.040121 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a553342a-638e-493b-be6e-04411162cad2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:40.040767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a553342a-638e-493b-be6e-04411162cad2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:40.041280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a553342a-638e-493b-be6e-04411162cad2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:40.069035 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e94265cb-8fa7-442e-855a-ed76e0b319a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:40.069848 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e94265cb-8fa7-442e-855a-ed76e0b319a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:40.076510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e94265cb-8fa7-442e-855a-ed76e0b319a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:40.077066 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e94265cb-8fa7-442e-855a-ed76e0b319a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:40.077624 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e94265cb-8fa7-442e-855a-ed76e0b319a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:40.078264 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e94265cb-8fa7-442e-855a-ed76e0b319a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:40.078736 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e94265cb-8fa7-442e-855a-ed76e0b319a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:40.079155 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e94265cb-8fa7-442e-855a-ed76e0b319a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:40.223217 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a553342a-638e-493b-be6e-04411162cad2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:40.231297 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a553342a-638e-493b-be6e-04411162cad2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.203173 Aug 04 23:13:40.231866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 57/118] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:40 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:40.251200 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e94265cb-8fa7-442e-855a-ed76e0b319a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:40.259087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e94265cb-8fa7-442e-855a-ed76e0b319a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.193816 Aug 04 23:13:40.259786 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 62/119] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:40 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:13:40.979648 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b4a4aefd-0bc9-468c-ab3c-3fdb2439d008 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:40.980260 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b4a4aefd-0bc9-468c-ab3c-3fdb2439d008 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:40.986259 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b4a4aefd-0bc9-468c-ab3c-3fdb2439d008 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:40.986771 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b4a4aefd-0bc9-468c-ab3c-3fdb2439d008 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:40.987203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b4a4aefd-0bc9-468c-ab3c-3fdb2439d008 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:40.987893 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b4a4aefd-0bc9-468c-ab3c-3fdb2439d008 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:40.988340 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b4a4aefd-0bc9-468c-ab3c-3fdb2439d008 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:40.988759 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b4a4aefd-0bc9-468c-ab3c-3fdb2439d008 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:41.005285 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-577b1931-e82c-42f5-8f58-ab364f4d89e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:41.006689 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-577b1931-e82c-42f5-8f58-ab364f4d89e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:41.020098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-577b1931-e82c-42f5-8f58-ab364f4d89e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:41.020098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-577b1931-e82c-42f5-8f58-ab364f4d89e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:41.020098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-577b1931-e82c-42f5-8f58-ab364f4d89e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:41.020098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-577b1931-e82c-42f5-8f58-ab364f4d89e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:41.020429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-577b1931-e82c-42f5-8f58-ab364f4d89e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:41.020429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-577b1931-e82c-42f5-8f58-ab364f4d89e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:41.193653 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b4a4aefd-0bc9-468c-ab3c-3fdb2439d008 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:41.199088 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-577b1931-e82c-42f5-8f58-ab364f4d89e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:41.202719 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b4a4aefd-0bc9-468c-ab3c-3fdb2439d008 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.226795 Aug 04 23:13:41.203321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 58/120] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:40 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:41.207286 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-577b1931-e82c-42f5-8f58-ab364f4d89e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:41.208765 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-577b1931-e82c-42f5-8f58-ab364f4d89e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:41.210110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-577b1931-e82c-42f5-8f58-ab364f4d89e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.209706 Aug 04 23:13:41.210692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 63/121] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:40 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:13:41.253534 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4dc2ea77-3344-4598-9053-dd7e47a1f438 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:41.254418 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4dc2ea77-3344-4598-9053-dd7e47a1f438 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:41.261608 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dc2ea77-3344-4598-9053-dd7e47a1f438 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:41.262093 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dc2ea77-3344-4598-9053-dd7e47a1f438 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:41.262560 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dc2ea77-3344-4598-9053-dd7e47a1f438 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:41.263281 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dc2ea77-3344-4598-9053-dd7e47a1f438 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:41.263729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dc2ea77-3344-4598-9053-dd7e47a1f438 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:41.264147 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dc2ea77-3344-4598-9053-dd7e47a1f438 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:41.280040 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ff3f3a32-9601-4081-a26c-63c805f8b085 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:41.280655 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ff3f3a32-9601-4081-a26c-63c805f8b085 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:41.286762 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff3f3a32-9601-4081-a26c-63c805f8b085 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:41.287250 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff3f3a32-9601-4081-a26c-63c805f8b085 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:41.287682 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff3f3a32-9601-4081-a26c-63c805f8b085 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:41.288476 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff3f3a32-9601-4081-a26c-63c805f8b085 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:41.288839 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff3f3a32-9601-4081-a26c-63c805f8b085 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:41.289422 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff3f3a32-9601-4081-a26c-63c805f8b085 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:41.463839 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4dc2ea77-3344-4598-9053-dd7e47a1f438 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:41.471624 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4dc2ea77-3344-4598-9053-dd7e47a1f438 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.222408 Aug 04 23:13:41.476644 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ff3f3a32-9601-4081-a26c-63c805f8b085 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:41.480684 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 59/122] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:41 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:41.484608 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ff3f3a32-9601-4081-a26c-63c805f8b085 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.208353 Aug 04 23:13:41.485233 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 64/123] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:41 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:13:41.857426 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-a1ea9222-a04a-4efe-9c9d-f425a7966650 req-e48b8626-bf1b-4405-bf05-7736a89fcad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852287f5-010e-4d74-a6ef-a4bf2f47c477", "name": "network-vif-plugged", "status": "completed", "tag": "f5be5be8-6bc4-4f6a-910d-b8fbf2981502"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:13:41.867369 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-a1ea9222-a04a-4efe-9c9d-f425a7966650 req-e48b8626-bf1b-4405-bf05-7736a89fcad9 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:41.867845 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-a1ea9222-a04a-4efe-9c9d-f425a7966650 req-e48b8626-bf1b-4405-bf05-7736a89fcad9 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:41.868276 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-a1ea9222-a04a-4efe-9c9d-f425a7966650 req-e48b8626-bf1b-4405-bf05-7736a89fcad9 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:41.880582 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-a1ea9222-a04a-4efe-9c9d-f425a7966650 req-e48b8626-bf1b-4405-bf05-7736a89fcad9 service nova] Creating event network-vif-plugged:f5be5be8-6bc4-4f6a-910d-b8fbf2981502 for instance 852287f5-010e-4d74-a6ef-a4bf2f47c477 on hv-cinder-85221 Aug 04 23:13:41.886510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-a1ea9222-a04a-4efe-9c9d-f425a7966650 req-e48b8626-bf1b-4405-bf05-7736a89fcad9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092232 Aug 04 23:13:41.887122 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 60/124] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:13:42.225333 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-bdd53a38-b597-4a41-971c-3d96b0e3b8c5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:42.225936 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-bdd53a38-b597-4a41-971c-3d96b0e3b8c5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:42.232554 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bdd53a38-b597-4a41-971c-3d96b0e3b8c5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:42.233026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bdd53a38-b597-4a41-971c-3d96b0e3b8c5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:42.233448 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bdd53a38-b597-4a41-971c-3d96b0e3b8c5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:42.234122 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-cec3f105-fcce-4192-8e9a-19fa23f8998c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:42.234584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bdd53a38-b597-4a41-971c-3d96b0e3b8c5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:42.234584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bdd53a38-b597-4a41-971c-3d96b0e3b8c5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:42.234857 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-cec3f105-fcce-4192-8e9a-19fa23f8998c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:42.234998 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bdd53a38-b597-4a41-971c-3d96b0e3b8c5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:42.241194 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cec3f105-fcce-4192-8e9a-19fa23f8998c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:42.241695 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cec3f105-fcce-4192-8e9a-19fa23f8998c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:42.242166 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cec3f105-fcce-4192-8e9a-19fa23f8998c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:42.242910 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cec3f105-fcce-4192-8e9a-19fa23f8998c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:42.244019 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cec3f105-fcce-4192-8e9a-19fa23f8998c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:42.244442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cec3f105-fcce-4192-8e9a-19fa23f8998c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:42.440641 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-bdd53a38-b597-4a41-971c-3d96b0e3b8c5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:42.444039 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cec3f105-fcce-4192-8e9a-19fa23f8998c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:42.448448 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-bdd53a38-b597-4a41-971c-3d96b0e3b8c5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.227421 Aug 04 23:13:42.449009 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 65/125] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:42 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:42.452434 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cec3f105-fcce-4192-8e9a-19fa23f8998c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:42.453932 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cec3f105-fcce-4192-8e9a-19fa23f8998c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:42.455078 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-cec3f105-fcce-4192-8e9a-19fa23f8998c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.225283 Aug 04 23:13:42.455616 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 61/126] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:42 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:13:42.492168 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6e3703c1-34c7-40eb-b41c-6bb465b53e83 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:42.492771 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6e3703c1-34c7-40eb-b41c-6bb465b53e83 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:42.499978 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e3703c1-34c7-40eb-b41c-6bb465b53e83 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:42.500553 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e3703c1-34c7-40eb-b41c-6bb465b53e83 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:42.500982 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e3703c1-34c7-40eb-b41c-6bb465b53e83 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:42.501996 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e3703c1-34c7-40eb-b41c-6bb465b53e83 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:42.502128 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e3703c1-34c7-40eb-b41c-6bb465b53e83 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:42.502563 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e3703c1-34c7-40eb-b41c-6bb465b53e83 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:42.505669 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4a21ffcf-a2cf-4f2a-ab2b-2df2d0133cb7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:42.506527 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4a21ffcf-a2cf-4f2a-ab2b-2df2d0133cb7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:42.513488 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4a21ffcf-a2cf-4f2a-ab2b-2df2d0133cb7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:42.513986 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4a21ffcf-a2cf-4f2a-ab2b-2df2d0133cb7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:42.514445 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4a21ffcf-a2cf-4f2a-ab2b-2df2d0133cb7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:42.515162 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4a21ffcf-a2cf-4f2a-ab2b-2df2d0133cb7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:42.515616 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4a21ffcf-a2cf-4f2a-ab2b-2df2d0133cb7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:42.516041 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4a21ffcf-a2cf-4f2a-ab2b-2df2d0133cb7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:42.887265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6e3703c1-34c7-40eb-b41c-6bb465b53e83 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:42.890154 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4a21ffcf-a2cf-4f2a-ab2b-2df2d0133cb7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:42.895840 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6e3703c1-34c7-40eb-b41c-6bb465b53e83 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.407399 Aug 04 23:13:42.896671 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 66/127] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:42 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:42.901444 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4a21ffcf-a2cf-4f2a-ab2b-2df2d0133cb7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.399449 Aug 04 23:13:42.902128 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 62/128] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:42 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:43.472452 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f001dfa3-c8b9-4848-b725-89ecca1abafe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:43.478005 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f001dfa3-c8b9-4848-b725-89ecca1abafe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:43.480886 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=84 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:13:43.481904 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d83fec84-2b1c-420d-9a67-02b6e8c50b0e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:43.482715 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d83fec84-2b1c-420d-9a67-02b6e8c50b0e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:43.492947 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d83fec84-2b1c-420d-9a67-02b6e8c50b0e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:43.495820 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f001dfa3-c8b9-4848-b725-89ecca1abafe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:43.496310 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f001dfa3-c8b9-4848-b725-89ecca1abafe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:43.496739 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f001dfa3-c8b9-4848-b725-89ecca1abafe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:43.497311 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d83fec84-2b1c-420d-9a67-02b6e8c50b0e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:43.497747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d83fec84-2b1c-420d-9a67-02b6e8c50b0e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:43.498566 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d83fec84-2b1c-420d-9a67-02b6e8c50b0e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:43.499026 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d83fec84-2b1c-420d-9a67-02b6e8c50b0e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:43.499442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d83fec84-2b1c-420d-9a67-02b6e8c50b0e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:43.501041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f001dfa3-c8b9-4848-b725-89ecca1abafe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:43.501498 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f001dfa3-c8b9-4848-b725-89ecca1abafe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:43.501916 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f001dfa3-c8b9-4848-b725-89ecca1abafe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:43.717834 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d83fec84-2b1c-420d-9a67-02b6e8c50b0e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:43.721075 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f001dfa3-c8b9-4848-b725-89ecca1abafe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:43.732778 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f001dfa3-c8b9-4848-b725-89ecca1abafe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.265169 Aug 04 23:13:43.748068 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d83fec84-2b1c-420d-9a67-02b6e8c50b0e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:43.748068 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d83fec84-2b1c-420d-9a67-02b6e8c50b0e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:43.748068 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d83fec84-2b1c-420d-9a67-02b6e8c50b0e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.266931 Aug 04 23:13:43.748332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 63/129] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:43 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:13:43.748592 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 67/130] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:43 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:43.921558 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9d78156a-f145-4e13-93dc-7e510597bb5b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:43.922134 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-58ed1b84-e3a5-469d-8451-e2f1864f99e6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:43.922476 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9d78156a-f145-4e13-93dc-7e510597bb5b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:43.922773 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-58ed1b84-e3a5-469d-8451-e2f1864f99e6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:43.929087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-58ed1b84-e3a5-469d-8451-e2f1864f99e6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:43.929570 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-58ed1b84-e3a5-469d-8451-e2f1864f99e6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:43.930188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-58ed1b84-e3a5-469d-8451-e2f1864f99e6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:43.930706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d78156a-f145-4e13-93dc-7e510597bb5b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:43.931990 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d78156a-f145-4e13-93dc-7e510597bb5b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:43.932200 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-58ed1b84-e3a5-469d-8451-e2f1864f99e6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:43.932741 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d78156a-f145-4e13-93dc-7e510597bb5b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:43.933062 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-58ed1b84-e3a5-469d-8451-e2f1864f99e6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:43.933700 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d78156a-f145-4e13-93dc-7e510597bb5b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:43.933933 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-58ed1b84-e3a5-469d-8451-e2f1864f99e6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:43.942247 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d78156a-f145-4e13-93dc-7e510597bb5b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:43.942247 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d78156a-f145-4e13-93dc-7e510597bb5b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:44.172492 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-58ed1b84-e3a5-469d-8451-e2f1864f99e6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:44.172983 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-58ed1b84-e3a5-469d-8451-e2f1864f99e6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.254523 Aug 04 23:13:44.174075 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 68/131] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:43 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:44.179653 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9d78156a-f145-4e13-93dc-7e510597bb5b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:44.187844 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9d78156a-f145-4e13-93dc-7e510597bb5b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.274438 Aug 04 23:13:44.188567 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 64/132] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:43 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:44.759015 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c1c74127-a527-425e-b052-3b03e114e415 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:44.760083 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c1c74127-a527-425e-b052-3b03e114e415 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:44.765031 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1bd8474f-198a-460e-96f3-33292284d1ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:44.765821 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1bd8474f-198a-460e-96f3-33292284d1ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:44.767728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c1c74127-a527-425e-b052-3b03e114e415 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:44.768400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c1c74127-a527-425e-b052-3b03e114e415 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:44.768832 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c1c74127-a527-425e-b052-3b03e114e415 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:44.769526 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c1c74127-a527-425e-b052-3b03e114e415 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:44.769966 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c1c74127-a527-425e-b052-3b03e114e415 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:44.770633 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c1c74127-a527-425e-b052-3b03e114e415 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:44.774870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1bd8474f-198a-460e-96f3-33292284d1ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:44.775449 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1bd8474f-198a-460e-96f3-33292284d1ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:44.776038 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1bd8474f-198a-460e-96f3-33292284d1ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:44.776837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1bd8474f-198a-460e-96f3-33292284d1ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:44.777499 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1bd8474f-198a-460e-96f3-33292284d1ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:44.777967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1bd8474f-198a-460e-96f3-33292284d1ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:45.004855 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1bd8474f-198a-460e-96f3-33292284d1ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:45.009179 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c1c74127-a527-425e-b052-3b03e114e415 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:45.014041 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1bd8474f-198a-460e-96f3-33292284d1ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:45.015673 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1bd8474f-198a-460e-96f3-33292284d1ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:45.016905 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1bd8474f-198a-460e-96f3-33292284d1ba tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.256414 Aug 04 23:13:45.017516 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c1c74127-a527-425e-b052-3b03e114e415 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.264000 Aug 04 23:13:45.017660 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 65/133] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:44 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:13:45.018062 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 69/134] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:44 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:45.196424 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c6724e93-dbf1-4c44-a1d5-acda1636c12e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:45.197698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c6724e93-dbf1-4c44-a1d5-acda1636c12e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:45.203850 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c6724e93-dbf1-4c44-a1d5-acda1636c12e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:45.204333 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c6724e93-dbf1-4c44-a1d5-acda1636c12e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:45.204766 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c6724e93-dbf1-4c44-a1d5-acda1636c12e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:45.205454 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c6724e93-dbf1-4c44-a1d5-acda1636c12e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:45.205901 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c6724e93-dbf1-4c44-a1d5-acda1636c12e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:45.206350 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c6724e93-dbf1-4c44-a1d5-acda1636c12e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:45.209317 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:13:45.211415 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c1eb8aae-cc13-4f90-b3f3-d64d5d62539b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:45.212153 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c1eb8aae-cc13-4f90-b3f3-d64d5d62539b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:45.227461 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c1eb8aae-cc13-4f90-b3f3-d64d5d62539b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:45.227461 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c1eb8aae-cc13-4f90-b3f3-d64d5d62539b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:45.227461 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c1eb8aae-cc13-4f90-b3f3-d64d5d62539b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:45.227461 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c1eb8aae-cc13-4f90-b3f3-d64d5d62539b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:45.227749 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c1eb8aae-cc13-4f90-b3f3-d64d5d62539b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:45.227749 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c1eb8aae-cc13-4f90-b3f3-d64d5d62539b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:45.409956 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c6724e93-dbf1-4c44-a1d5-acda1636c12e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:45.418263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c1eb8aae-cc13-4f90-b3f3-d64d5d62539b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:45.418573 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c6724e93-dbf1-4c44-a1d5-acda1636c12e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.225835 Aug 04 23:13:45.419147 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 66/135] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:45 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:45.427075 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c1eb8aae-cc13-4f90-b3f3-d64d5d62539b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.220503 Aug 04 23:13:45.427648 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 70/136] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:45 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:13:46.038155 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-538d1707-f467-483b-9b9d-60c054a1c999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:46.038691 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5db04a4a-d47d-4407-acf4-f7473def2d96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:46.039061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5db04a4a-d47d-4407-acf4-f7473def2d96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:46.039156 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-538d1707-f467-483b-9b9d-60c054a1c999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:46.045655 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-538d1707-f467-483b-9b9d-60c054a1c999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:46.045833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5db04a4a-d47d-4407-acf4-f7473def2d96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:46.046129 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5db04a4a-d47d-4407-acf4-f7473def2d96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:46.046238 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-538d1707-f467-483b-9b9d-60c054a1c999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:46.046589 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-538d1707-f467-483b-9b9d-60c054a1c999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:46.046703 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5db04a4a-d47d-4407-acf4-f7473def2d96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:46.047278 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-538d1707-f467-483b-9b9d-60c054a1c999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:46.047370 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5db04a4a-d47d-4407-acf4-f7473def2d96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:46.047722 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-538d1707-f467-483b-9b9d-60c054a1c999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:46.047812 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5db04a4a-d47d-4407-acf4-f7473def2d96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:46.048140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-538d1707-f467-483b-9b9d-60c054a1c999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:46.048242 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5db04a4a-d47d-4407-acf4-f7473def2d96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:46.247109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-538d1707-f467-483b-9b9d-60c054a1c999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:46.249739 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5db04a4a-d47d-4407-acf4-f7473def2d96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:46.254645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-538d1707-f467-483b-9b9d-60c054a1c999 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.220229 Aug 04 23:13:46.258045 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5db04a4a-d47d-4407-acf4-f7473def2d96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:46.260448 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5db04a4a-d47d-4407-acf4-f7473def2d96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:46.261606 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5db04a4a-d47d-4407-acf4-f7473def2d96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.227266 Aug 04 23:13:46.262331 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 71/137] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:46 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:13:46.266806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 67/138] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:46 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:46.440757 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b7b3b724-ef9d-477a-9836-412e08b46298 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:46.441367 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b7b3b724-ef9d-477a-9836-412e08b46298 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:46.448741 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-bba4eb35-fae4-486c-bf03-dce28f4f9688 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:46.448928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b7b3b724-ef9d-477a-9836-412e08b46298 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:46.449270 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b7b3b724-ef9d-477a-9836-412e08b46298 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:46.449373 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-bba4eb35-fae4-486c-bf03-dce28f4f9688 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:46.449702 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b7b3b724-ef9d-477a-9836-412e08b46298 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:46.450414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b7b3b724-ef9d-477a-9836-412e08b46298 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:46.450879 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b7b3b724-ef9d-477a-9836-412e08b46298 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:46.451300 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b7b3b724-ef9d-477a-9836-412e08b46298 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:46.455328 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bba4eb35-fae4-486c-bf03-dce28f4f9688 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:46.455810 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bba4eb35-fae4-486c-bf03-dce28f4f9688 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:46.456242 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bba4eb35-fae4-486c-bf03-dce28f4f9688 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:46.456932 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bba4eb35-fae4-486c-bf03-dce28f4f9688 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:46.457381 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bba4eb35-fae4-486c-bf03-dce28f4f9688 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:46.457798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bba4eb35-fae4-486c-bf03-dce28f4f9688 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:46.642178 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b7b3b724-ef9d-477a-9836-412e08b46298 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:46.646250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-bba4eb35-fae4-486c-bf03-dce28f4f9688 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:46.649830 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b7b3b724-ef9d-477a-9836-412e08b46298 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.212888 Aug 04 23:13:46.650549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 72/139] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:46 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:46.654627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-bba4eb35-fae4-486c-bf03-dce28f4f9688 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.210361 Aug 04 23:13:46.655188 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 68/140] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:46 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:13:47.277240 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8a86cec6-16b8-436b-95d1-9e2fd42553fa tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:47.277948 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8a86cec6-16b8-436b-95d1-9e2fd42553fa tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:47.283137 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-65466256-f7bd-44fd-a682-f7fd53793c6f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:47.283734 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-65466256-f7bd-44fd-a682-f7fd53793c6f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:47.284070 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a86cec6-16b8-436b-95d1-9e2fd42553fa tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:47.284551 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a86cec6-16b8-436b-95d1-9e2fd42553fa tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:47.284981 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a86cec6-16b8-436b-95d1-9e2fd42553fa tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:47.285703 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a86cec6-16b8-436b-95d1-9e2fd42553fa tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:47.286156 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a86cec6-16b8-436b-95d1-9e2fd42553fa tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:47.286604 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a86cec6-16b8-436b-95d1-9e2fd42553fa tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:47.292353 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-65466256-f7bd-44fd-a682-f7fd53793c6f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:47.292353 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-65466256-f7bd-44fd-a682-f7fd53793c6f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:47.292353 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-65466256-f7bd-44fd-a682-f7fd53793c6f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:47.293286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-65466256-f7bd-44fd-a682-f7fd53793c6f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:47.294261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-65466256-f7bd-44fd-a682-f7fd53793c6f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:47.295102 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-65466256-f7bd-44fd-a682-f7fd53793c6f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:47.488499 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8a86cec6-16b8-436b-95d1-9e2fd42553fa tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:47.492932 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-65466256-f7bd-44fd-a682-f7fd53793c6f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:47.496558 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8a86cec6-16b8-436b-95d1-9e2fd42553fa tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.223846 Aug 04 23:13:47.497139 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 73/141] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:47 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:47.501520 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-65466256-f7bd-44fd-a682-f7fd53793c6f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:47.503050 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-65466256-f7bd-44fd-a682-f7fd53793c6f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:47.504138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-65466256-f7bd-44fd-a682-f7fd53793c6f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.224745 Aug 04 23:13:47.504858 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 69/142] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:47 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:13:47.670867 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a9ac90b3-0960-4db7-93af-d7b366163212 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:47.671475 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a9ac90b3-0960-4db7-93af-d7b366163212 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:47.675086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c647ae34-b4ce-4938-9c22-f8b578de7b05 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:47.675700 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c647ae34-b4ce-4938-9c22-f8b578de7b05 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:47.677980 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9ac90b3-0960-4db7-93af-d7b366163212 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:47.678481 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9ac90b3-0960-4db7-93af-d7b366163212 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:47.678901 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9ac90b3-0960-4db7-93af-d7b366163212 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:47.679582 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9ac90b3-0960-4db7-93af-d7b366163212 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:47.680023 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9ac90b3-0960-4db7-93af-d7b366163212 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:47.680506 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9ac90b3-0960-4db7-93af-d7b366163212 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:47.682271 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c647ae34-b4ce-4938-9c22-f8b578de7b05 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:47.682852 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c647ae34-b4ce-4938-9c22-f8b578de7b05 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:47.683282 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c647ae34-b4ce-4938-9c22-f8b578de7b05 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:47.684384 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c647ae34-b4ce-4938-9c22-f8b578de7b05 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:47.684835 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c647ae34-b4ce-4938-9c22-f8b578de7b05 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:47.685254 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c647ae34-b4ce-4938-9c22-f8b578de7b05 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:47.889350 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a9ac90b3-0960-4db7-93af-d7b366163212 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:47.894601 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c647ae34-b4ce-4938-9c22-f8b578de7b05 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:47.897135 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a9ac90b3-0960-4db7-93af-d7b366163212 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.231174 Aug 04 23:13:47.897877 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 74/143] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:47 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:47.902864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c647ae34-b4ce-4938-9c22-f8b578de7b05 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.231452 Aug 04 23:13:47.903694 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 70/144] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:47 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:13:48.518061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-54df2976-ab9c-44d5-849c-dc3d29c71ef5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:48.518699 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-54df2976-ab9c-44d5-849c-dc3d29c71ef5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:48.524875 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54df2976-ab9c-44d5-849c-dc3d29c71ef5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:48.525010 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-cec634f6-d886-4d69-92eb-785bec760967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:48.525467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54df2976-ab9c-44d5-849c-dc3d29c71ef5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:48.525575 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-cec634f6-d886-4d69-92eb-785bec760967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:48.525731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54df2976-ab9c-44d5-849c-dc3d29c71ef5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:48.526472 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54df2976-ab9c-44d5-849c-dc3d29c71ef5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:48.526911 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54df2976-ab9c-44d5-849c-dc3d29c71ef5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:48.527334 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54df2976-ab9c-44d5-849c-dc3d29c71ef5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:48.531441 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:13:48.531942 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cec634f6-d886-4d69-92eb-785bec760967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:48.532564 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cec634f6-d886-4d69-92eb-785bec760967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:48.533060 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cec634f6-d886-4d69-92eb-785bec760967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:48.533804 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cec634f6-d886-4d69-92eb-785bec760967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:48.534247 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cec634f6-d886-4d69-92eb-785bec760967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:48.534696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cec634f6-d886-4d69-92eb-785bec760967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:48.734812 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-54df2976-ab9c-44d5-849c-dc3d29c71ef5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:48.739169 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cec634f6-d886-4d69-92eb-785bec760967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:48.742502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-54df2976-ab9c-44d5-849c-dc3d29c71ef5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.228250 Aug 04 23:13:48.743077 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 75/145] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:48 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:48.748101 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cec634f6-d886-4d69-92eb-785bec760967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:48.749796 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cec634f6-d886-4d69-92eb-785bec760967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:48.750949 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-cec634f6-d886-4d69-92eb-785bec760967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.229768 Aug 04 23:13:48.751492 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 71/146] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:48 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:13:48.911912 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-1d8ef9da-f50f-447c-891f-a9abb5fdca4b req-0ed02c35-11d8-4bad-ac17-be2f6b8e5fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b9e29c3-d35b-4e35-90fb-6184265d0ecf", "name": "network-vif-plugged", "status": "completed", "tag": "a99ad26c-475b-45a9-a064-2c729edd77f1"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:13:48.924183 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-40c6278e-bbf6-499c-8602-e50c1223c0c2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:48.924327 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-1d8ef9da-f50f-447c-891f-a9abb5fdca4b req-0ed02c35-11d8-4bad-ac17-be2f6b8e5fe3 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:48.924798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-40c6278e-bbf6-499c-8602-e50c1223c0c2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:48.924931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-1d8ef9da-f50f-447c-891f-a9abb5fdca4b req-0ed02c35-11d8-4bad-ac17-be2f6b8e5fe3 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:48.925371 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-1d8ef9da-f50f-447c-891f-a9abb5fdca4b req-0ed02c35-11d8-4bad-ac17-be2f6b8e5fe3 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:48.931008 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-40c6278e-bbf6-499c-8602-e50c1223c0c2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:48.931580 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-40c6278e-bbf6-499c-8602-e50c1223c0c2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:48.932094 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-40c6278e-bbf6-499c-8602-e50c1223c0c2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:48.932969 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-40c6278e-bbf6-499c-8602-e50c1223c0c2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:48.933422 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-40c6278e-bbf6-499c-8602-e50c1223c0c2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:48.933840 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-40c6278e-bbf6-499c-8602-e50c1223c0c2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:48.939350 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-1d8ef9da-f50f-447c-891f-a9abb5fdca4b req-0ed02c35-11d8-4bad-ac17-be2f6b8e5fe3 service nova] Creating event network-vif-plugged:a99ad26c-475b-45a9-a064-2c729edd77f1 for instance 9b9e29c3-d35b-4e35-90fb-6184265d0ecf on hv-cinder-85221 Aug 04 23:13:48.944544 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-1d8ef9da-f50f-447c-891f-a9abb5fdca4b req-0ed02c35-11d8-4bad-ac17-be2f6b8e5fe3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036214 Aug 04 23:13:48.945215 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 76/147] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:13:48.950613 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6b457a45-f80e-4f40-9528-95173e907c0e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:48.951329 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6b457a45-f80e-4f40-9528-95173e907c0e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:48.957753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b457a45-f80e-4f40-9528-95173e907c0e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:48.958235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b457a45-f80e-4f40-9528-95173e907c0e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:48.958685 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b457a45-f80e-4f40-9528-95173e907c0e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:48.959366 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b457a45-f80e-4f40-9528-95173e907c0e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:48.960069 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b457a45-f80e-4f40-9528-95173e907c0e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:48.960590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b457a45-f80e-4f40-9528-95173e907c0e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:49.154920 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-40c6278e-bbf6-499c-8602-e50c1223c0c2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:49.161611 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6b457a45-f80e-4f40-9528-95173e907c0e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:49.164510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-40c6278e-bbf6-499c-8602-e50c1223c0c2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.244552 Aug 04 23:13:49.165861 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 72/148] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:48 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:13:49.171066 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6b457a45-f80e-4f40-9528-95173e907c0e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.224468 Aug 04 23:13:49.172007 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 77/149] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:48 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:49.768912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d17cbe2c-d49d-4c6a-bdf7-0d67a4339e34 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:49.769532 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d17cbe2c-d49d-4c6a-bdf7-0d67a4339e34 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:49.776884 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e0fe90ec-1f9f-4998-ba1f-cedf69383c5a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:49.778815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e0fe90ec-1f9f-4998-ba1f-cedf69383c5a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:49.781216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d17cbe2c-d49d-4c6a-bdf7-0d67a4339e34 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:49.781888 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d17cbe2c-d49d-4c6a-bdf7-0d67a4339e34 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:49.782631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d17cbe2c-d49d-4c6a-bdf7-0d67a4339e34 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:49.783493 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d17cbe2c-d49d-4c6a-bdf7-0d67a4339e34 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:49.784136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d17cbe2c-d49d-4c6a-bdf7-0d67a4339e34 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:49.784839 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d17cbe2c-d49d-4c6a-bdf7-0d67a4339e34 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:49.793961 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e0fe90ec-1f9f-4998-ba1f-cedf69383c5a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:49.799021 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e0fe90ec-1f9f-4998-ba1f-cedf69383c5a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:49.800774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e0fe90ec-1f9f-4998-ba1f-cedf69383c5a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:49.801595 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e0fe90ec-1f9f-4998-ba1f-cedf69383c5a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:49.802004 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e0fe90ec-1f9f-4998-ba1f-cedf69383c5a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:49.807140 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e0fe90ec-1f9f-4998-ba1f-cedf69383c5a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:50.092456 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d17cbe2c-d49d-4c6a-bdf7-0d67a4339e34 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:50.098385 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e0fe90ec-1f9f-4998-ba1f-cedf69383c5a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:50.099966 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d17cbe2c-d49d-4c6a-bdf7-0d67a4339e34 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.335170 Aug 04 23:13:50.100740 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 73/150] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:49 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:50.108987 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e0fe90ec-1f9f-4998-ba1f-cedf69383c5a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:50.110716 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e0fe90ec-1f9f-4998-ba1f-cedf69383c5a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:50.111931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e0fe90ec-1f9f-4998-ba1f-cedf69383c5a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.342445 Aug 04 23:13:50.112515 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 78/151] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:49 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:13:50.192142 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4826e6f7-071a-45db-8807-f7274fdb6e09 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:50.192779 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4826e6f7-071a-45db-8807-f7274fdb6e09 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:50.198983 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d7122692-2b1b-44a0-95b1-c2fae4776597 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:50.199146 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4826e6f7-071a-45db-8807-f7274fdb6e09 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:50.199705 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4826e6f7-071a-45db-8807-f7274fdb6e09 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:50.200040 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d7122692-2b1b-44a0-95b1-c2fae4776597 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:50.200204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4826e6f7-071a-45db-8807-f7274fdb6e09 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:50.201121 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4826e6f7-071a-45db-8807-f7274fdb6e09 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:50.201635 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4826e6f7-071a-45db-8807-f7274fdb6e09 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:50.202126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4826e6f7-071a-45db-8807-f7274fdb6e09 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:50.205981 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d7122692-2b1b-44a0-95b1-c2fae4776597 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:50.206504 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d7122692-2b1b-44a0-95b1-c2fae4776597 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:50.206933 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d7122692-2b1b-44a0-95b1-c2fae4776597 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:50.207898 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d7122692-2b1b-44a0-95b1-c2fae4776597 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:50.208573 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d7122692-2b1b-44a0-95b1-c2fae4776597 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:50.209060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d7122692-2b1b-44a0-95b1-c2fae4776597 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:50.414343 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d7122692-2b1b-44a0-95b1-c2fae4776597 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:50.419695 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4826e6f7-071a-45db-8807-f7274fdb6e09 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:50.425289 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d7122692-2b1b-44a0-95b1-c2fae4776597 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.230026 Aug 04 23:13:50.426215 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 79/152] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:50 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:13:50.428082 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4826e6f7-071a-45db-8807-f7274fdb6e09 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.239620 Aug 04 23:13:50.428847 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 74/153] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:50 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:51.123293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3e51b632-a9a3-4260-9ded-642984f54cba tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:51.123723 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3e51b632-a9a3-4260-9ded-642984f54cba tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:51.131428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e51b632-a9a3-4260-9ded-642984f54cba tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:51.132290 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e51b632-a9a3-4260-9ded-642984f54cba tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:51.132412 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e51b632-a9a3-4260-9ded-642984f54cba tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:51.133005 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e51b632-a9a3-4260-9ded-642984f54cba tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:51.133449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e51b632-a9a3-4260-9ded-642984f54cba tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:51.133874 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e51b632-a9a3-4260-9ded-642984f54cba tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:51.135762 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-24030683-7d94-4352-bfc7-20424447ef55 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:51.136375 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-24030683-7d94-4352-bfc7-20424447ef55 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:51.147690 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24030683-7d94-4352-bfc7-20424447ef55 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:51.148175 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24030683-7d94-4352-bfc7-20424447ef55 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:51.148606 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24030683-7d94-4352-bfc7-20424447ef55 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:51.149307 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24030683-7d94-4352-bfc7-20424447ef55 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:51.150773 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24030683-7d94-4352-bfc7-20424447ef55 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:51.150773 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24030683-7d94-4352-bfc7-20424447ef55 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:51.343808 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3e51b632-a9a3-4260-9ded-642984f54cba tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:51.347299 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-24030683-7d94-4352-bfc7-20424447ef55 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:51.352422 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3e51b632-a9a3-4260-9ded-642984f54cba tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.234624 Aug 04 23:13:51.353110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 80/154] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:51 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:51.358600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-24030683-7d94-4352-bfc7-20424447ef55 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:51.360667 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-24030683-7d94-4352-bfc7-20424447ef55 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:51.361995 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-24030683-7d94-4352-bfc7-20424447ef55 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.230900 Aug 04 23:13:51.363240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 75/155] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:51 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:13:51.445598 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1a819baf-549d-4733-b8ab-12211fc3d940 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:51.446214 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1a819baf-549d-4733-b8ab-12211fc3d940 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:51.448645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ab43ad78-590b-4cba-9161-3c880c3e5caf tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:51.449256 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ab43ad78-590b-4cba-9161-3c880c3e5caf tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:51.453445 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1a819baf-549d-4733-b8ab-12211fc3d940 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:51.453932 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1a819baf-549d-4733-b8ab-12211fc3d940 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:51.454381 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1a819baf-549d-4733-b8ab-12211fc3d940 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:51.455071 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1a819baf-549d-4733-b8ab-12211fc3d940 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:51.455247 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ab43ad78-590b-4cba-9161-3c880c3e5caf tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:51.455517 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1a819baf-549d-4733-b8ab-12211fc3d940 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:51.455730 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ab43ad78-590b-4cba-9161-3c880c3e5caf tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:51.455931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1a819baf-549d-4733-b8ab-12211fc3d940 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:51.456165 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ab43ad78-590b-4cba-9161-3c880c3e5caf tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:51.456855 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ab43ad78-590b-4cba-9161-3c880c3e5caf tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:51.457313 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ab43ad78-590b-4cba-9161-3c880c3e5caf tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:51.457736 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ab43ad78-590b-4cba-9161-3c880c3e5caf tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:51.657556 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1a819baf-549d-4733-b8ab-12211fc3d940 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:51.661348 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ab43ad78-590b-4cba-9161-3c880c3e5caf tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:51.665454 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1a819baf-549d-4733-b8ab-12211fc3d940 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.223821 Aug 04 23:13:51.666623 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 81/156] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:51 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:51.669805 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ab43ad78-590b-4cba-9161-3c880c3e5caf tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.225438 Aug 04 23:13:51.670398 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 76/157] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:51 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:13:52.373702 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-da285c58-3e94-4e25-86c4-11c20f78a63d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:52.374303 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-da285c58-3e94-4e25-86c4-11c20f78a63d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:52.380431 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-da285c58-3e94-4e25-86c4-11c20f78a63d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:52.380909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-da285c58-3e94-4e25-86c4-11c20f78a63d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:52.381331 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-da285c58-3e94-4e25-86c4-11c20f78a63d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:52.382014 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-da285c58-3e94-4e25-86c4-11c20f78a63d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:52.382495 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-da285c58-3e94-4e25-86c4-11c20f78a63d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:52.382907 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-da285c58-3e94-4e25-86c4-11c20f78a63d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:52.384870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-92316c74-604d-4058-b574-1849cc207ba0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:52.385483 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-92316c74-604d-4058-b574-1849cc207ba0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:52.391927 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-92316c74-604d-4058-b574-1849cc207ba0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:52.392407 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-92316c74-604d-4058-b574-1849cc207ba0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:52.392840 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-92316c74-604d-4058-b574-1849cc207ba0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:52.393540 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-92316c74-604d-4058-b574-1849cc207ba0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:52.394061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-92316c74-604d-4058-b574-1849cc207ba0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:52.394546 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-92316c74-604d-4058-b574-1849cc207ba0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:52.581645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-da285c58-3e94-4e25-86c4-11c20f78a63d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:52.586051 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-92316c74-604d-4058-b574-1849cc207ba0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:52.589953 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-da285c58-3e94-4e25-86c4-11c20f78a63d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.220631 Aug 04 23:13:52.590546 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 82/158] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:52 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:52.595161 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-92316c74-604d-4058-b574-1849cc207ba0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:52.596760 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-92316c74-604d-4058-b574-1849cc207ba0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:52.597927 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-92316c74-604d-4058-b574-1849cc207ba0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.217070 Aug 04 23:13:52.598619 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 77/159] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:52 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:13:52.687553 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9056e461-c73e-47b6-a938-605dd3d341ab tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:52.688271 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9056e461-c73e-47b6-a938-605dd3d341ab tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:52.691025 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-efd23e99-c90a-4836-871f-97a84606e377 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:52.691645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-efd23e99-c90a-4836-871f-97a84606e377 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:52.694513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9056e461-c73e-47b6-a938-605dd3d341ab tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:52.694997 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9056e461-c73e-47b6-a938-605dd3d341ab tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:52.695423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9056e461-c73e-47b6-a938-605dd3d341ab tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:52.696120 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9056e461-c73e-47b6-a938-605dd3d341ab tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:52.696565 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9056e461-c73e-47b6-a938-605dd3d341ab tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:52.696986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9056e461-c73e-47b6-a938-605dd3d341ab tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:52.698185 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-efd23e99-c90a-4836-871f-97a84606e377 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:52.698705 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-efd23e99-c90a-4836-871f-97a84606e377 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:52.699130 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-efd23e99-c90a-4836-871f-97a84606e377 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:52.699827 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-efd23e99-c90a-4836-871f-97a84606e377 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:52.700288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-efd23e99-c90a-4836-871f-97a84606e377 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:52.700706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-efd23e99-c90a-4836-871f-97a84606e377 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:52.904087 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-efd23e99-c90a-4836-871f-97a84606e377 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:52.907982 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9056e461-c73e-47b6-a938-605dd3d341ab tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:52.911683 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-efd23e99-c90a-4836-871f-97a84606e377 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.224409 Aug 04 23:13:52.912253 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 78/160] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:52 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:13:52.916739 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9056e461-c73e-47b6-a938-605dd3d341ab tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.233153 Aug 04 23:13:52.928302 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 83/161] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:52 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:53.612694 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-02ef581b-adc9-4e11-9581-391ff960ce7d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:53.613498 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-02ef581b-adc9-4e11-9581-391ff960ce7d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:53.623912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02ef581b-adc9-4e11-9581-391ff960ce7d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:53.624798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02ef581b-adc9-4e11-9581-391ff960ce7d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:53.625498 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02ef581b-adc9-4e11-9581-391ff960ce7d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:53.625740 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f3e8c93e-f38b-466f-a038-a484528a2205 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:53.626514 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f3e8c93e-f38b-466f-a038-a484528a2205 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:53.627333 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02ef581b-adc9-4e11-9581-391ff960ce7d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:53.628164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02ef581b-adc9-4e11-9581-391ff960ce7d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:53.628843 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02ef581b-adc9-4e11-9581-391ff960ce7d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:53.634671 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f3e8c93e-f38b-466f-a038-a484528a2205 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:53.635155 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f3e8c93e-f38b-466f-a038-a484528a2205 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:53.635595 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f3e8c93e-f38b-466f-a038-a484528a2205 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:53.636337 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f3e8c93e-f38b-466f-a038-a484528a2205 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:53.636961 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f3e8c93e-f38b-466f-a038-a484528a2205 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:53.637963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f3e8c93e-f38b-466f-a038-a484528a2205 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:54.119609 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-02ef581b-adc9-4e11-9581-391ff960ce7d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:54.128680 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-02ef581b-adc9-4e11-9581-391ff960ce7d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.520749 Aug 04 23:13:54.129304 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 79/162] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:53 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:54.133933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8519259a-0138-4b32-819e-506ca9add131 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:54.134560 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8519259a-0138-4b32-819e-506ca9add131 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:54.138963 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=98 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:13:54.151341 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8519259a-0138-4b32-819e-506ca9add131 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:54.151663 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8519259a-0138-4b32-819e-506ca9add131 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:54.152091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8519259a-0138-4b32-819e-506ca9add131 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:54.152790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8519259a-0138-4b32-819e-506ca9add131 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:54.153236 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8519259a-0138-4b32-819e-506ca9add131 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:54.153922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8519259a-0138-4b32-819e-506ca9add131 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:54.154032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f3e8c93e-f38b-466f-a038-a484528a2205 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:54.162632 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f3e8c93e-f38b-466f-a038-a484528a2205 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:54.164294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f3e8c93e-f38b-466f-a038-a484528a2205 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:54.165423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f3e8c93e-f38b-466f-a038-a484528a2205 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.548502 Aug 04 23:13:54.166097 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 84/163] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:53 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:13:54.171230 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-fc862b0d-edcc-4c9a-951e-35650e8dd01e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:54.172070 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-fc862b0d-edcc-4c9a-951e-35650e8dd01e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:54.178572 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fc862b0d-edcc-4c9a-951e-35650e8dd01e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:54.179276 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fc862b0d-edcc-4c9a-951e-35650e8dd01e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:54.179879 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fc862b0d-edcc-4c9a-951e-35650e8dd01e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:54.180585 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fc862b0d-edcc-4c9a-951e-35650e8dd01e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:54.181037 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fc862b0d-edcc-4c9a-951e-35650e8dd01e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:54.181458 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fc862b0d-edcc-4c9a-951e-35650e8dd01e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:54.360923 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8519259a-0138-4b32-819e-506ca9add131 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:54.368609 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-fc862b0d-edcc-4c9a-951e-35650e8dd01e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:54.368924 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8519259a-0138-4b32-819e-506ca9add131 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.238330 Aug 04 23:13:54.370151 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 80/164] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:54 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:54.377464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-fc862b0d-edcc-4c9a-951e-35650e8dd01e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.209865 Aug 04 23:13:54.378023 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 85/165] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:54 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:55.153383 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-301bdafd-951b-4e0c-ba59-5f56b1a2e609 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:55.153914 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-301bdafd-951b-4e0c-ba59-5f56b1a2e609 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:55.159973 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-301bdafd-951b-4e0c-ba59-5f56b1a2e609 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:55.160453 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-301bdafd-951b-4e0c-ba59-5f56b1a2e609 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:55.160879 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-301bdafd-951b-4e0c-ba59-5f56b1a2e609 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:55.161561 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-301bdafd-951b-4e0c-ba59-5f56b1a2e609 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:55.162002 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-301bdafd-951b-4e0c-ba59-5f56b1a2e609 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:55.162443 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-301bdafd-951b-4e0c-ba59-5f56b1a2e609 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:55.188842 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ffc6ef12-0e97-4cd3-802c-a68d8d8ca9cb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:55.189573 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ffc6ef12-0e97-4cd3-802c-a68d8d8ca9cb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:55.195613 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ffc6ef12-0e97-4cd3-802c-a68d8d8ca9cb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:55.196167 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ffc6ef12-0e97-4cd3-802c-a68d8d8ca9cb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:55.196668 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ffc6ef12-0e97-4cd3-802c-a68d8d8ca9cb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:55.197721 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ffc6ef12-0e97-4cd3-802c-a68d8d8ca9cb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:55.198254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ffc6ef12-0e97-4cd3-802c-a68d8d8ca9cb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:55.198768 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ffc6ef12-0e97-4cd3-802c-a68d8d8ca9cb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:55.376947 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-301bdafd-951b-4e0c-ba59-5f56b1a2e609 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:55.390015 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-301bdafd-951b-4e0c-ba59-5f56b1a2e609 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.240602 Aug 04 23:13:55.390721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 81/166] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:55 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:55.397425 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-735522d4-fcd8-4c04-a185-e03a5e830a5d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:55.397961 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ffc6ef12-0e97-4cd3-802c-a68d8d8ca9cb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:55.398881 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-735522d4-fcd8-4c04-a185-e03a5e830a5d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:55.416618 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ffc6ef12-0e97-4cd3-802c-a68d8d8ca9cb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:55.419130 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-735522d4-fcd8-4c04-a185-e03a5e830a5d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:55.419987 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ffc6ef12-0e97-4cd3-802c-a68d8d8ca9cb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:55.420358 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-735522d4-fcd8-4c04-a185-e03a5e830a5d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:55.421375 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-735522d4-fcd8-4c04-a185-e03a5e830a5d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:55.422527 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ffc6ef12-0e97-4cd3-802c-a68d8d8ca9cb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.237158 Aug 04 23:13:55.434999 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 86/167] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:55 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:13:55.434999 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3ab64fb8-92be-4c3e-94c8-1c4fab9275a1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:55.434999 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3ab64fb8-92be-4c3e-94c8-1c4fab9275a1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:55.435630 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-735522d4-fcd8-4c04-a185-e03a5e830a5d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:55.437090 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-735522d4-fcd8-4c04-a185-e03a5e830a5d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:55.437752 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-735522d4-fcd8-4c04-a185-e03a5e830a5d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:55.437860 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3ab64fb8-92be-4c3e-94c8-1c4fab9275a1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:55.438719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3ab64fb8-92be-4c3e-94c8-1c4fab9275a1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:55.439378 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3ab64fb8-92be-4c3e-94c8-1c4fab9275a1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:55.440218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3ab64fb8-92be-4c3e-94c8-1c4fab9275a1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:55.440699 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3ab64fb8-92be-4c3e-94c8-1c4fab9275a1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:55.441471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3ab64fb8-92be-4c3e-94c8-1c4fab9275a1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:55.656605 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-735522d4-fcd8-4c04-a185-e03a5e830a5d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:55.658772 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:13:55.661098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3ab64fb8-92be-4c3e-94c8-1c4fab9275a1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:55.665493 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-735522d4-fcd8-4c04-a185-e03a5e830a5d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.273342 Aug 04 23:13:55.666131 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 82/168] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:55 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:55.671764 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3ab64fb8-92be-4c3e-94c8-1c4fab9275a1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.246962 Aug 04 23:13:55.672439 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 87/169] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:55 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:56.411006 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-84fc4ba3-0b1c-4893-891c-4f9342a184a2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:56.411806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-84fc4ba3-0b1c-4893-891c-4f9342a184a2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:56.418511 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-84fc4ba3-0b1c-4893-891c-4f9342a184a2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:56.419515 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-84fc4ba3-0b1c-4893-891c-4f9342a184a2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:56.420008 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-84fc4ba3-0b1c-4893-891c-4f9342a184a2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:56.421029 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-84fc4ba3-0b1c-4893-891c-4f9342a184a2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:56.421454 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-84fc4ba3-0b1c-4893-891c-4f9342a184a2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:56.421870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-84fc4ba3-0b1c-4893-891c-4f9342a184a2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:56.460913 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-bb5d118e-be8e-4580-8707-134469494bed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:56.461526 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-bb5d118e-be8e-4580-8707-134469494bed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:56.470834 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb5d118e-be8e-4580-8707-134469494bed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:56.471545 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb5d118e-be8e-4580-8707-134469494bed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:56.472134 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb5d118e-be8e-4580-8707-134469494bed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:56.473130 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb5d118e-be8e-4580-8707-134469494bed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:56.473779 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb5d118e-be8e-4580-8707-134469494bed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:56.474550 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb5d118e-be8e-4580-8707-134469494bed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:56.612203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-84fc4ba3-0b1c-4893-891c-4f9342a184a2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:56.619729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-84fc4ba3-0b1c-4893-891c-4f9342a184a2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.212725 Aug 04 23:13:56.620493 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 83/170] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:56 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:56.642254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-bb5d118e-be8e-4580-8707-134469494bed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:56.650070 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-bb5d118e-be8e-4580-8707-134469494bed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:56.652237 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-bb5d118e-be8e-4580-8707-134469494bed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:56.653337 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-bb5d118e-be8e-4580-8707-134469494bed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.197158 Aug 04 23:13:56.653893 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 88/171] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:56 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:13:56.686774 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0af60a71-0826-40e4-b1d7-946f9f3142d9 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:56.687289 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0af60a71-0826-40e4-b1d7-946f9f3142d9 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:56.692754 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9d63f5b0-4369-4e26-9555-609c385da72a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:56.693511 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9d63f5b0-4369-4e26-9555-609c385da72a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:56.693677 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0af60a71-0826-40e4-b1d7-946f9f3142d9 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:56.694019 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0af60a71-0826-40e4-b1d7-946f9f3142d9 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:56.694471 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0af60a71-0826-40e4-b1d7-946f9f3142d9 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:56.695162 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0af60a71-0826-40e4-b1d7-946f9f3142d9 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:56.695600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0af60a71-0826-40e4-b1d7-946f9f3142d9 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:56.696013 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0af60a71-0826-40e4-b1d7-946f9f3142d9 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:56.700566 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d63f5b0-4369-4e26-9555-609c385da72a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:56.701040 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d63f5b0-4369-4e26-9555-609c385da72a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:56.701466 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d63f5b0-4369-4e26-9555-609c385da72a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:56.702146 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d63f5b0-4369-4e26-9555-609c385da72a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:56.702609 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d63f5b0-4369-4e26-9555-609c385da72a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:56.703022 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d63f5b0-4369-4e26-9555-609c385da72a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:56.893557 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0af60a71-0826-40e4-b1d7-946f9f3142d9 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:56.897004 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9d63f5b0-4369-4e26-9555-609c385da72a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:56.902203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0af60a71-0826-40e4-b1d7-946f9f3142d9 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.219350 Aug 04 23:13:56.902807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 84/172] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:56 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:56.905634 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9d63f5b0-4369-4e26-9555-609c385da72a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.216596 Aug 04 23:13:56.906257 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 89/173] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:56 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:13:57.639931 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4a7d122e-ebef-479d-8803-162c0c4996d7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:57.640539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4a7d122e-ebef-479d-8803-162c0c4996d7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:57.646451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4a7d122e-ebef-479d-8803-162c0c4996d7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:57.646934 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4a7d122e-ebef-479d-8803-162c0c4996d7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:57.647359 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4a7d122e-ebef-479d-8803-162c0c4996d7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:57.648040 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4a7d122e-ebef-479d-8803-162c0c4996d7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:57.648486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4a7d122e-ebef-479d-8803-162c0c4996d7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:57.648918 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4a7d122e-ebef-479d-8803-162c0c4996d7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:57.676781 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a64d9841-a2be-4c66-83b0-904c74947904 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:57.677540 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a64d9841-a2be-4c66-83b0-904c74947904 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:57.686395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a64d9841-a2be-4c66-83b0-904c74947904 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:57.686877 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a64d9841-a2be-4c66-83b0-904c74947904 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:57.687300 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a64d9841-a2be-4c66-83b0-904c74947904 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:57.687984 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a64d9841-a2be-4c66-83b0-904c74947904 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:57.688425 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a64d9841-a2be-4c66-83b0-904c74947904 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:57.688837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a64d9841-a2be-4c66-83b0-904c74947904 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:57.849294 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4a7d122e-ebef-479d-8803-162c0c4996d7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:57.858026 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4a7d122e-ebef-479d-8803-162c0c4996d7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.221870 Aug 04 23:13:57.858908 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 85/174] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:57 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:57.863202 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-ef73fa6a-1cd7-43d4-97cc-6a4937510569 req-7465b252-ea20-48a6-9649-a7d7e399dc5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faea55ff-7fe8-496e-a691-cbd9ce467f0a", "name": "network-vif-plugged", "status": "completed", "tag": "7c54c357-45ad-4b09-8da5-f5ebc9e3bd6b"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:13:57.872670 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a64d9841-a2be-4c66-83b0-904c74947904 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:57.874608 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-ef73fa6a-1cd7-43d4-97cc-6a4937510569 req-7465b252-ea20-48a6-9649-a7d7e399dc5c service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:57.875087 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-ef73fa6a-1cd7-43d4-97cc-6a4937510569 req-7465b252-ea20-48a6-9649-a7d7e399dc5c service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:57.875511 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-ef73fa6a-1cd7-43d4-97cc-6a4937510569 req-7465b252-ea20-48a6-9649-a7d7e399dc5c service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:57.882184 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a64d9841-a2be-4c66-83b0-904c74947904 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:57.883711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a64d9841-a2be-4c66-83b0-904c74947904 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:57.885227 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a64d9841-a2be-4c66-83b0-904c74947904 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.211979 Aug 04 23:13:57.886003 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 90/175] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:57 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:13:57.887366 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-ef73fa6a-1cd7-43d4-97cc-6a4937510569 req-7465b252-ea20-48a6-9649-a7d7e399dc5c service nova] Creating event network-vif-plugged:7c54c357-45ad-4b09-8da5-f5ebc9e3bd6b for instance faea55ff-7fe8-496e-a691-cbd9ce467f0a on hv-cinder-85221 Aug 04 23:13:57.901140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-ef73fa6a-1cd7-43d4-97cc-6a4937510569 req-7465b252-ea20-48a6-9649-a7d7e399dc5c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040685 Aug 04 23:13:57.901850 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 86/176] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:13:57.923338 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f9780a2e-38ca-4810-8a70-c6d9a464ccc3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:57.923947 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f9780a2e-38ca-4810-8a70-c6d9a464ccc3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:57.926883 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-47c8f725-013b-4741-a89c-660f1e653170 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:57.927576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-47c8f725-013b-4741-a89c-660f1e653170 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:57.929987 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f9780a2e-38ca-4810-8a70-c6d9a464ccc3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:57.930510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f9780a2e-38ca-4810-8a70-c6d9a464ccc3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:57.930982 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f9780a2e-38ca-4810-8a70-c6d9a464ccc3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:57.931781 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f9780a2e-38ca-4810-8a70-c6d9a464ccc3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:57.932272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f9780a2e-38ca-4810-8a70-c6d9a464ccc3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:57.932781 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f9780a2e-38ca-4810-8a70-c6d9a464ccc3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:57.934316 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-47c8f725-013b-4741-a89c-660f1e653170 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:57.934846 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-47c8f725-013b-4741-a89c-660f1e653170 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:57.935277 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-47c8f725-013b-4741-a89c-660f1e653170 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:57.935970 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-47c8f725-013b-4741-a89c-660f1e653170 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:57.936414 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-47c8f725-013b-4741-a89c-660f1e653170 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:57.936836 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-47c8f725-013b-4741-a89c-660f1e653170 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:58.130465 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f9780a2e-38ca-4810-8a70-c6d9a464ccc3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:58.137746 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-47c8f725-013b-4741-a89c-660f1e653170 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:58.139321 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f9780a2e-38ca-4810-8a70-c6d9a464ccc3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.219791 Aug 04 23:13:58.139902 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 91/177] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:57 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:58.145501 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-47c8f725-013b-4741-a89c-660f1e653170 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.222560 Aug 04 23:13:58.146065 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 87/178] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:57 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:13:58.878947 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5c481625-b919-4d27-ac0b-ed74703861b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:58.879617 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5c481625-b919-4d27-ac0b-ed74703861b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:58.886432 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c481625-b919-4d27-ac0b-ed74703861b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:58.886906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c481625-b919-4d27-ac0b-ed74703861b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:58.887370 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c481625-b919-4d27-ac0b-ed74703861b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:58.888014 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c481625-b919-4d27-ac0b-ed74703861b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:58.888447 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c481625-b919-4d27-ac0b-ed74703861b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:58.888966 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c481625-b919-4d27-ac0b-ed74703861b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:58.907696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9dd698ae-eddc-4af7-b315-ef3d4ee891c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:58.908384 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9dd698ae-eddc-4af7-b315-ef3d4ee891c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:58.908508 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:13:58.914463 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9dd698ae-eddc-4af7-b315-ef3d4ee891c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:58.914944 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9dd698ae-eddc-4af7-b315-ef3d4ee891c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:58.915372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9dd698ae-eddc-4af7-b315-ef3d4ee891c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:58.916095 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9dd698ae-eddc-4af7-b315-ef3d4ee891c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:58.916514 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9dd698ae-eddc-4af7-b315-ef3d4ee891c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:58.917096 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9dd698ae-eddc-4af7-b315-ef3d4ee891c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:59.096035 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5c481625-b919-4d27-ac0b-ed74703861b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:59.102939 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9dd698ae-eddc-4af7-b315-ef3d4ee891c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:59.104069 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5c481625-b919-4d27-ac0b-ed74703861b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.228502 Aug 04 23:13:59.104656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 92/179] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:58 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:59.111990 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9dd698ae-eddc-4af7-b315-ef3d4ee891c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:59.113467 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9dd698ae-eddc-4af7-b315-ef3d4ee891c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:59.114572 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9dd698ae-eddc-4af7-b315-ef3d4ee891c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.210759 Aug 04 23:13:59.115103 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 88/180] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:13:58 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:13:59.160430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4ee8d129-7f6f-4213-960b-cefad1401b91 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:59.161046 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4ee8d129-7f6f-4213-960b-cefad1401b91 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:59.165618 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-82f1848e-e730-482d-8f64-8193e798d70f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:13:59.167002 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-82f1848e-e730-482d-8f64-8193e798d70f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:13:59.167517 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4ee8d129-7f6f-4213-960b-cefad1401b91 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:59.167994 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4ee8d129-7f6f-4213-960b-cefad1401b91 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:59.168421 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4ee8d129-7f6f-4213-960b-cefad1401b91 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:59.169111 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4ee8d129-7f6f-4213-960b-cefad1401b91 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:59.169558 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4ee8d129-7f6f-4213-960b-cefad1401b91 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:59.169975 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4ee8d129-7f6f-4213-960b-cefad1401b91 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:59.172756 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82f1848e-e730-482d-8f64-8193e798d70f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:59.173224 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82f1848e-e730-482d-8f64-8193e798d70f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:59.173646 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82f1848e-e730-482d-8f64-8193e798d70f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:59.174324 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82f1848e-e730-482d-8f64-8193e798d70f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:13:59.174789 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82f1848e-e730-482d-8f64-8193e798d70f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:13:59.175202 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82f1848e-e730-482d-8f64-8193e798d70f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:13:59.365131 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4ee8d129-7f6f-4213-960b-cefad1401b91 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:59.373874 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4ee8d129-7f6f-4213-960b-cefad1401b91 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.217406 Aug 04 23:13:59.374107 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-82f1848e-e730-482d-8f64-8193e798d70f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:13:59.374472 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 93/181] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:59 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:13:59.382847 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-82f1848e-e730-482d-8f64-8193e798d70f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.220863 Aug 04 23:13:59.383419 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 89/182] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:13:59 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:00.124882 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-987cde6e-98f0-4836-9ff1-95584262b5c8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:00.126223 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-987cde6e-98f0-4836-9ff1-95584262b5c8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:00.131917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-987cde6e-98f0-4836-9ff1-95584262b5c8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:00.132399 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-987cde6e-98f0-4836-9ff1-95584262b5c8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:00.132831 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-987cde6e-98f0-4836-9ff1-95584262b5c8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:00.133520 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-987cde6e-98f0-4836-9ff1-95584262b5c8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:00.134131 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-987cde6e-98f0-4836-9ff1-95584262b5c8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:00.134580 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-987cde6e-98f0-4836-9ff1-95584262b5c8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:00.137447 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6cdf6f9b-512a-47ea-8181-4577b41dc569 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:00.138059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6cdf6f9b-512a-47ea-8181-4577b41dc569 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:00.144072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6cdf6f9b-512a-47ea-8181-4577b41dc569 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:00.144554 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6cdf6f9b-512a-47ea-8181-4577b41dc569 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:00.144984 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6cdf6f9b-512a-47ea-8181-4577b41dc569 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:00.145676 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6cdf6f9b-512a-47ea-8181-4577b41dc569 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:00.146129 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6cdf6f9b-512a-47ea-8181-4577b41dc569 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:00.146575 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6cdf6f9b-512a-47ea-8181-4577b41dc569 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:00.336140 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-987cde6e-98f0-4836-9ff1-95584262b5c8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:00.339582 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6cdf6f9b-512a-47ea-8181-4577b41dc569 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:00.346424 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-987cde6e-98f0-4836-9ff1-95584262b5c8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.224820 Aug 04 23:14:00.348189 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6cdf6f9b-512a-47ea-8181-4577b41dc569 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:00.349747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6cdf6f9b-512a-47ea-8181-4577b41dc569 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:00.350905 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6cdf6f9b-512a-47ea-8181-4577b41dc569 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.217609 Aug 04 23:14:00.366045 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 90/183] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:00 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:14:00.366148 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 94/184] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:00 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:00.394648 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-40095244-d20a-453d-adb7-a6fc6278d2d2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:00.395209 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-40095244-d20a-453d-adb7-a6fc6278d2d2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:00.401210 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-40095244-d20a-453d-adb7-a6fc6278d2d2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:00.401690 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-40095244-d20a-453d-adb7-a6fc6278d2d2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:00.402125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-40095244-d20a-453d-adb7-a6fc6278d2d2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:00.402844 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-40095244-d20a-453d-adb7-a6fc6278d2d2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:00.403299 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-40095244-d20a-453d-adb7-a6fc6278d2d2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:00.403399 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4f8b74a0-5146-41d1-a411-b4e7f064ebc0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:00.403722 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-40095244-d20a-453d-adb7-a6fc6278d2d2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:00.403998 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4f8b74a0-5146-41d1-a411-b4e7f064ebc0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:00.412662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f8b74a0-5146-41d1-a411-b4e7f064ebc0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:00.413124 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f8b74a0-5146-41d1-a411-b4e7f064ebc0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:00.413539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f8b74a0-5146-41d1-a411-b4e7f064ebc0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:00.414224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f8b74a0-5146-41d1-a411-b4e7f064ebc0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:00.414704 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f8b74a0-5146-41d1-a411-b4e7f064ebc0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:00.415116 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f8b74a0-5146-41d1-a411-b4e7f064ebc0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:00.604588 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-40095244-d20a-453d-adb7-a6fc6278d2d2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:00.612550 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-40095244-d20a-453d-adb7-a6fc6278d2d2 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.221563 Aug 04 23:14:00.613008 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4f8b74a0-5146-41d1-a411-b4e7f064ebc0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:00.615959 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 91/185] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:00 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:00.629345 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4f8b74a0-5146-41d1-a411-b4e7f064ebc0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.229960 Aug 04 23:14:00.630090 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 95/186] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:00 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:01.367876 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-cf984cee-977b-4d5a-8bce-4cee3ca7a14d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:01.368567 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-cf984cee-977b-4d5a-8bce-4cee3ca7a14d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:01.375837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cf984cee-977b-4d5a-8bce-4cee3ca7a14d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:01.376332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cf984cee-977b-4d5a-8bce-4cee3ca7a14d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:01.376765 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cf984cee-977b-4d5a-8bce-4cee3ca7a14d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:01.377471 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cf984cee-977b-4d5a-8bce-4cee3ca7a14d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:01.379612 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cf984cee-977b-4d5a-8bce-4cee3ca7a14d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:01.379612 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cf984cee-977b-4d5a-8bce-4cee3ca7a14d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:01.383192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-abeac0c4-bd66-4163-9b2f-393db013a2fa tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:01.383910 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-abeac0c4-bd66-4163-9b2f-393db013a2fa tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:01.396574 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-abeac0c4-bd66-4163-9b2f-393db013a2fa tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:01.397058 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-abeac0c4-bd66-4163-9b2f-393db013a2fa tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:01.397487 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-abeac0c4-bd66-4163-9b2f-393db013a2fa tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:01.398181 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-abeac0c4-bd66-4163-9b2f-393db013a2fa tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:01.398689 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-abeac0c4-bd66-4163-9b2f-393db013a2fa tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:01.399100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-abeac0c4-bd66-4163-9b2f-393db013a2fa tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:01.596634 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cf984cee-977b-4d5a-8bce-4cee3ca7a14d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:01.600842 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-abeac0c4-bd66-4163-9b2f-393db013a2fa tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:01.605184 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-cf984cee-977b-4d5a-8bce-4cee3ca7a14d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.240887 Aug 04 23:14:01.605726 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 92/187] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:01 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:01.609689 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-abeac0c4-bd66-4163-9b2f-393db013a2fa tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:01.611302 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-abeac0c4-bd66-4163-9b2f-393db013a2fa tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:01.612516 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-abeac0c4-bd66-4163-9b2f-393db013a2fa tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.243420 Aug 04 23:14:01.613143 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 96/188] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:01 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:14:01.637286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-607d43e3-03ef-40c1-8959-5de833c2efc6 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:01.637784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-607d43e3-03ef-40c1-8959-5de833c2efc6 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:01.643987 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-607d43e3-03ef-40c1-8959-5de833c2efc6 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:01.644465 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-607d43e3-03ef-40c1-8959-5de833c2efc6 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:01.644897 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-607d43e3-03ef-40c1-8959-5de833c2efc6 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:01.645584 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-607d43e3-03ef-40c1-8959-5de833c2efc6 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:01.647851 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-607d43e3-03ef-40c1-8959-5de833c2efc6 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:01.648298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-607d43e3-03ef-40c1-8959-5de833c2efc6 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:01.652581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-47b7bdfc-0248-4bf0-98d2-ac352ff6cdc3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:01.654893 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-47b7bdfc-0248-4bf0-98d2-ac352ff6cdc3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:01.660767 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-47b7bdfc-0248-4bf0-98d2-ac352ff6cdc3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:01.661255 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-47b7bdfc-0248-4bf0-98d2-ac352ff6cdc3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:01.661692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-47b7bdfc-0248-4bf0-98d2-ac352ff6cdc3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:01.662406 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-47b7bdfc-0248-4bf0-98d2-ac352ff6cdc3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:01.662862 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-47b7bdfc-0248-4bf0-98d2-ac352ff6cdc3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:01.663283 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-47b7bdfc-0248-4bf0-98d2-ac352ff6cdc3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:01.875818 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-47b7bdfc-0248-4bf0-98d2-ac352ff6cdc3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:01.879447 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-607d43e3-03ef-40c1-8959-5de833c2efc6 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:01.888910 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-47b7bdfc-0248-4bf0-98d2-ac352ff6cdc3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.240449 Aug 04 23:14:01.889818 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 97/189] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:01 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:01.890457 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-607d43e3-03ef-40c1-8959-5de833c2efc6 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.257865 Aug 04 23:14:01.891208 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 93/190] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:01 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:02.626899 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0ce2cd43-c105-451c-9d81-dc02aaa24d67 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:02.627506 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0ce2cd43-c105-451c-9d81-dc02aaa24d67 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:02.633719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0ce2cd43-c105-451c-9d81-dc02aaa24d67 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:02.634215 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0ce2cd43-c105-451c-9d81-dc02aaa24d67 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:02.634671 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0ce2cd43-c105-451c-9d81-dc02aaa24d67 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:02.635064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3d793de2-2044-4b9a-af0e-dac030374444 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:02.635923 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0ce2cd43-c105-451c-9d81-dc02aaa24d67 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:02.635923 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0ce2cd43-c105-451c-9d81-dc02aaa24d67 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:02.636097 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3d793de2-2044-4b9a-af0e-dac030374444 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:02.636221 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0ce2cd43-c105-451c-9d81-dc02aaa24d67 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:02.642057 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3d793de2-2044-4b9a-af0e-dac030374444 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:02.642566 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3d793de2-2044-4b9a-af0e-dac030374444 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:02.642990 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3d793de2-2044-4b9a-af0e-dac030374444 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:02.643676 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3d793de2-2044-4b9a-af0e-dac030374444 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:02.644249 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3d793de2-2044-4b9a-af0e-dac030374444 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:02.644699 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3d793de2-2044-4b9a-af0e-dac030374444 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:02.836385 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0ce2cd43-c105-451c-9d81-dc02aaa24d67 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:02.844747 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0ce2cd43-c105-451c-9d81-dc02aaa24d67 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.221645 Aug 04 23:14:02.844919 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3d793de2-2044-4b9a-af0e-dac030374444 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:02.846099 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 98/191] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:02 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:02.853161 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3d793de2-2044-4b9a-af0e-dac030374444 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:02.855678 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3d793de2-2044-4b9a-af0e-dac030374444 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:02.856773 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3d793de2-2044-4b9a-af0e-dac030374444 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.225726 Aug 04 23:14:02.857316 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 94/192] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:02 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:14:02.910910 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4fab3091-7073-43d3-9122-981fe9cbe772 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:02.911515 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4fab3091-7073-43d3-9122-981fe9cbe772 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:02.911626 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b44ad2d9-6b9b-4903-b207-7c7f942567cc tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:02.912228 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b44ad2d9-6b9b-4903-b207-7c7f942567cc tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:02.918257 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4fab3091-7073-43d3-9122-981fe9cbe772 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:02.918779 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4fab3091-7073-43d3-9122-981fe9cbe772 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:02.918922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b44ad2d9-6b9b-4903-b207-7c7f942567cc tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:02.919206 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4fab3091-7073-43d3-9122-981fe9cbe772 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:02.919333 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b44ad2d9-6b9b-4903-b207-7c7f942567cc tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:02.919711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b44ad2d9-6b9b-4903-b207-7c7f942567cc tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:02.919908 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4fab3091-7073-43d3-9122-981fe9cbe772 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:02.920357 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4fab3091-7073-43d3-9122-981fe9cbe772 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:02.920464 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b44ad2d9-6b9b-4903-b207-7c7f942567cc tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:02.920778 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4fab3091-7073-43d3-9122-981fe9cbe772 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:02.920886 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b44ad2d9-6b9b-4903-b207-7c7f942567cc tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:02.921219 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b44ad2d9-6b9b-4903-b207-7c7f942567cc tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:03.121809 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4fab3091-7073-43d3-9122-981fe9cbe772 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:03.129423 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b44ad2d9-6b9b-4903-b207-7c7f942567cc tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:03.130137 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4fab3091-7073-43d3-9122-981fe9cbe772 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.222921 Aug 04 23:14:03.130835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 99/193] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:02 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:03.138318 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b44ad2d9-6b9b-4903-b207-7c7f942567cc tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.230412 Aug 04 23:14:03.146141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 95/194] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:02 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:03.864856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a6820798-3f78-4c86-8337-799e82863a14 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:03.865466 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a6820798-3f78-4c86-8337-799e82863a14 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:03.871497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a6820798-3f78-4c86-8337-799e82863a14 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:03.871972 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a6820798-3f78-4c86-8337-799e82863a14 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:03.872410 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a6820798-3f78-4c86-8337-799e82863a14 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:03.874173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a6820798-3f78-4c86-8337-799e82863a14 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:03.875044 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a6820798-3f78-4c86-8337-799e82863a14 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:03.875522 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a6820798-3f78-4c86-8337-799e82863a14 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:03.884443 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c85debca-78c8-4589-9961-489f4a6e8d83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:03.885136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c85debca-78c8-4589-9961-489f4a6e8d83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:03.891055 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c85debca-78c8-4589-9961-489f4a6e8d83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:03.891536 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c85debca-78c8-4589-9961-489f4a6e8d83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:03.891971 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c85debca-78c8-4589-9961-489f4a6e8d83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:03.892662 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c85debca-78c8-4589-9961-489f4a6e8d83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:03.893107 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c85debca-78c8-4589-9961-489f4a6e8d83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:03.893624 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c85debca-78c8-4589-9961-489f4a6e8d83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:04.084502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a6820798-3f78-4c86-8337-799e82863a14 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:04.093294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a6820798-3f78-4c86-8337-799e82863a14 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.232146 Aug 04 23:14:04.093992 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 100/195] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:03 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:04.095967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c85debca-78c8-4589-9961-489f4a6e8d83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:04.103835 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c85debca-78c8-4589-9961-489f4a6e8d83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:04.105611 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c85debca-78c8-4589-9961-489f4a6e8d83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:04.106720 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c85debca-78c8-4589-9961-489f4a6e8d83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.226386 Aug 04 23:14:04.107265 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 96/196] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:03 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:14:04.151880 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-485a3d15-fc06-43a2-93ee-d87d896e20c3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:04.152491 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-485a3d15-fc06-43a2-93ee-d87d896e20c3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:04.158788 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-485a3d15-fc06-43a2-93ee-d87d896e20c3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:04.158985 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-dbdc3ec6-ed00-4151-994f-a431eec268e3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:04.159274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-485a3d15-fc06-43a2-93ee-d87d896e20c3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:04.159731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-485a3d15-fc06-43a2-93ee-d87d896e20c3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:04.159836 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-dbdc3ec6-ed00-4151-994f-a431eec268e3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:04.160392 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-485a3d15-fc06-43a2-93ee-d87d896e20c3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:04.160864 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-485a3d15-fc06-43a2-93ee-d87d896e20c3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:04.161261 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-485a3d15-fc06-43a2-93ee-d87d896e20c3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:04.165823 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dbdc3ec6-ed00-4151-994f-a431eec268e3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:04.166543 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dbdc3ec6-ed00-4151-994f-a431eec268e3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:04.167237 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dbdc3ec6-ed00-4151-994f-a431eec268e3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:04.167943 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dbdc3ec6-ed00-4151-994f-a431eec268e3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:04.168393 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dbdc3ec6-ed00-4151-994f-a431eec268e3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:04.168808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dbdc3ec6-ed00-4151-994f-a431eec268e3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:04.376870 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-485a3d15-fc06-43a2-93ee-d87d896e20c3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:04.380250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-dbdc3ec6-ed00-4151-994f-a431eec268e3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:04.384417 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-485a3d15-fc06-43a2-93ee-d87d896e20c3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.236955 Aug 04 23:14:04.385666 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 101/197] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:04 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:04.388551 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-dbdc3ec6-ed00-4151-994f-a431eec268e3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.233214 Aug 04 23:14:04.389106 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 97/198] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:04 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:05.114062 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8346d3e7-6988-4769-80ee-6719fdfde316 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:05.114724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8346d3e7-6988-4769-80ee-6719fdfde316 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:05.121505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8346d3e7-6988-4769-80ee-6719fdfde316 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:05.121965 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8346d3e7-6988-4769-80ee-6719fdfde316 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:05.122495 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8346d3e7-6988-4769-80ee-6719fdfde316 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:05.123197 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8346d3e7-6988-4769-80ee-6719fdfde316 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:05.123933 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8346d3e7-6988-4769-80ee-6719fdfde316 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:05.124069 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8346d3e7-6988-4769-80ee-6719fdfde316 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:05.130661 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a5bd6148-467e-48f9-9b13-0e5b594fe777 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:05.131374 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a5bd6148-467e-48f9-9b13-0e5b594fe777 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:05.138679 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5bd6148-467e-48f9-9b13-0e5b594fe777 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:05.139152 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5bd6148-467e-48f9-9b13-0e5b594fe777 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:05.139573 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5bd6148-467e-48f9-9b13-0e5b594fe777 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:05.140261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5bd6148-467e-48f9-9b13-0e5b594fe777 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:05.140695 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5bd6148-467e-48f9-9b13-0e5b594fe777 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:05.141102 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5bd6148-467e-48f9-9b13-0e5b594fe777 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:05.325704 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8346d3e7-6988-4769-80ee-6719fdfde316 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:05.335511 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8346d3e7-6988-4769-80ee-6719fdfde316 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.224861 Aug 04 23:14:05.336107 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 102/199] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:05 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:05.341800 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a5bd6148-467e-48f9-9b13-0e5b594fe777 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:05.350014 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a5bd6148-467e-48f9-9b13-0e5b594fe777 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:05.351557 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a5bd6148-467e-48f9-9b13-0e5b594fe777 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:05.352694 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a5bd6148-467e-48f9-9b13-0e5b594fe777 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.227713 Aug 04 23:14:05.353256 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 98/200] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:05 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:14:05.405514 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-29b07d65-fa44-4a4d-a6a6-64fa3b4084de tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:05.406137 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-29b07d65-fa44-4a4d-a6a6-64fa3b4084de tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:05.409224 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5e0250dc-b7fd-4fbb-8a99-b44c8bccb528 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:05.409837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5e0250dc-b7fd-4fbb-8a99-b44c8bccb528 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:05.413924 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-29b07d65-fa44-4a4d-a6a6-64fa3b4084de tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:05.414440 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-29b07d65-fa44-4a4d-a6a6-64fa3b4084de tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:05.414880 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-29b07d65-fa44-4a4d-a6a6-64fa3b4084de tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:05.415585 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-29b07d65-fa44-4a4d-a6a6-64fa3b4084de tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:05.415878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5e0250dc-b7fd-4fbb-8a99-b44c8bccb528 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:05.416086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-29b07d65-fa44-4a4d-a6a6-64fa3b4084de tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:05.416391 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5e0250dc-b7fd-4fbb-8a99-b44c8bccb528 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:05.416520 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-29b07d65-fa44-4a4d-a6a6-64fa3b4084de tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:05.416837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5e0250dc-b7fd-4fbb-8a99-b44c8bccb528 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:05.417530 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5e0250dc-b7fd-4fbb-8a99-b44c8bccb528 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:05.417982 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5e0250dc-b7fd-4fbb-8a99-b44c8bccb528 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:05.418421 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5e0250dc-b7fd-4fbb-8a99-b44c8bccb528 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:05.618922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5e0250dc-b7fd-4fbb-8a99-b44c8bccb528 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:05.623918 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-29b07d65-fa44-4a4d-a6a6-64fa3b4084de tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:05.629564 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5e0250dc-b7fd-4fbb-8a99-b44c8bccb528 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.223964 Aug 04 23:14:05.631590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-29b07d65-fa44-4a4d-a6a6-64fa3b4084de tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.229905 Aug 04 23:14:05.632163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 103/201] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:05 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:05.634530 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 99/202] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:05 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:06.357467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ca57eac8-d4d9-4f28-82f7-922d3a36e7e5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:06.358082 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ca57eac8-d4d9-4f28-82f7-922d3a36e7e5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:06.364270 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca57eac8-d4d9-4f28-82f7-922d3a36e7e5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:06.364747 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca57eac8-d4d9-4f28-82f7-922d3a36e7e5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:06.365176 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca57eac8-d4d9-4f28-82f7-922d3a36e7e5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:06.365880 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca57eac8-d4d9-4f28-82f7-922d3a36e7e5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:06.366325 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca57eac8-d4d9-4f28-82f7-922d3a36e7e5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:06.366772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca57eac8-d4d9-4f28-82f7-922d3a36e7e5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:06.375757 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2bf0f412-0829-490c-ae48-274e5a442029 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:06.376361 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2bf0f412-0829-490c-ae48-274e5a442029 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:06.389983 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bf0f412-0829-490c-ae48-274e5a442029 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:06.390502 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bf0f412-0829-490c-ae48-274e5a442029 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:06.390928 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bf0f412-0829-490c-ae48-274e5a442029 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:06.391628 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bf0f412-0829-490c-ae48-274e5a442029 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:06.393221 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bf0f412-0829-490c-ae48-274e5a442029 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:06.393830 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bf0f412-0829-490c-ae48-274e5a442029 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:06.397206 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:14:06.616507 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ca57eac8-d4d9-4f28-82f7-922d3a36e7e5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:06.629038 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ca57eac8-d4d9-4f28-82f7-922d3a36e7e5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.276109 Aug 04 23:14:06.638397 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 104/203] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:06 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:06.653115 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-86438edc-4984-483e-9700-46b5617aab03 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:06.653799 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-86438edc-4984-483e-9700-46b5617aab03 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:06.657345 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2bf0f412-0829-490c-ae48-274e5a442029 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:06.660911 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86438edc-4984-483e-9700-46b5617aab03 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:06.661416 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86438edc-4984-483e-9700-46b5617aab03 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:06.661909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86438edc-4984-483e-9700-46b5617aab03 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:06.662976 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86438edc-4984-483e-9700-46b5617aab03 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:06.664323 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86438edc-4984-483e-9700-46b5617aab03 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:06.664323 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86438edc-4984-483e-9700-46b5617aab03 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:06.672265 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2bf0f412-0829-490c-ae48-274e5a442029 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:06.674554 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2bf0f412-0829-490c-ae48-274e5a442029 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:06.676475 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2bf0f412-0829-490c-ae48-274e5a442029 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.304551 Aug 04 23:14:06.688330 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 100/204] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:06 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:14:06.702552 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-28736dfd-3a51-4a15-801e-e02ea551f177 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:06.704957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-28736dfd-3a51-4a15-801e-e02ea551f177 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:06.725303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28736dfd-3a51-4a15-801e-e02ea551f177 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:06.725797 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28736dfd-3a51-4a15-801e-e02ea551f177 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:06.726455 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28736dfd-3a51-4a15-801e-e02ea551f177 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:06.727341 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28736dfd-3a51-4a15-801e-e02ea551f177 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:06.727796 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28736dfd-3a51-4a15-801e-e02ea551f177 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:06.728232 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28736dfd-3a51-4a15-801e-e02ea551f177 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:06.881400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-86438edc-4984-483e-9700-46b5617aab03 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:06.892321 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-86438edc-4984-483e-9700-46b5617aab03 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.244190 Aug 04 23:14:06.893745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 105/205] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:06 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:06.927807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-28736dfd-3a51-4a15-801e-e02ea551f177 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:06.935673 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-28736dfd-3a51-4a15-801e-e02ea551f177 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.245878 Aug 04 23:14:06.936253 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 101/206] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:06 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:07.149131 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-69975a24-9a02-4215-a372-219ab3c06286 req-ba2f6806-bdc0-4bc8-9733-5f1f21e9071c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cd10c30-2a58-4afa-b3c3-2da74e98b7d9", "name": "network-vif-plugged", "status": "completed", "tag": "f0661d6e-dd49-44fb-9a40-a031958d1e11"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:14:07.164575 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-69975a24-9a02-4215-a372-219ab3c06286 req-ba2f6806-bdc0-4bc8-9733-5f1f21e9071c service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:07.165922 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-69975a24-9a02-4215-a372-219ab3c06286 req-ba2f6806-bdc0-4bc8-9733-5f1f21e9071c service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:07.168322 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-69975a24-9a02-4215-a372-219ab3c06286 req-ba2f6806-bdc0-4bc8-9733-5f1f21e9071c service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:07.189571 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-69975a24-9a02-4215-a372-219ab3c06286 req-ba2f6806-bdc0-4bc8-9733-5f1f21e9071c service nova] Creating event network-vif-plugged:f0661d6e-dd49-44fb-9a40-a031958d1e11 for instance 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 on hv-cinder-85221 Aug 04 23:14:07.203591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-69975a24-9a02-4215-a372-219ab3c06286 req-ba2f6806-bdc0-4bc8-9733-5f1f21e9071c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057720 Aug 04 23:14:07.205338 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 106/207] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:14:07.650221 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-515757d1-77bc-47f4-825b-4b69ddb68893 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:07.651001 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-515757d1-77bc-47f4-825b-4b69ddb68893 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:07.657761 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-515757d1-77bc-47f4-825b-4b69ddb68893 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:07.658353 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-515757d1-77bc-47f4-825b-4b69ddb68893 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:07.658815 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-515757d1-77bc-47f4-825b-4b69ddb68893 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:07.659565 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-515757d1-77bc-47f4-825b-4b69ddb68893 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:07.660007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-515757d1-77bc-47f4-825b-4b69ddb68893 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:07.660469 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-515757d1-77bc-47f4-825b-4b69ddb68893 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:07.701699 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c6c8c6b7-cd6d-4b1d-815e-25b7f4dc1aed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:07.702483 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c6c8c6b7-cd6d-4b1d-815e-25b7f4dc1aed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:07.708951 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6c8c6b7-cd6d-4b1d-815e-25b7f4dc1aed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:07.709441 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6c8c6b7-cd6d-4b1d-815e-25b7f4dc1aed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:07.709902 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6c8c6b7-cd6d-4b1d-815e-25b7f4dc1aed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:07.710896 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6c8c6b7-cd6d-4b1d-815e-25b7f4dc1aed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:07.711343 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6c8c6b7-cd6d-4b1d-815e-25b7f4dc1aed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:07.711758 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6c8c6b7-cd6d-4b1d-815e-25b7f4dc1aed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:07.875540 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-515757d1-77bc-47f4-825b-4b69ddb68893 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:07.891327 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-515757d1-77bc-47f4-825b-4b69ddb68893 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.243650 Aug 04 23:14:07.893162 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 102/208] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:07 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:07.922840 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5468e60a-dc7d-44fa-aa53-439df8efc2a0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:07.923743 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5468e60a-dc7d-44fa-aa53-439df8efc2a0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:07.931122 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c6c8c6b7-cd6d-4b1d-815e-25b7f4dc1aed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:07.948712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5468e60a-dc7d-44fa-aa53-439df8efc2a0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:07.948712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5468e60a-dc7d-44fa-aa53-439df8efc2a0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:07.948712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5468e60a-dc7d-44fa-aa53-439df8efc2a0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:07.948712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5468e60a-dc7d-44fa-aa53-439df8efc2a0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:07.949169 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5468e60a-dc7d-44fa-aa53-439df8efc2a0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:07.949169 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5468e60a-dc7d-44fa-aa53-439df8efc2a0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:07.956484 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c6c8c6b7-cd6d-4b1d-815e-25b7f4dc1aed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:07.959781 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c6c8c6b7-cd6d-4b1d-815e-25b7f4dc1aed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:07.967814 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c6c8c6b7-cd6d-4b1d-815e-25b7f4dc1aed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.271823 Aug 04 23:14:07.969003 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 107/209] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:07 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:14:07.982574 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b3de705d-3046-444e-908c-c6e20b91e944 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:07.984229 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b3de705d-3046-444e-908c-c6e20b91e944 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:07.991643 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3de705d-3046-444e-908c-c6e20b91e944 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:07.992744 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3de705d-3046-444e-908c-c6e20b91e944 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:07.993426 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3de705d-3046-444e-908c-c6e20b91e944 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:07.995263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3de705d-3046-444e-908c-c6e20b91e944 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:07.996040 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3de705d-3046-444e-908c-c6e20b91e944 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:07.996612 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3de705d-3046-444e-908c-c6e20b91e944 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:08.184153 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5468e60a-dc7d-44fa-aa53-439df8efc2a0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:08.196723 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5468e60a-dc7d-44fa-aa53-439df8efc2a0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.285034 Aug 04 23:14:08.198300 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 103/210] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:07 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:08.228994 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b3de705d-3046-444e-908c-c6e20b91e944 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:08.237451 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b3de705d-3046-444e-908c-c6e20b91e944 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.267138 Aug 04 23:14:08.238042 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 108/211] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:07 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:08.912266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e2241f06-18ef-4e16-bc52-234acc7ab949 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:08.912823 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e2241f06-18ef-4e16-bc52-234acc7ab949 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:08.919514 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2241f06-18ef-4e16-bc52-234acc7ab949 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:08.919986 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2241f06-18ef-4e16-bc52-234acc7ab949 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:08.920407 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2241f06-18ef-4e16-bc52-234acc7ab949 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:08.921093 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2241f06-18ef-4e16-bc52-234acc7ab949 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:08.921534 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2241f06-18ef-4e16-bc52-234acc7ab949 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:08.921946 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2241f06-18ef-4e16-bc52-234acc7ab949 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:08.993322 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-421a6f81-7603-4541-b91d-bd72a9c6f549 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:08.994619 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-421a6f81-7603-4541-b91d-bd72a9c6f549 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:09.001640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-421a6f81-7603-4541-b91d-bd72a9c6f549 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:09.002240 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-421a6f81-7603-4541-b91d-bd72a9c6f549 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:09.002715 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-421a6f81-7603-4541-b91d-bd72a9c6f549 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:09.003280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-421a6f81-7603-4541-b91d-bd72a9c6f549 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:09.003890 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-421a6f81-7603-4541-b91d-bd72a9c6f549 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:09.004454 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-421a6f81-7603-4541-b91d-bd72a9c6f549 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:09.102164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e2241f06-18ef-4e16-bc52-234acc7ab949 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:09.120182 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e2241f06-18ef-4e16-bc52-234acc7ab949 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.211673 Aug 04 23:14:09.121030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 104/212] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:08 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:09.173783 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-421a6f81-7603-4541-b91d-bd72a9c6f549 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:09.177443 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:14:09.183299 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-421a6f81-7603-4541-b91d-bd72a9c6f549 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:09.184807 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-421a6f81-7603-4541-b91d-bd72a9c6f549 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:09.185925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-421a6f81-7603-4541-b91d-bd72a9c6f549 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.196532 Aug 04 23:14:09.186545 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 109/213] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:08 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:14:09.221334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ac544c89-5754-421c-8a89-90a39ea7d36d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:09.221935 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ac544c89-5754-421c-8a89-90a39ea7d36d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:09.228004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac544c89-5754-421c-8a89-90a39ea7d36d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:09.228479 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac544c89-5754-421c-8a89-90a39ea7d36d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:09.228911 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac544c89-5754-421c-8a89-90a39ea7d36d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:09.230242 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac544c89-5754-421c-8a89-90a39ea7d36d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:09.230925 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac544c89-5754-421c-8a89-90a39ea7d36d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:09.231351 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac544c89-5754-421c-8a89-90a39ea7d36d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:09.258887 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a0ab5064-7ec7-452d-98b6-714e058e1a52 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:09.259494 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a0ab5064-7ec7-452d-98b6-714e058e1a52 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:09.265627 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0ab5064-7ec7-452d-98b6-714e058e1a52 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:09.266108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0ab5064-7ec7-452d-98b6-714e058e1a52 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:09.266566 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0ab5064-7ec7-452d-98b6-714e058e1a52 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:09.267259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0ab5064-7ec7-452d-98b6-714e058e1a52 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:09.267711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0ab5064-7ec7-452d-98b6-714e058e1a52 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:09.268125 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0ab5064-7ec7-452d-98b6-714e058e1a52 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:09.413754 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ac544c89-5754-421c-8a89-90a39ea7d36d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:09.422099 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ac544c89-5754-421c-8a89-90a39ea7d36d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.204490 Aug 04 23:14:09.422826 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 105/214] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:09 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:09.442215 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a0ab5064-7ec7-452d-98b6-714e058e1a52 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:09.449852 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a0ab5064-7ec7-452d-98b6-714e058e1a52 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.194988 Aug 04 23:14:09.450432 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 110/215] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:09 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:10.141292 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-abc628fd-1a70-4d35-b258-81615b2c4da9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:10.141929 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-abc628fd-1a70-4d35-b258-81615b2c4da9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:10.148111 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abc628fd-1a70-4d35-b258-81615b2c4da9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:10.148592 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abc628fd-1a70-4d35-b258-81615b2c4da9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:10.149015 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abc628fd-1a70-4d35-b258-81615b2c4da9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:10.149711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abc628fd-1a70-4d35-b258-81615b2c4da9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:10.150157 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abc628fd-1a70-4d35-b258-81615b2c4da9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:10.150601 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abc628fd-1a70-4d35-b258-81615b2c4da9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:10.208119 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-be4c0423-5772-45f9-88e1-883f7fafa560 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:10.208735 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-be4c0423-5772-45f9-88e1-883f7fafa560 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:10.216170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-be4c0423-5772-45f9-88e1-883f7fafa560 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:10.216844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-be4c0423-5772-45f9-88e1-883f7fafa560 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:10.217354 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-be4c0423-5772-45f9-88e1-883f7fafa560 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:10.218141 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-be4c0423-5772-45f9-88e1-883f7fafa560 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:10.218872 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-be4c0423-5772-45f9-88e1-883f7fafa560 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:10.219567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-be4c0423-5772-45f9-88e1-883f7fafa560 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:10.348565 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-abc628fd-1a70-4d35-b258-81615b2c4da9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:10.370704 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-abc628fd-1a70-4d35-b258-81615b2c4da9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.232111 Aug 04 23:14:10.371548 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 106/216] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:10 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:10.407078 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-be4c0423-5772-45f9-88e1-883f7fafa560 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:10.415429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-be4c0423-5772-45f9-88e1-883f7fafa560 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:10.417927 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-be4c0423-5772-45f9-88e1-883f7fafa560 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:10.419111 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-be4c0423-5772-45f9-88e1-883f7fafa560 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.215070 Aug 04 23:14:10.419676 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 111/217] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:10 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:14:10.444041 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c605096a-4f98-46d3-a7e8-b2984a7e2e55 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:10.444696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c605096a-4f98-46d3-a7e8-b2984a7e2e55 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:10.451781 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c605096a-4f98-46d3-a7e8-b2984a7e2e55 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:10.452220 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c605096a-4f98-46d3-a7e8-b2984a7e2e55 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:10.452652 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c605096a-4f98-46d3-a7e8-b2984a7e2e55 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:10.453747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c605096a-4f98-46d3-a7e8-b2984a7e2e55 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:10.453950 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c605096a-4f98-46d3-a7e8-b2984a7e2e55 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:10.454406 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c605096a-4f98-46d3-a7e8-b2984a7e2e55 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:10.471436 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a7b9c4a8-8757-4c62-b3f6-fc714eaffa8e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:10.472341 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a7b9c4a8-8757-4c62-b3f6-fc714eaffa8e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:10.481679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a7b9c4a8-8757-4c62-b3f6-fc714eaffa8e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:10.482348 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a7b9c4a8-8757-4c62-b3f6-fc714eaffa8e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:10.482892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a7b9c4a8-8757-4c62-b3f6-fc714eaffa8e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:10.483614 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a7b9c4a8-8757-4c62-b3f6-fc714eaffa8e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:10.484094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a7b9c4a8-8757-4c62-b3f6-fc714eaffa8e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:10.484630 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a7b9c4a8-8757-4c62-b3f6-fc714eaffa8e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:10.671206 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c605096a-4f98-46d3-a7e8-b2984a7e2e55 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:10.678725 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c605096a-4f98-46d3-a7e8-b2984a7e2e55 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.238739 Aug 04 23:14:10.678914 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a7b9c4a8-8757-4c62-b3f6-fc714eaffa8e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:10.679563 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 107/218] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:10 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:10.688821 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a7b9c4a8-8757-4c62-b3f6-fc714eaffa8e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.221375 Aug 04 23:14:10.689679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 112/219] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:10 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:11.392680 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8717b1a7-b029-4508-b546-99692e3f1009 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:11.393273 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8717b1a7-b029-4508-b546-99692e3f1009 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:11.399385 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8717b1a7-b029-4508-b546-99692e3f1009 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:11.399852 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8717b1a7-b029-4508-b546-99692e3f1009 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:11.400277 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8717b1a7-b029-4508-b546-99692e3f1009 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:11.400950 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8717b1a7-b029-4508-b546-99692e3f1009 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:11.401450 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8717b1a7-b029-4508-b546-99692e3f1009 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:11.402026 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8717b1a7-b029-4508-b546-99692e3f1009 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:11.446180 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-24c7ddba-7f55-48dc-86fb-3fb9d47e3747 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:11.446868 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-24c7ddba-7f55-48dc-86fb-3fb9d47e3747 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:11.454966 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24c7ddba-7f55-48dc-86fb-3fb9d47e3747 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:11.455364 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24c7ddba-7f55-48dc-86fb-3fb9d47e3747 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:11.455780 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24c7ddba-7f55-48dc-86fb-3fb9d47e3747 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:11.456471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24c7ddba-7f55-48dc-86fb-3fb9d47e3747 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:11.456917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24c7ddba-7f55-48dc-86fb-3fb9d47e3747 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:11.457329 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24c7ddba-7f55-48dc-86fb-3fb9d47e3747 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:11.788084 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8717b1a7-b029-4508-b546-99692e3f1009 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:11.796800 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-24c7ddba-7f55-48dc-86fb-3fb9d47e3747 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:11.798690 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8717b1a7-b029-4508-b546-99692e3f1009 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.409435 Aug 04 23:14:11.814506 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 108/220] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:11 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:11.820308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-24c7ddba-7f55-48dc-86fb-3fb9d47e3747 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:11.821348 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5b3594dd-d56f-489f-bd41-4a2ee6009ec9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:11.822187 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-24c7ddba-7f55-48dc-86fb-3fb9d47e3747 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:11.822544 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5b3594dd-d56f-489f-bd41-4a2ee6009ec9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:11.824692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-24c7ddba-7f55-48dc-86fb-3fb9d47e3747 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.383581 Aug 04 23:14:11.830808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b3594dd-d56f-489f-bd41-4a2ee6009ec9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:11.831564 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b3594dd-d56f-489f-bd41-4a2ee6009ec9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:11.832231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b3594dd-d56f-489f-bd41-4a2ee6009ec9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:11.833240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b3594dd-d56f-489f-bd41-4a2ee6009ec9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:11.833957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b3594dd-d56f-489f-bd41-4a2ee6009ec9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:11.834757 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b3594dd-d56f-489f-bd41-4a2ee6009ec9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:11.841832 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 113/221] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:11 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:14:11.849163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b919e18c-34a3-4e52-9747-feb31c9465ad tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:11.849768 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b919e18c-34a3-4e52-9747-feb31c9465ad tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:11.857606 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b919e18c-34a3-4e52-9747-feb31c9465ad tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:11.858086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b919e18c-34a3-4e52-9747-feb31c9465ad tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:11.858558 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b919e18c-34a3-4e52-9747-feb31c9465ad tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:11.859252 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b919e18c-34a3-4e52-9747-feb31c9465ad tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:11.859694 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b919e18c-34a3-4e52-9747-feb31c9465ad tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:11.860104 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b919e18c-34a3-4e52-9747-feb31c9465ad tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:12.059506 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5b3594dd-d56f-489f-bd41-4a2ee6009ec9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:12.068195 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5b3594dd-d56f-489f-bd41-4a2ee6009ec9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.252307 Aug 04 23:14:12.068933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 109/222] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:11 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:12.077159 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b919e18c-34a3-4e52-9747-feb31c9465ad tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:12.085036 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b919e18c-34a3-4e52-9747-feb31c9465ad tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.241197 Aug 04 23:14:12.085930 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 114/223] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:11 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:12.820922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2f392fb7-708a-476e-80cf-304cf18fad2f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:12.821547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2f392fb7-708a-476e-80cf-304cf18fad2f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:12.828305 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f392fb7-708a-476e-80cf-304cf18fad2f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:12.828767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f392fb7-708a-476e-80cf-304cf18fad2f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:12.829193 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f392fb7-708a-476e-80cf-304cf18fad2f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:12.829963 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f392fb7-708a-476e-80cf-304cf18fad2f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:12.830430 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f392fb7-708a-476e-80cf-304cf18fad2f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:12.830846 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f392fb7-708a-476e-80cf-304cf18fad2f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:12.851721 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-793c6e8e-19ac-47cc-8919-ad5aaef57477 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:12.852871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-793c6e8e-19ac-47cc-8919-ad5aaef57477 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:12.859582 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-793c6e8e-19ac-47cc-8919-ad5aaef57477 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:12.860383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-793c6e8e-19ac-47cc-8919-ad5aaef57477 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:12.861204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-793c6e8e-19ac-47cc-8919-ad5aaef57477 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:12.862302 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-793c6e8e-19ac-47cc-8919-ad5aaef57477 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:12.863013 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-793c6e8e-19ac-47cc-8919-ad5aaef57477 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:12.863761 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-793c6e8e-19ac-47cc-8919-ad5aaef57477 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:13.047158 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2f392fb7-708a-476e-80cf-304cf18fad2f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:13.051695 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-793c6e8e-19ac-47cc-8919-ad5aaef57477 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:13.054642 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2f392fb7-708a-476e-80cf-304cf18fad2f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.237653 Aug 04 23:14:13.055205 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 110/224] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:12 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:13.060853 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-793c6e8e-19ac-47cc-8919-ad5aaef57477 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:13.062387 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-793c6e8e-19ac-47cc-8919-ad5aaef57477 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:13.063489 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-793c6e8e-19ac-47cc-8919-ad5aaef57477 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.217790 Aug 04 23:14:13.064027 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 115/225] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:12 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:14:13.097623 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-419d6cca-1be6-4c05-a76c-76495f074884 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:13.098252 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-419d6cca-1be6-4c05-a76c-76495f074884 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:13.104767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-419d6cca-1be6-4c05-a76c-76495f074884 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:13.105295 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-419d6cca-1be6-4c05-a76c-76495f074884 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:13.105720 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-419d6cca-1be6-4c05-a76c-76495f074884 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:13.106411 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-419d6cca-1be6-4c05-a76c-76495f074884 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:13.106856 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-419d6cca-1be6-4c05-a76c-76495f074884 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:13.107264 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-419d6cca-1be6-4c05-a76c-76495f074884 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:13.107360 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7a5fa4e4-c7fd-4a83-8b5a-a07fbbc680d3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:13.107871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7a5fa4e4-c7fd-4a83-8b5a-a07fbbc680d3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:13.113666 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a5fa4e4-c7fd-4a83-8b5a-a07fbbc680d3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:13.114137 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a5fa4e4-c7fd-4a83-8b5a-a07fbbc680d3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:13.114595 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a5fa4e4-c7fd-4a83-8b5a-a07fbbc680d3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:13.115268 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a5fa4e4-c7fd-4a83-8b5a-a07fbbc680d3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:13.115723 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a5fa4e4-c7fd-4a83-8b5a-a07fbbc680d3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:13.116114 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a5fa4e4-c7fd-4a83-8b5a-a07fbbc680d3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:13.350907 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-419d6cca-1be6-4c05-a76c-76495f074884 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:13.352875 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7a5fa4e4-c7fd-4a83-8b5a-a07fbbc680d3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:13.361462 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-419d6cca-1be6-4c05-a76c-76495f074884 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.267654 Aug 04 23:14:13.362221 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 111/226] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:13 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:13.364284 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7a5fa4e4-c7fd-4a83-8b5a-a07fbbc680d3 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.262142 Aug 04 23:14:13.365401 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 116/227] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:13 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:14.076704 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-45faea68-27be-4bad-a253-b4e8a5941fb5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:14.077311 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-45faea68-27be-4bad-a253-b4e8a5941fb5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:14.083416 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-45faea68-27be-4bad-a253-b4e8a5941fb5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:14.083893 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-45faea68-27be-4bad-a253-b4e8a5941fb5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:14.084318 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-45faea68-27be-4bad-a253-b4e8a5941fb5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:14.085003 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-45faea68-27be-4bad-a253-b4e8a5941fb5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:14.085391 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-08bb862a-2f52-48c0-989b-a51ce1df7bb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:14.086085 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-45faea68-27be-4bad-a253-b4e8a5941fb5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:14.086175 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-45faea68-27be-4bad-a253-b4e8a5941fb5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:14.086253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-08bb862a-2f52-48c0-989b-a51ce1df7bb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:14.088050 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:14:14.094969 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-08bb862a-2f52-48c0-989b-a51ce1df7bb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:14.096129 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-08bb862a-2f52-48c0-989b-a51ce1df7bb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:14.096561 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-08bb862a-2f52-48c0-989b-a51ce1df7bb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:14.097252 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-08bb862a-2f52-48c0-989b-a51ce1df7bb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:14.097688 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-08bb862a-2f52-48c0-989b-a51ce1df7bb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:14.098095 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-08bb862a-2f52-48c0-989b-a51ce1df7bb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:14.283538 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-45faea68-27be-4bad-a253-b4e8a5941fb5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:14.291028 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-45faea68-27be-4bad-a253-b4e8a5941fb5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1366 microversion: 2.1 time: 0.219068 Aug 04 23:14:14.292594 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 112/228] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:14 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:14.295294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-08bb862a-2f52-48c0-989b-a51ce1df7bb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:14.303336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-08bb862a-2f52-48c0-989b-a51ce1df7bb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:14.304841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-08bb862a-2f52-48c0-989b-a51ce1df7bb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:14.305929 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-08bb862a-2f52-48c0-989b-a51ce1df7bb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.224370 Aug 04 23:14:14.306499 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 117/229] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:14 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:14:14.383584 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ea443bef-4fa8-470a-89a2-2bebe7864d2e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:14.384377 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ea443bef-4fa8-470a-89a2-2bebe7864d2e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:14.392021 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea443bef-4fa8-470a-89a2-2bebe7864d2e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:14.392602 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea443bef-4fa8-470a-89a2-2bebe7864d2e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:14.393132 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea443bef-4fa8-470a-89a2-2bebe7864d2e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:14.394008 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea443bef-4fa8-470a-89a2-2bebe7864d2e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:14.394584 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea443bef-4fa8-470a-89a2-2bebe7864d2e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:14.395100 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea443bef-4fa8-470a-89a2-2bebe7864d2e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:14.395899 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-aa12504d-0a29-44c9-abeb-7db20e2c117c tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:14.400628 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-aa12504d-0a29-44c9-abeb-7db20e2c117c tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:14.410227 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa12504d-0a29-44c9-abeb-7db20e2c117c tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:14.410752 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa12504d-0a29-44c9-abeb-7db20e2c117c tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:14.411185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa12504d-0a29-44c9-abeb-7db20e2c117c tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:14.411893 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa12504d-0a29-44c9-abeb-7db20e2c117c tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:14.412335 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa12504d-0a29-44c9-abeb-7db20e2c117c tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:14.412752 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa12504d-0a29-44c9-abeb-7db20e2c117c tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:14.628364 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ea443bef-4fa8-470a-89a2-2bebe7864d2e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:14.637345 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-aa12504d-0a29-44c9-abeb-7db20e2c117c tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:14.640518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ea443bef-4fa8-470a-89a2-2bebe7864d2e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.261214 Aug 04 23:14:14.645759 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 113/230] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:14 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:14.652250 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-aa12504d-0a29-44c9-abeb-7db20e2c117c tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.267842 Aug 04 23:14:14.653007 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 118/231] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:14 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:15.312403 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-61cc48fb-e6c6-41db-8290-371e28709635 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:15.313011 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-61cc48fb-e6c6-41db-8290-371e28709635 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:15.319187 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-61cc48fb-e6c6-41db-8290-371e28709635 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:15.319672 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-61cc48fb-e6c6-41db-8290-371e28709635 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:15.320098 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-61cc48fb-e6c6-41db-8290-371e28709635 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:15.320783 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-61cc48fb-e6c6-41db-8290-371e28709635 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:15.321236 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-61cc48fb-e6c6-41db-8290-371e28709635 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:15.321653 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-61cc48fb-e6c6-41db-8290-371e28709635 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:15.328727 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-17227c24-70ad-4d9c-904b-104af77140b2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:15.329295 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-17227c24-70ad-4d9c-904b-104af77140b2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:15.335372 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17227c24-70ad-4d9c-904b-104af77140b2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:15.336118 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17227c24-70ad-4d9c-904b-104af77140b2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:15.336544 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17227c24-70ad-4d9c-904b-104af77140b2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:15.337234 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17227c24-70ad-4d9c-904b-104af77140b2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:15.337684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17227c24-70ad-4d9c-904b-104af77140b2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:15.338096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17227c24-70ad-4d9c-904b-104af77140b2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:15.539885 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-61cc48fb-e6c6-41db-8290-371e28709635 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:15.548353 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-61cc48fb-e6c6-41db-8290-371e28709635 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1556 microversion: 2.1 time: 0.239754 Aug 04 23:14:15.548818 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-17227c24-70ad-4d9c-904b-104af77140b2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:15.559819 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-17227c24-70ad-4d9c-904b-104af77140b2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:15.561794 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-17227c24-70ad-4d9c-904b-104af77140b2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:15.562576 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-17227c24-70ad-4d9c-904b-104af77140b2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.237754 Aug 04 23:14:15.565835 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 114/232] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:15 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1556 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:15.571656 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-df1aadc9-dd05-4b03-a310-60b853b0aa66 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:15.572435 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-df1aadc9-dd05-4b03-a310-60b853b0aa66 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:15.579006 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 119/233] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:15 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:14:15.579301 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-df1aadc9-dd05-4b03-a310-60b853b0aa66 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:15.579990 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-df1aadc9-dd05-4b03-a310-60b853b0aa66 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:15.580607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-df1aadc9-dd05-4b03-a310-60b853b0aa66 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:15.581407 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-df1aadc9-dd05-4b03-a310-60b853b0aa66 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:15.581949 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-df1aadc9-dd05-4b03-a310-60b853b0aa66 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:15.582655 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-df1aadc9-dd05-4b03-a310-60b853b0aa66 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:15.665599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-10ccc60f-4cf0-415c-9b70-dba9e8829771 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:15.666215 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-10ccc60f-4cf0-415c-9b70-dba9e8829771 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:15.674300 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10ccc60f-4cf0-415c-9b70-dba9e8829771 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:15.674814 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10ccc60f-4cf0-415c-9b70-dba9e8829771 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:15.675246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10ccc60f-4cf0-415c-9b70-dba9e8829771 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:15.676006 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10ccc60f-4cf0-415c-9b70-dba9e8829771 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:15.676393 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10ccc60f-4cf0-415c-9b70-dba9e8829771 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:15.676810 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10ccc60f-4cf0-415c-9b70-dba9e8829771 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:15.799697 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-df1aadc9-dd05-4b03-a310-60b853b0aa66 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.231542 Aug 04 23:14:15.801387 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 115/234] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Aug 4 23:14:15 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/os-interface => generated 284 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:14:15.810539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5580f02d-5d1f-4ad0-9c2c-bb2a0070db18 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:15.811273 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5580f02d-5d1f-4ad0-9c2c-bb2a0070db18 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:15.838207 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5580f02d-5d1f-4ad0-9c2c-bb2a0070db18 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:15.839895 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5580f02d-5d1f-4ad0-9c2c-bb2a0070db18 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:15.840779 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5580f02d-5d1f-4ad0-9c2c-bb2a0070db18 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:15.842491 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5580f02d-5d1f-4ad0-9c2c-bb2a0070db18 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:15.843480 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5580f02d-5d1f-4ad0-9c2c-bb2a0070db18 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:15.844439 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5580f02d-5d1f-4ad0-9c2c-bb2a0070db18 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:16.239185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-10ccc60f-4cf0-415c-9b70-dba9e8829771 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:16.265307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-10ccc60f-4cf0-415c-9b70-dba9e8829771 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.603848 Aug 04 23:14:16.266900 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 120/235] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:15 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:16.328186 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5580f02d-5d1f-4ad0-9c2c-bb2a0070db18 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:16.337752 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5580f02d-5d1f-4ad0-9c2c-bb2a0070db18 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1314 microversion: 2.1 time: 0.535043 Aug 04 23:14:16.338416 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 116/236] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:15 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:16.591114 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-92475c09-665d-48da-b20d-e953e1ef6f72 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:16.591828 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-92475c09-665d-48da-b20d-e953e1ef6f72 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:16.599529 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92475c09-665d-48da-b20d-e953e1ef6f72 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:16.600252 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92475c09-665d-48da-b20d-e953e1ef6f72 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:16.601085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92475c09-665d-48da-b20d-e953e1ef6f72 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:16.601974 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92475c09-665d-48da-b20d-e953e1ef6f72 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:16.602797 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92475c09-665d-48da-b20d-e953e1ef6f72 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:16.603366 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92475c09-665d-48da-b20d-e953e1ef6f72 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:17.176614 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-92475c09-665d-48da-b20d-e953e1ef6f72 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:17.201479 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-92475c09-665d-48da-b20d-e953e1ef6f72 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:17.215412 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-92475c09-665d-48da-b20d-e953e1ef6f72 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:17.219024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-92475c09-665d-48da-b20d-e953e1ef6f72 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.637824 Aug 04 23:14:17.219892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 121/237] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:16 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:14:17.305240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-dc581c54-7701-45bc-95f6-8060b1ef2664 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:17.306418 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-dc581c54-7701-45bc-95f6-8060b1ef2664 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:17.317816 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dc581c54-7701-45bc-95f6-8060b1ef2664 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:17.319470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dc581c54-7701-45bc-95f6-8060b1ef2664 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:17.320430 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dc581c54-7701-45bc-95f6-8060b1ef2664 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:17.322135 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dc581c54-7701-45bc-95f6-8060b1ef2664 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:17.324250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dc581c54-7701-45bc-95f6-8060b1ef2664 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:17.325030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dc581c54-7701-45bc-95f6-8060b1ef2664 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:17.330338 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:14:17.365557 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4127eed4-3d06-48c8-92e6-fa4a7f1431db tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:17.367114 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4127eed4-3d06-48c8-92e6-fa4a7f1431db tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:17.378657 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4127eed4-3d06-48c8-92e6-fa4a7f1431db tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:17.379520 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4127eed4-3d06-48c8-92e6-fa4a7f1431db tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:17.380288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4127eed4-3d06-48c8-92e6-fa4a7f1431db tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:17.381743 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4127eed4-3d06-48c8-92e6-fa4a7f1431db tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:17.382898 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4127eed4-3d06-48c8-92e6-fa4a7f1431db tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:17.384666 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4127eed4-3d06-48c8-92e6-fa4a7f1431db tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:17.647408 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-dc581c54-7701-45bc-95f6-8060b1ef2664 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:17.656292 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-dc581c54-7701-45bc-95f6-8060b1ef2664 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.358085 Aug 04 23:14:17.669446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 117/238] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:17 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:17.689717 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4127eed4-3d06-48c8-92e6-fa4a7f1431db tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:17.700553 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4127eed4-3d06-48c8-92e6-fa4a7f1431db tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1500 microversion: 2.1 time: 0.341537 Aug 04 23:14:17.701973 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 122/239] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:17 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1500 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:17.892382 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-10cea4b7-2577-426d-ae23-de794afcd7c9 req-6644ea5b-71bc-4912-ae1b-d5b7f86fd8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "852287f5-010e-4d74-a6ef-a4bf2f47c477", "tag": "f5be5be8-6bc4-4f6a-910d-b8fbf2981502"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:14:17.906051 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-10cea4b7-2577-426d-ae23-de794afcd7c9 req-6644ea5b-71bc-4912-ae1b-d5b7f86fd8a6 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:17.906998 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-10cea4b7-2577-426d-ae23-de794afcd7c9 req-6644ea5b-71bc-4912-ae1b-d5b7f86fd8a6 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:17.908004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-10cea4b7-2577-426d-ae23-de794afcd7c9 req-6644ea5b-71bc-4912-ae1b-d5b7f86fd8a6 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:17.924307 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-10cea4b7-2577-426d-ae23-de794afcd7c9 req-6644ea5b-71bc-4912-ae1b-d5b7f86fd8a6 service nova] Creating event network-changed:f5be5be8-6bc4-4f6a-910d-b8fbf2981502 for instance 852287f5-010e-4d74-a6ef-a4bf2f47c477 on hv-cinder-85221 Aug 04 23:14:17.930666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-10cea4b7-2577-426d-ae23-de794afcd7c9 req-6644ea5b-71bc-4912-ae1b-d5b7f86fd8a6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044377 Aug 04 23:14:17.931254 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 118/240] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:14:18.262628 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5583a8b8-8dc7-4491-a4a5-a4f1d388fb22 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:18.263147 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5583a8b8-8dc7-4491-a4a5-a4f1d388fb22 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:18.271033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5583a8b8-8dc7-4491-a4a5-a4f1d388fb22 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:18.271511 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5583a8b8-8dc7-4491-a4a5-a4f1d388fb22 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:18.271932 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5583a8b8-8dc7-4491-a4a5-a4f1d388fb22 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:18.272651 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5583a8b8-8dc7-4491-a4a5-a4f1d388fb22 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:18.273094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5583a8b8-8dc7-4491-a4a5-a4f1d388fb22 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:18.273507 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5583a8b8-8dc7-4491-a4a5-a4f1d388fb22 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:18.437567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5583a8b8-8dc7-4491-a4a5-a4f1d388fb22 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:18.447505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5583a8b8-8dc7-4491-a4a5-a4f1d388fb22 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:18.449796 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5583a8b8-8dc7-4491-a4a5-a4f1d388fb22 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:18.451782 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5583a8b8-8dc7-4491-a4a5-a4f1d388fb22 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.194519 Aug 04 23:14:18.452829 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 123/241] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:18 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:14:18.680230 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e124d0c3-f684-481a-b88f-266f2b94fcfd tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:18.681683 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e124d0c3-f684-481a-b88f-266f2b94fcfd tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:18.688618 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e124d0c3-f684-481a-b88f-266f2b94fcfd tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:18.689660 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e124d0c3-f684-481a-b88f-266f2b94fcfd tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:18.690286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e124d0c3-f684-481a-b88f-266f2b94fcfd tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:18.690983 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e124d0c3-f684-481a-b88f-266f2b94fcfd tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:18.691615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e124d0c3-f684-481a-b88f-266f2b94fcfd tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:18.692245 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e124d0c3-f684-481a-b88f-266f2b94fcfd tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:18.856675 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e124d0c3-f684-481a-b88f-266f2b94fcfd tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:18.871803 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e124d0c3-f684-481a-b88f-266f2b94fcfd tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.195830 Aug 04 23:14:18.872919 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 119/242] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:18 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:19.479235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d82c4666-d01c-48de-9ad2-8e0fe6df8b4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:19.479967 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d82c4666-d01c-48de-9ad2-8e0fe6df8b4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:19.485964 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d82c4666-d01c-48de-9ad2-8e0fe6df8b4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:19.486465 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d82c4666-d01c-48de-9ad2-8e0fe6df8b4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:19.486914 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d82c4666-d01c-48de-9ad2-8e0fe6df8b4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:19.487639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d82c4666-d01c-48de-9ad2-8e0fe6df8b4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:19.488063 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d82c4666-d01c-48de-9ad2-8e0fe6df8b4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:19.488472 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d82c4666-d01c-48de-9ad2-8e0fe6df8b4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:19.627438 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d82c4666-d01c-48de-9ad2-8e0fe6df8b4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:19.635579 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d82c4666-d01c-48de-9ad2-8e0fe6df8b4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:19.637799 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d82c4666-d01c-48de-9ad2-8e0fe6df8b4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:19.638930 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d82c4666-d01c-48de-9ad2-8e0fe6df8b4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.163648 Aug 04 23:14:19.639492 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 124/243] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:19 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:14:19.893159 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-31a1ef26-e9a5-4267-b418-b4ddec112126 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:19.893811 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-31a1ef26-e9a5-4267-b418-b4ddec112126 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:19.900303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-31a1ef26-e9a5-4267-b418-b4ddec112126 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:19.900791 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-31a1ef26-e9a5-4267-b418-b4ddec112126 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:19.901370 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-31a1ef26-e9a5-4267-b418-b4ddec112126 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:19.902870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-31a1ef26-e9a5-4267-b418-b4ddec112126 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:19.903302 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-31a1ef26-e9a5-4267-b418-b4ddec112126 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:19.903576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-31a1ef26-e9a5-4267-b418-b4ddec112126 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:20.066187 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-31a1ef26-e9a5-4267-b418-b4ddec112126 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:20.075236 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-31a1ef26-e9a5-4267-b418-b4ddec112126 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.185765 Aug 04 23:14:20.075759 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 120/244] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:19 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:20.661353 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4746913f-eac4-441b-a7af-4f50746a4151 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:20.662094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4746913f-eac4-441b-a7af-4f50746a4151 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:20.670901 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4746913f-eac4-441b-a7af-4f50746a4151 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:20.671440 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4746913f-eac4-441b-a7af-4f50746a4151 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:20.671904 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4746913f-eac4-441b-a7af-4f50746a4151 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:20.672632 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4746913f-eac4-441b-a7af-4f50746a4151 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:20.673138 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4746913f-eac4-441b-a7af-4f50746a4151 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:20.673690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4746913f-eac4-441b-a7af-4f50746a4151 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:20.815571 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4746913f-eac4-441b-a7af-4f50746a4151 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:20.824992 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4746913f-eac4-441b-a7af-4f50746a4151 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:20.826533 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4746913f-eac4-441b-a7af-4f50746a4151 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:20.827645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4746913f-eac4-441b-a7af-4f50746a4151 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.170426 Aug 04 23:14:20.828206 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 125/245] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:20 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:14:21.096508 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-eaec49b2-4b16-46a1-bbae-ee5ce0b72b90 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:21.097017 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-eaec49b2-4b16-46a1-bbae-ee5ce0b72b90 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:21.103278 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eaec49b2-4b16-46a1-bbae-ee5ce0b72b90 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:21.103760 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eaec49b2-4b16-46a1-bbae-ee5ce0b72b90 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:21.104187 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eaec49b2-4b16-46a1-bbae-ee5ce0b72b90 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:21.104948 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eaec49b2-4b16-46a1-bbae-ee5ce0b72b90 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:21.105423 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eaec49b2-4b16-46a1-bbae-ee5ce0b72b90 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:21.105817 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eaec49b2-4b16-46a1-bbae-ee5ce0b72b90 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:21.244843 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-eaec49b2-4b16-46a1-bbae-ee5ce0b72b90 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:21.254599 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-eaec49b2-4b16-46a1-bbae-ee5ce0b72b90 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.161958 Aug 04 23:14:21.255215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 121/246] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:21 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:21.850914 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2164606a-69a7-4a68-8b4a-80a3b6309acc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:21.851505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2164606a-69a7-4a68-8b4a-80a3b6309acc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:21.857791 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2164606a-69a7-4a68-8b4a-80a3b6309acc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:21.858267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2164606a-69a7-4a68-8b4a-80a3b6309acc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:21.858739 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2164606a-69a7-4a68-8b4a-80a3b6309acc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:21.859418 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2164606a-69a7-4a68-8b4a-80a3b6309acc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:21.859866 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2164606a-69a7-4a68-8b4a-80a3b6309acc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:21.860278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2164606a-69a7-4a68-8b4a-80a3b6309acc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:21.879102 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:14:21.990544 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2164606a-69a7-4a68-8b4a-80a3b6309acc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:21.999660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2164606a-69a7-4a68-8b4a-80a3b6309acc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:22.001141 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2164606a-69a7-4a68-8b4a-80a3b6309acc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:22.002233 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2164606a-69a7-4a68-8b4a-80a3b6309acc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.155275 Aug 04 23:14:22.002814 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 126/247] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:21 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:14:22.277152 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6e9caa48-b546-4066-a768-6ece0520fd09 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:22.278317 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6e9caa48-b546-4066-a768-6ece0520fd09 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:22.290514 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e9caa48-b546-4066-a768-6ece0520fd09 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:22.291531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e9caa48-b546-4066-a768-6ece0520fd09 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:22.292966 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e9caa48-b546-4066-a768-6ece0520fd09 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:22.294550 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e9caa48-b546-4066-a768-6ece0520fd09 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:22.295281 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e9caa48-b546-4066-a768-6ece0520fd09 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:22.296043 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e9caa48-b546-4066-a768-6ece0520fd09 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:22.463424 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6e9caa48-b546-4066-a768-6ece0520fd09 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:22.472062 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6e9caa48-b546-4066-a768-6ece0520fd09 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1322 microversion: 2.1 time: 0.199373 Aug 04 23:14:22.472638 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 122/248] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:22 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:23.026175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c2cb0502-063c-41ac-a283-a5d1101ff63b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:23.027696 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c2cb0502-063c-41ac-a283-a5d1101ff63b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:23.034669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c2cb0502-063c-41ac-a283-a5d1101ff63b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:23.035150 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c2cb0502-063c-41ac-a283-a5d1101ff63b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:23.035769 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c2cb0502-063c-41ac-a283-a5d1101ff63b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:23.036468 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c2cb0502-063c-41ac-a283-a5d1101ff63b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:23.036913 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c2cb0502-063c-41ac-a283-a5d1101ff63b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:23.037421 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c2cb0502-063c-41ac-a283-a5d1101ff63b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:23.228876 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c2cb0502-063c-41ac-a283-a5d1101ff63b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:23.240061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c2cb0502-063c-41ac-a283-a5d1101ff63b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:23.241724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c2cb0502-063c-41ac-a283-a5d1101ff63b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:23.243557 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c2cb0502-063c-41ac-a283-a5d1101ff63b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.221293 Aug 04 23:14:23.255400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 127/249] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:23 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:14:23.494249 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-23337942-a383-47ce-a621-e013cbd157a4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:23.495100 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-23337942-a383-47ce-a621-e013cbd157a4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:23.502633 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23337942-a383-47ce-a621-e013cbd157a4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:23.503324 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23337942-a383-47ce-a621-e013cbd157a4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:23.504029 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23337942-a383-47ce-a621-e013cbd157a4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:23.504840 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23337942-a383-47ce-a621-e013cbd157a4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:23.505399 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23337942-a383-47ce-a621-e013cbd157a4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:23.505924 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23337942-a383-47ce-a621-e013cbd157a4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:23.524635 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7cd27c6a-ea03-415a-ad1d-d8dadf7e858e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "298eabd6-ed08-42e0-8ffa-b13072914445"}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:14:23.527388 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7cd27c6a-ea03-415a-ad1d-d8dadf7e858e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:23.535783 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7cd27c6a-ea03-415a-ad1d-d8dadf7e858e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:23.535783 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7cd27c6a-ea03-415a-ad1d-d8dadf7e858e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:23.535783 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7cd27c6a-ea03-415a-ad1d-d8dadf7e858e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:23.537674 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7cd27c6a-ea03-415a-ad1d-d8dadf7e858e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:23.538155 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7cd27c6a-ea03-415a-ad1d-d8dadf7e858e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:23.538653 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7cd27c6a-ea03-415a-ad1d-d8dadf7e858e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:23.697581 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-23337942-a383-47ce-a621-e013cbd157a4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:23.707639 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-23337942-a383-47ce-a621-e013cbd157a4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1516 microversion: 2.1 time: 0.217161 Aug 04 23:14:23.708288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 123/250] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:23 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1516 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:23.731768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-473a00af-5248-4fe8-a38c-9beb72dc0064 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:14:23.736437 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-473a00af-5248-4fe8-a38c-9beb72dc0064 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:23.743074 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-473a00af-5248-4fe8-a38c-9beb72dc0064 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:23.743942 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-473a00af-5248-4fe8-a38c-9beb72dc0064 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:23.744452 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-473a00af-5248-4fe8-a38c-9beb72dc0064 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:23.745317 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-473a00af-5248-4fe8-a38c-9beb72dc0064 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:23.747128 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-473a00af-5248-4fe8-a38c-9beb72dc0064 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:23.747701 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-473a00af-5248-4fe8-a38c-9beb72dc0064 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:23.780545 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.objects.instance [None req-473a00af-5248-4fe8-a38c-9beb72dc0064 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lazy-loading 'flavor' on Instance uuid 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 {{(pid=129791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:14:23.932472 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-473a00af-5248-4fe8-a38c-9beb72dc0064 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "POST /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9/action" status: 200 len: 32 microversion: 2.1 time: 0.206185 Aug 04 23:14:23.947098 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 124/251] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Aug 4 23:14:23 2022] POST /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9/action => generated 32 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 23:14:23.953095 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-887c130a-8d72-43e2-a8fa-877935d9182d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:23.953805 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-887c130a-8d72-43e2-a8fa-877935d9182d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:23.960977 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-887c130a-8d72-43e2-a8fa-877935d9182d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:23.961491 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-887c130a-8d72-43e2-a8fa-877935d9182d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:23.962103 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-887c130a-8d72-43e2-a8fa-877935d9182d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:23.962865 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-887c130a-8d72-43e2-a8fa-877935d9182d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:23.963412 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-887c130a-8d72-43e2-a8fa-877935d9182d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:23.963924 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-887c130a-8d72-43e2-a8fa-877935d9182d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:24.131712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-887c130a-8d72-43e2-a8fa-877935d9182d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:24.140600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-887c130a-8d72-43e2-a8fa-877935d9182d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.201237 Aug 04 23:14:24.141185 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 125/252] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:23 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:24.268283 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f0ac1547-ded3-4cb2-9c6c-acdd1cc7f075 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:24.268891 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f0ac1547-ded3-4cb2-9c6c-acdd1cc7f075 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:24.270844 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=92 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:14:24.276042 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f0ac1547-ded3-4cb2-9c6c-acdd1cc7f075 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:24.276521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f0ac1547-ded3-4cb2-9c6c-acdd1cc7f075 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:24.277704 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f0ac1547-ded3-4cb2-9c6c-acdd1cc7f075 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:24.278445 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f0ac1547-ded3-4cb2-9c6c-acdd1cc7f075 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:24.278905 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f0ac1547-ded3-4cb2-9c6c-acdd1cc7f075 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:24.279331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f0ac1547-ded3-4cb2-9c6c-acdd1cc7f075 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:24.418996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f0ac1547-ded3-4cb2-9c6c-acdd1cc7f075 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:24.427080 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f0ac1547-ded3-4cb2-9c6c-acdd1cc7f075 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:24.428671 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f0ac1547-ded3-4cb2-9c6c-acdd1cc7f075 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:24.429756 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f0ac1547-ded3-4cb2-9c6c-acdd1cc7f075 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.165303 Aug 04 23:14:24.430306 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 126/253] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:24 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:14:25.161587 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-daf72af6-5bf0-42c8-af16-acc940345b0e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:25.162332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-daf72af6-5bf0-42c8-af16-acc940345b0e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:25.169788 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-daf72af6-5bf0-42c8-af16-acc940345b0e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:25.170765 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-daf72af6-5bf0-42c8-af16-acc940345b0e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:25.171475 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-daf72af6-5bf0-42c8-af16-acc940345b0e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:25.172262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-daf72af6-5bf0-42c8-af16-acc940345b0e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:25.172927 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-daf72af6-5bf0-42c8-af16-acc940345b0e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:25.173564 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-daf72af6-5bf0-42c8-af16-acc940345b0e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:25.354155 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-daf72af6-5bf0-42c8-af16-acc940345b0e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:25.364343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-daf72af6-5bf0-42c8-af16-acc940345b0e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.207137 Aug 04 23:14:25.365008 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 127/254] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:25 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:25.453408 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-bd367798-ee2e-46f0-8f1b-e83c059cab6c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:25.454172 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-bd367798-ee2e-46f0-8f1b-e83c059cab6c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:25.460410 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd367798-ee2e-46f0-8f1b-e83c059cab6c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:25.461147 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd367798-ee2e-46f0-8f1b-e83c059cab6c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:25.461574 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd367798-ee2e-46f0-8f1b-e83c059cab6c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:25.462974 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd367798-ee2e-46f0-8f1b-e83c059cab6c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:25.463485 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd367798-ee2e-46f0-8f1b-e83c059cab6c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:25.463901 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd367798-ee2e-46f0-8f1b-e83c059cab6c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:25.631621 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-bd367798-ee2e-46f0-8f1b-e83c059cab6c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:25.640835 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-bd367798-ee2e-46f0-8f1b-e83c059cab6c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:25.642497 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-bd367798-ee2e-46f0-8f1b-e83c059cab6c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:25.643627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-bd367798-ee2e-46f0-8f1b-e83c059cab6c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.194369 Aug 04 23:14:25.644423 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 128/255] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:25 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:14:26.387680 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-56514d24-ad9f-4526-ae55-4c40e1666ff5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:26.388351 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-56514d24-ad9f-4526-ae55-4c40e1666ff5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:26.394399 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-56514d24-ad9f-4526-ae55-4c40e1666ff5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:26.394888 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-56514d24-ad9f-4526-ae55-4c40e1666ff5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:26.395312 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-56514d24-ad9f-4526-ae55-4c40e1666ff5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:26.396000 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-56514d24-ad9f-4526-ae55-4c40e1666ff5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:26.396495 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-56514d24-ad9f-4526-ae55-4c40e1666ff5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:26.396912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-56514d24-ad9f-4526-ae55-4c40e1666ff5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:26.531372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-56514d24-ad9f-4526-ae55-4c40e1666ff5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:26.539763 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-56514d24-ad9f-4526-ae55-4c40e1666ff5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.157040 Aug 04 23:14:26.540341 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 129/256] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:26 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:26.666510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f204ba78-6a74-4123-bd8c-7766996f60a8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:26.667133 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f204ba78-6a74-4123-bd8c-7766996f60a8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:26.673850 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f204ba78-6a74-4123-bd8c-7766996f60a8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:26.674336 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f204ba78-6a74-4123-bd8c-7766996f60a8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:26.674800 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f204ba78-6a74-4123-bd8c-7766996f60a8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:26.675505 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f204ba78-6a74-4123-bd8c-7766996f60a8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:26.675954 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f204ba78-6a74-4123-bd8c-7766996f60a8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:26.676371 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f204ba78-6a74-4123-bd8c-7766996f60a8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:26.814040 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f204ba78-6a74-4123-bd8c-7766996f60a8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:26.822233 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f204ba78-6a74-4123-bd8c-7766996f60a8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:26.824461 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f204ba78-6a74-4123-bd8c-7766996f60a8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:26.825557 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f204ba78-6a74-4123-bd8c-7766996f60a8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.163109 Aug 04 23:14:26.826108 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 130/257] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:26 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:14:27.563334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1d211eef-bd3e-4707-8f1f-6a45033e6cd2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:27.564631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1d211eef-bd3e-4707-8f1f-6a45033e6cd2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:27.572519 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1d211eef-bd3e-4707-8f1f-6a45033e6cd2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:27.573136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1d211eef-bd3e-4707-8f1f-6a45033e6cd2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:27.573440 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1d211eef-bd3e-4707-8f1f-6a45033e6cd2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:27.574209 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1d211eef-bd3e-4707-8f1f-6a45033e6cd2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:27.574698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1d211eef-bd3e-4707-8f1f-6a45033e6cd2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:27.575121 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1d211eef-bd3e-4707-8f1f-6a45033e6cd2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:27.711997 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1d211eef-bd3e-4707-8f1f-6a45033e6cd2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:27.720168 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1d211eef-bd3e-4707-8f1f-6a45033e6cd2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.162243 Aug 04 23:14:27.720737 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 131/258] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:27 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:27.848832 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b0dfd4b7-eb8f-40cb-8bfa-938234272b9b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:27.849430 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b0dfd4b7-eb8f-40cb-8bfa-938234272b9b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:27.856521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b0dfd4b7-eb8f-40cb-8bfa-938234272b9b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:27.856998 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b0dfd4b7-eb8f-40cb-8bfa-938234272b9b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:27.857422 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b0dfd4b7-eb8f-40cb-8bfa-938234272b9b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:27.858105 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b0dfd4b7-eb8f-40cb-8bfa-938234272b9b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:27.858578 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b0dfd4b7-eb8f-40cb-8bfa-938234272b9b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:27.859000 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b0dfd4b7-eb8f-40cb-8bfa-938234272b9b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:27.874893 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:14:27.995832 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b0dfd4b7-eb8f-40cb-8bfa-938234272b9b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:28.004100 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b0dfd4b7-eb8f-40cb-8bfa-938234272b9b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:28.005612 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b0dfd4b7-eb8f-40cb-8bfa-938234272b9b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:28.006738 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b0dfd4b7-eb8f-40cb-8bfa-938234272b9b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.161845 Aug 04 23:14:28.007289 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 132/259] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:27 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:14:28.741190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1786fbae-2858-43ed-a147-fe6f5f7f8bd1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:28.741859 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1786fbae-2858-43ed-a147-fe6f5f7f8bd1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:28.749138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1786fbae-2858-43ed-a147-fe6f5f7f8bd1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:28.749613 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1786fbae-2858-43ed-a147-fe6f5f7f8bd1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:28.750040 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1786fbae-2858-43ed-a147-fe6f5f7f8bd1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:28.750768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1786fbae-2858-43ed-a147-fe6f5f7f8bd1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:28.751212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1786fbae-2858-43ed-a147-fe6f5f7f8bd1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:28.751631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1786fbae-2858-43ed-a147-fe6f5f7f8bd1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:28.899420 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1786fbae-2858-43ed-a147-fe6f5f7f8bd1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:28.907944 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1786fbae-2858-43ed-a147-fe6f5f7f8bd1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.170485 Aug 04 23:14:28.908519 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 133/260] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:28 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:29.028987 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fcc67e75-b2de-4f52-9424-c730015a474a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:29.029628 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-fcc67e75-b2de-4f52-9424-c730015a474a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:29.035676 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fcc67e75-b2de-4f52-9424-c730015a474a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:29.036156 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fcc67e75-b2de-4f52-9424-c730015a474a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:29.036584 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fcc67e75-b2de-4f52-9424-c730015a474a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:29.037281 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fcc67e75-b2de-4f52-9424-c730015a474a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:29.037728 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fcc67e75-b2de-4f52-9424-c730015a474a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:29.038145 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fcc67e75-b2de-4f52-9424-c730015a474a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:29.176579 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fcc67e75-b2de-4f52-9424-c730015a474a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:29.185549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fcc67e75-b2de-4f52-9424-c730015a474a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:29.187072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fcc67e75-b2de-4f52-9424-c730015a474a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:29.188165 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-fcc67e75-b2de-4f52-9424-c730015a474a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.163233 Aug 04 23:14:29.188716 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 134/261] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:29 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:14:29.931040 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-66b2e96e-8a2f-4011-a7c3-4f12403f2513 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:29.931669 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-66b2e96e-8a2f-4011-a7c3-4f12403f2513 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:29.938561 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66b2e96e-8a2f-4011-a7c3-4f12403f2513 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:29.939035 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66b2e96e-8a2f-4011-a7c3-4f12403f2513 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:29.939456 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66b2e96e-8a2f-4011-a7c3-4f12403f2513 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:29.940146 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66b2e96e-8a2f-4011-a7c3-4f12403f2513 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:29.940584 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66b2e96e-8a2f-4011-a7c3-4f12403f2513 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:29.941128 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66b2e96e-8a2f-4011-a7c3-4f12403f2513 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:30.095860 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-66b2e96e-8a2f-4011-a7c3-4f12403f2513 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:30.104512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-66b2e96e-8a2f-4011-a7c3-4f12403f2513 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.177089 Aug 04 23:14:30.105247 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 135/262] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:29 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:30.210802 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a9ff2099-31e9-477d-a6ff-b2c00da34209 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:30.211662 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a9ff2099-31e9-477d-a6ff-b2c00da34209 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:30.218264 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a9ff2099-31e9-477d-a6ff-b2c00da34209 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:30.218264 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a9ff2099-31e9-477d-a6ff-b2c00da34209 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:30.218704 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a9ff2099-31e9-477d-a6ff-b2c00da34209 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:30.219333 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a9ff2099-31e9-477d-a6ff-b2c00da34209 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:30.219942 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a9ff2099-31e9-477d-a6ff-b2c00da34209 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:30.220302 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a9ff2099-31e9-477d-a6ff-b2c00da34209 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:30.370457 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a9ff2099-31e9-477d-a6ff-b2c00da34209 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:30.379750 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a9ff2099-31e9-477d-a6ff-b2c00da34209 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:30.381363 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a9ff2099-31e9-477d-a6ff-b2c00da34209 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:30.382488 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a9ff2099-31e9-477d-a6ff-b2c00da34209 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.175501 Aug 04 23:14:30.383044 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 136/263] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:30 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:14:31.127062 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-97cb3e5b-4ea8-4929-918c-46e3bae3bdcf tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:31.127687 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-97cb3e5b-4ea8-4929-918c-46e3bae3bdcf tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:31.133507 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97cb3e5b-4ea8-4929-918c-46e3bae3bdcf tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:31.133980 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97cb3e5b-4ea8-4929-918c-46e3bae3bdcf tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:31.134436 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97cb3e5b-4ea8-4929-918c-46e3bae3bdcf tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:31.135131 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97cb3e5b-4ea8-4929-918c-46e3bae3bdcf tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:31.135558 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97cb3e5b-4ea8-4929-918c-46e3bae3bdcf tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:31.135972 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97cb3e5b-4ea8-4929-918c-46e3bae3bdcf tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:31.268034 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-97cb3e5b-4ea8-4929-918c-46e3bae3bdcf tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:31.275396 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-97cb3e5b-4ea8-4929-918c-46e3bae3bdcf tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.152247 Aug 04 23:14:31.275951 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 137/264] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:31 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:31.405442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-92ba35c5-0989-40f8-ac52-a4a512e4a9ae tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:31.406052 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-92ba35c5-0989-40f8-ac52-a4a512e4a9ae tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:31.412190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-92ba35c5-0989-40f8-ac52-a4a512e4a9ae tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:31.412745 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-92ba35c5-0989-40f8-ac52-a4a512e4a9ae tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:31.413271 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-92ba35c5-0989-40f8-ac52-a4a512e4a9ae tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:31.414029 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-92ba35c5-0989-40f8-ac52-a4a512e4a9ae tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:31.414517 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-92ba35c5-0989-40f8-ac52-a4a512e4a9ae tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:31.414938 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-92ba35c5-0989-40f8-ac52-a4a512e4a9ae tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:31.557426 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-92ba35c5-0989-40f8-ac52-a4a512e4a9ae tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:31.566527 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-92ba35c5-0989-40f8-ac52-a4a512e4a9ae tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:31.568313 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-92ba35c5-0989-40f8-ac52-a4a512e4a9ae tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:31.569424 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-92ba35c5-0989-40f8-ac52-a4a512e4a9ae tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.168682 Aug 04 23:14:31.577972 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 138/265] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:31 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:14:32.296726 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-185666e7-dee3-4a95-aaab-7f38cf6dd927 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:32.297381 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-185666e7-dee3-4a95-aaab-7f38cf6dd927 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:32.303281 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-185666e7-dee3-4a95-aaab-7f38cf6dd927 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:32.303756 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-185666e7-dee3-4a95-aaab-7f38cf6dd927 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:32.304189 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-185666e7-dee3-4a95-aaab-7f38cf6dd927 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:32.304888 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-185666e7-dee3-4a95-aaab-7f38cf6dd927 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:32.305332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-185666e7-dee3-4a95-aaab-7f38cf6dd927 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:32.305755 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-185666e7-dee3-4a95-aaab-7f38cf6dd927 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:32.623041 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-185666e7-dee3-4a95-aaab-7f38cf6dd927 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:32.632700 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-185666e7-dee3-4a95-aaab-7f38cf6dd927 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.339721 Aug 04 23:14:32.633267 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 139/266] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:32 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:32.640182 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-333fb284-6ad6-4589-9708-b04d8daf9181 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:32.643415 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-333fb284-6ad6-4589-9708-b04d8daf9181 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:32.652035 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-333fb284-6ad6-4589-9708-b04d8daf9181 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:32.652664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-333fb284-6ad6-4589-9708-b04d8daf9181 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:32.653478 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-333fb284-6ad6-4589-9708-b04d8daf9181 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:32.654034 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-333fb284-6ad6-4589-9708-b04d8daf9181 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:32.654759 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-333fb284-6ad6-4589-9708-b04d8daf9181 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:32.655323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-333fb284-6ad6-4589-9708-b04d8daf9181 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:32.842437 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-333fb284-6ad6-4589-9708-b04d8daf9181 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:32.852842 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-333fb284-6ad6-4589-9708-b04d8daf9181 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:32.854394 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-333fb284-6ad6-4589-9708-b04d8daf9181 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:32.856293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-333fb284-6ad6-4589-9708-b04d8daf9181 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.220956 Aug 04 23:14:32.856968 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 140/267] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:32 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:14:33.535180 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=23 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:14:33.656562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3575b24a-35e5-4f93-9567-365a4af1ddbb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:33.657232 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3575b24a-35e5-4f93-9567-365a4af1ddbb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:33.664448 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3575b24a-35e5-4f93-9567-365a4af1ddbb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:33.665090 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3575b24a-35e5-4f93-9567-365a4af1ddbb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:33.665716 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3575b24a-35e5-4f93-9567-365a4af1ddbb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:33.666493 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3575b24a-35e5-4f93-9567-365a4af1ddbb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:33.666937 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3575b24a-35e5-4f93-9567-365a4af1ddbb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:33.667362 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3575b24a-35e5-4f93-9567-365a4af1ddbb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:33.708280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=14 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:14:33.828038 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3575b24a-35e5-4f93-9567-365a4af1ddbb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:33.846667 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3575b24a-35e5-4f93-9567-365a4af1ddbb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.195987 Aug 04 23:14:33.848897 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 141/268] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:33 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:33.878798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-52852faa-f3a7-459c-bd29-33a826693ee3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:33.885048 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-52852faa-f3a7-459c-bd29-33a826693ee3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:33.886391 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-52852faa-f3a7-459c-bd29-33a826693ee3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:33.887122 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-52852faa-f3a7-459c-bd29-33a826693ee3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:33.887560 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-52852faa-f3a7-459c-bd29-33a826693ee3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:33.888546 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-52852faa-f3a7-459c-bd29-33a826693ee3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:33.889109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-52852faa-f3a7-459c-bd29-33a826693ee3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:33.889557 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-52852faa-f3a7-459c-bd29-33a826693ee3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:34.053793 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-52852faa-f3a7-459c-bd29-33a826693ee3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:34.062032 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-52852faa-f3a7-459c-bd29-33a826693ee3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:34.063509 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-52852faa-f3a7-459c-bd29-33a826693ee3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:34.064602 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-52852faa-f3a7-459c-bd29-33a826693ee3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.189599 Aug 04 23:14:34.065481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 142/269] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:33 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:14:34.869953 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0a2f970b-bba1-4520-bcb0-f2cb0e73ada6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:34.870963 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0a2f970b-bba1-4520-bcb0-f2cb0e73ada6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:34.878263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0a2f970b-bba1-4520-bcb0-f2cb0e73ada6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:34.878806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0a2f970b-bba1-4520-bcb0-f2cb0e73ada6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:34.879232 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0a2f970b-bba1-4520-bcb0-f2cb0e73ada6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:34.880279 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0a2f970b-bba1-4520-bcb0-f2cb0e73ada6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:34.880912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0a2f970b-bba1-4520-bcb0-f2cb0e73ada6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:34.881593 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0a2f970b-bba1-4520-bcb0-f2cb0e73ada6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:35.030758 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0a2f970b-bba1-4520-bcb0-f2cb0e73ada6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:35.040308 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0a2f970b-bba1-4520-bcb0-f2cb0e73ada6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.174457 Aug 04 23:14:35.040874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 143/270] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:34 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:35.115036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3e676f5f-4601-4462-a0e2-b2358f05e654 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:35.115694 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3e676f5f-4601-4462-a0e2-b2358f05e654 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:35.124817 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e676f5f-4601-4462-a0e2-b2358f05e654 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:35.126328 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e676f5f-4601-4462-a0e2-b2358f05e654 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:35.128994 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e676f5f-4601-4462-a0e2-b2358f05e654 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:35.131410 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e676f5f-4601-4462-a0e2-b2358f05e654 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:35.132325 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e676f5f-4601-4462-a0e2-b2358f05e654 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:35.134071 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e676f5f-4601-4462-a0e2-b2358f05e654 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:35.326307 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3e676f5f-4601-4462-a0e2-b2358f05e654 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:35.336428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3e676f5f-4601-4462-a0e2-b2358f05e654 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:35.338261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3e676f5f-4601-4462-a0e2-b2358f05e654 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:35.340456 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3e676f5f-4601-4462-a0e2-b2358f05e654 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.242673 Aug 04 23:14:35.351648 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 144/271] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:35 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:14:35.483131 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7cd27c6a-ea03-415a-ad1d-d8dadf7e858e tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "POST /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.962467 Aug 04 23:14:35.484998 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 128/272] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Aug 4 23:14:23 2022] POST /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a/os-volume_attachments => generated 194 bytes in 11966 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:14:36.063583 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-23b4938c-407d-401c-ad94-7f5f0033fd9d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:36.064361 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-23b4938c-407d-401c-ad94-7f5f0033fd9d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:36.072272 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23b4938c-407d-401c-ad94-7f5f0033fd9d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:36.077686 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23b4938c-407d-401c-ad94-7f5f0033fd9d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:36.078539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23b4938c-407d-401c-ad94-7f5f0033fd9d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:36.079835 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23b4938c-407d-401c-ad94-7f5f0033fd9d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:36.081977 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23b4938c-407d-401c-ad94-7f5f0033fd9d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:36.082642 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23b4938c-407d-401c-ad94-7f5f0033fd9d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:36.264648 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-23b4938c-407d-401c-ad94-7f5f0033fd9d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:36.273311 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-23b4938c-407d-401c-ad94-7f5f0033fd9d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.214970 Aug 04 23:14:36.273889 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 145/273] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:36 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:36.369777 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-cfd76d98-87ad-4729-adbe-5b0e79c6ae4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:36.372333 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-cfd76d98-87ad-4729-adbe-5b0e79c6ae4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:36.389159 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cfd76d98-87ad-4729-adbe-5b0e79c6ae4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:36.390449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cfd76d98-87ad-4729-adbe-5b0e79c6ae4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:36.391472 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cfd76d98-87ad-4729-adbe-5b0e79c6ae4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:36.393302 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cfd76d98-87ad-4729-adbe-5b0e79c6ae4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:36.394800 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cfd76d98-87ad-4729-adbe-5b0e79c6ae4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:36.395844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cfd76d98-87ad-4729-adbe-5b0e79c6ae4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:36.700934 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-cfd76d98-87ad-4729-adbe-5b0e79c6ae4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:36.713884 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-cfd76d98-87ad-4729-adbe-5b0e79c6ae4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:36.717016 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-cfd76d98-87ad-4729-adbe-5b0e79c6ae4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:36.719174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-cfd76d98-87ad-4729-adbe-5b0e79c6ae4a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.357675 Aug 04 23:14:36.719861 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 129/274] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:36 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:14:37.297643 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c8239923-7b54-4c95-be0d-32af297cab25 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:37.299830 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c8239923-7b54-4c95-be0d-32af297cab25 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:37.306973 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8239923-7b54-4c95-be0d-32af297cab25 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:37.307803 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8239923-7b54-4c95-be0d-32af297cab25 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:37.308592 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8239923-7b54-4c95-be0d-32af297cab25 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:37.309869 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8239923-7b54-4c95-be0d-32af297cab25 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:37.310329 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8239923-7b54-4c95-be0d-32af297cab25 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:37.310779 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8239923-7b54-4c95-be0d-32af297cab25 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:37.466041 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c8239923-7b54-4c95-be0d-32af297cab25 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:37.475633 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c8239923-7b54-4c95-be0d-32af297cab25 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.182300 Aug 04 23:14:37.476216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 146/275] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:37 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:37.671860 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-279e168f-af0d-440a-bd65-c73a72be4d09 req-51347efd-1552-4e27-afb5-07237cd19546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2013d923-81bb-4002-976d-64d3722b15d2", "name": "network-vif-plugged", "status": "completed", "tag": "bae5f1bd-b332-4fbe-8c3e-7f38e098b71d"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:14:37.685962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-279e168f-af0d-440a-bd65-c73a72be4d09 req-51347efd-1552-4e27-afb5-07237cd19546 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:37.686462 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-279e168f-af0d-440a-bd65-c73a72be4d09 req-51347efd-1552-4e27-afb5-07237cd19546 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:37.687136 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-279e168f-af0d-440a-bd65-c73a72be4d09 req-51347efd-1552-4e27-afb5-07237cd19546 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:37.701297 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-279e168f-af0d-440a-bd65-c73a72be4d09 req-51347efd-1552-4e27-afb5-07237cd19546 service nova] Creating event network-vif-plugged:bae5f1bd-b332-4fbe-8c3e-7f38e098b71d for instance 2013d923-81bb-4002-976d-64d3722b15d2 on hv-cinder-85221 Aug 04 23:14:37.707244 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-279e168f-af0d-440a-bd65-c73a72be4d09 req-51347efd-1552-4e27-afb5-07237cd19546 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048368 Aug 04 23:14:37.707999 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 130/276] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:14:37.744684 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7b99adb3-9c36-4944-b0df-4dbc005b05e8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:37.746385 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7b99adb3-9c36-4944-b0df-4dbc005b05e8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:37.769492 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7b99adb3-9c36-4944-b0df-4dbc005b05e8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:37.770072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7b99adb3-9c36-4944-b0df-4dbc005b05e8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:37.770532 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7b99adb3-9c36-4944-b0df-4dbc005b05e8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:37.771428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7b99adb3-9c36-4944-b0df-4dbc005b05e8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:37.772026 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7b99adb3-9c36-4944-b0df-4dbc005b05e8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:37.772594 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7b99adb3-9c36-4944-b0df-4dbc005b05e8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:37.972651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7b99adb3-9c36-4944-b0df-4dbc005b05e8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:37.984229 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7b99adb3-9c36-4944-b0df-4dbc005b05e8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:37.986238 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7b99adb3-9c36-4944-b0df-4dbc005b05e8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:37.988205 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7b99adb3-9c36-4944-b0df-4dbc005b05e8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.250663 Aug 04 23:14:37.998408 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 147/277] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:37 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:14:38.500467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a379b2fa-bf02-4f35-b926-99e9543d6b61 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:38.501164 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a379b2fa-bf02-4f35-b926-99e9543d6b61 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:38.507652 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a379b2fa-bf02-4f35-b926-99e9543d6b61 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:38.508375 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a379b2fa-bf02-4f35-b926-99e9543d6b61 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:38.508806 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a379b2fa-bf02-4f35-b926-99e9543d6b61 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:38.509486 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a379b2fa-bf02-4f35-b926-99e9543d6b61 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:38.510091 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a379b2fa-bf02-4f35-b926-99e9543d6b61 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:38.510540 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a379b2fa-bf02-4f35-b926-99e9543d6b61 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:38.659105 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a379b2fa-bf02-4f35-b926-99e9543d6b61 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:38.666940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a379b2fa-bf02-4f35-b926-99e9543d6b61 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.170963 Aug 04 23:14:38.678820 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 131/278] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:38 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:39.011095 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5a0235bc-1b50-4d67-88e4-375d70bc03e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:39.012710 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5a0235bc-1b50-4d67-88e4-375d70bc03e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:39.019638 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a0235bc-1b50-4d67-88e4-375d70bc03e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:39.020452 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a0235bc-1b50-4d67-88e4-375d70bc03e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:39.021040 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a0235bc-1b50-4d67-88e4-375d70bc03e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:39.021894 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a0235bc-1b50-4d67-88e4-375d70bc03e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:39.022588 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a0235bc-1b50-4d67-88e4-375d70bc03e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:39.023160 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a0235bc-1b50-4d67-88e4-375d70bc03e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:39.406376 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5a0235bc-1b50-4d67-88e4-375d70bc03e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:39.414945 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5a0235bc-1b50-4d67-88e4-375d70bc03e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:39.416658 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5a0235bc-1b50-4d67-88e4-375d70bc03e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:39.418410 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5a0235bc-1b50-4d67-88e4-375d70bc03e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.411199 Aug 04 23:14:39.418914 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 148/279] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:39 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:14:39.693073 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3eb2f44c-3662-4304-bba9-e946712e6346 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:39.694936 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3eb2f44c-3662-4304-bba9-e946712e6346 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:39.704566 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3eb2f44c-3662-4304-bba9-e946712e6346 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:39.705152 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3eb2f44c-3662-4304-bba9-e946712e6346 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:39.705820 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3eb2f44c-3662-4304-bba9-e946712e6346 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:39.706802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3eb2f44c-3662-4304-bba9-e946712e6346 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:39.707385 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3eb2f44c-3662-4304-bba9-e946712e6346 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:39.707903 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3eb2f44c-3662-4304-bba9-e946712e6346 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:39.988528 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3eb2f44c-3662-4304-bba9-e946712e6346 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:40.000789 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3eb2f44c-3662-4304-bba9-e946712e6346 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.312620 Aug 04 23:14:40.011337 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 132/280] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:39 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:40.443666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-190486a0-fa99-46bc-872d-31e27dd06316 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:40.445000 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-190486a0-fa99-46bc-872d-31e27dd06316 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:40.452457 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-190486a0-fa99-46bc-872d-31e27dd06316 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:40.453350 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-190486a0-fa99-46bc-872d-31e27dd06316 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:40.454045 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-190486a0-fa99-46bc-872d-31e27dd06316 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:40.455016 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-190486a0-fa99-46bc-872d-31e27dd06316 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:40.455679 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-190486a0-fa99-46bc-872d-31e27dd06316 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:40.456508 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-190486a0-fa99-46bc-872d-31e27dd06316 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:40.461463 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:14:40.636360 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-190486a0-fa99-46bc-872d-31e27dd06316 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:40.647946 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-190486a0-fa99-46bc-872d-31e27dd06316 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:40.649778 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-190486a0-fa99-46bc-872d-31e27dd06316 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:40.651414 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-190486a0-fa99-46bc-872d-31e27dd06316 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1407 microversion: 2.20 time: 0.212161 Aug 04 23:14:40.652845 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 149/281] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:40 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:14:41.023805 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6020332f-b866-4c73-be8f-98caad1732fb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:41.024658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6020332f-b866-4c73-be8f-98caad1732fb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:41.032426 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6020332f-b866-4c73-be8f-98caad1732fb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:41.032918 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6020332f-b866-4c73-be8f-98caad1732fb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:41.033382 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6020332f-b866-4c73-be8f-98caad1732fb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:41.034198 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6020332f-b866-4c73-be8f-98caad1732fb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:41.034605 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6020332f-b866-4c73-be8f-98caad1732fb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:41.035026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6020332f-b866-4c73-be8f-98caad1732fb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:41.187312 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6020332f-b866-4c73-be8f-98caad1732fb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:41.200134 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6020332f-b866-4c73-be8f-98caad1732fb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.179024 Aug 04 23:14:41.201147 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 133/282] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:41 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:41.675279 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2e0de482-50d2-4cb7-acf4-d4f30a72f8e7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:41.675902 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2e0de482-50d2-4cb7-acf4-d4f30a72f8e7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:41.682642 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2e0de482-50d2-4cb7-acf4-d4f30a72f8e7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:41.683749 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2e0de482-50d2-4cb7-acf4-d4f30a72f8e7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:41.684163 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2e0de482-50d2-4cb7-acf4-d4f30a72f8e7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:41.684983 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2e0de482-50d2-4cb7-acf4-d4f30a72f8e7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:41.685432 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2e0de482-50d2-4cb7-acf4-d4f30a72f8e7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:41.685919 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2e0de482-50d2-4cb7-acf4-d4f30a72f8e7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:41.854915 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2e0de482-50d2-4cb7-acf4-d4f30a72f8e7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:41.875648 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2e0de482-50d2-4cb7-acf4-d4f30a72f8e7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:41.877270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2e0de482-50d2-4cb7-acf4-d4f30a72f8e7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:41.878524 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2e0de482-50d2-4cb7-acf4-d4f30a72f8e7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1599 microversion: 2.20 time: 0.207376 Aug 04 23:14:41.879086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 150/283] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:14:41 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1599 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:14:41.904312 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3b6f7a62-1279-445e-b0d0-d162680e706d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:41.904802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3b6f7a62-1279-445e-b0d0-d162680e706d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:41.911284 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b6f7a62-1279-445e-b0d0-d162680e706d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:41.911764 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b6f7a62-1279-445e-b0d0-d162680e706d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:41.912431 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b6f7a62-1279-445e-b0d0-d162680e706d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:41.913486 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b6f7a62-1279-445e-b0d0-d162680e706d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:41.913950 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b6f7a62-1279-445e-b0d0-d162680e706d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:41.914389 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b6f7a62-1279-445e-b0d0-d162680e706d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:42.003060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3b6f7a62-1279-445e-b0d0-d162680e706d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.103607 Aug 04 23:14:42.004283 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 134/284] 10.222.0.33 () {60 vars in 1316 bytes} [Thu Aug 4 23:14:41 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 23:14:42.223033 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3398e0fd-2f06-4076-a04e-a12731558ff8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:42.223802 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3398e0fd-2f06-4076-a04e-a12731558ff8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:42.233691 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3398e0fd-2f06-4076-a04e-a12731558ff8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:42.236010 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3398e0fd-2f06-4076-a04e-a12731558ff8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:42.240615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3398e0fd-2f06-4076-a04e-a12731558ff8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:42.241626 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3398e0fd-2f06-4076-a04e-a12731558ff8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:42.242256 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3398e0fd-2f06-4076-a04e-a12731558ff8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:42.242888 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3398e0fd-2f06-4076-a04e-a12731558ff8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:42.429239 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3398e0fd-2f06-4076-a04e-a12731558ff8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:42.438601 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3398e0fd-2f06-4076-a04e-a12731558ff8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.220569 Aug 04 23:14:42.439256 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 151/285] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:42 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:43.462234 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d1c35868-052c-40d8-84fe-40ca27b82974 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:43.462899 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d1c35868-052c-40d8-84fe-40ca27b82974 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:43.471197 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1c35868-052c-40d8-84fe-40ca27b82974 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:43.471687 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1c35868-052c-40d8-84fe-40ca27b82974 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:43.472121 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1c35868-052c-40d8-84fe-40ca27b82974 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:43.473011 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1c35868-052c-40d8-84fe-40ca27b82974 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:43.473644 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1c35868-052c-40d8-84fe-40ca27b82974 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:43.474285 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1c35868-052c-40d8-84fe-40ca27b82974 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:43.524155 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-9f890742-5fef-49d9-a3e0-2cf08d4bc064 req-b261a8a6-66ff-4713-ba0d-f64c823a06f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2013d923-81bb-4002-976d-64d3722b15d2", "tag": "bae5f1bd-b332-4fbe-8c3e-7f38e098b71d"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:14:43.535147 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-9f890742-5fef-49d9-a3e0-2cf08d4bc064 req-b261a8a6-66ff-4713-ba0d-f64c823a06f0 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:43.535691 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-9f890742-5fef-49d9-a3e0-2cf08d4bc064 req-b261a8a6-66ff-4713-ba0d-f64c823a06f0 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:43.536175 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-9f890742-5fef-49d9-a3e0-2cf08d4bc064 req-b261a8a6-66ff-4713-ba0d-f64c823a06f0 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:43.552695 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-9f890742-5fef-49d9-a3e0-2cf08d4bc064 req-b261a8a6-66ff-4713-ba0d-f64c823a06f0 service nova] Creating event network-changed:bae5f1bd-b332-4fbe-8c3e-7f38e098b71d for instance 2013d923-81bb-4002-976d-64d3722b15d2 on hv-cinder-85221 Aug 04 23:14:43.559671 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-9f890742-5fef-49d9-a3e0-2cf08d4bc064 req-b261a8a6-66ff-4713-ba0d-f64c823a06f0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039540 Aug 04 23:14:43.565524 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 152/286] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:14:43.645015 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d1c35868-052c-40d8-84fe-40ca27b82974 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:43.653100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d1c35868-052c-40d8-84fe-40ca27b82974 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.196690 Aug 04 23:14:43.653739 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 135/287] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:43 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:44.576476 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ce255eca-dacd-48ad-a37e-82c5e9944d8d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:44.577064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ce255eca-dacd-48ad-a37e-82c5e9944d8d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:44.583156 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce255eca-dacd-48ad-a37e-82c5e9944d8d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:44.583643 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce255eca-dacd-48ad-a37e-82c5e9944d8d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:44.584072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce255eca-dacd-48ad-a37e-82c5e9944d8d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:44.584772 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce255eca-dacd-48ad-a37e-82c5e9944d8d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:44.585221 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce255eca-dacd-48ad-a37e-82c5e9944d8d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:44.585633 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce255eca-dacd-48ad-a37e-82c5e9944d8d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:44.613171 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ce255eca-dacd-48ad-a37e-82c5e9944d8d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Going to try to terminate instance {{(pid=129791) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 23:14:44.676457 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-91ed1422-4428-4935-b404-5a7dd53e7bb3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:44.677094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-91ed1422-4428-4935-b404-5a7dd53e7bb3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:44.690380 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-91ed1422-4428-4935-b404-5a7dd53e7bb3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:44.694384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-91ed1422-4428-4935-b404-5a7dd53e7bb3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:44.695457 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-91ed1422-4428-4935-b404-5a7dd53e7bb3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:44.698485 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-91ed1422-4428-4935-b404-5a7dd53e7bb3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:44.700113 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-91ed1422-4428-4935-b404-5a7dd53e7bb3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:44.701666 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-91ed1422-4428-4935-b404-5a7dd53e7bb3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:44.751572 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ce255eca-dacd-48ad-a37e-82c5e9944d8d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "DELETE /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 204 len: 0 microversion: 2.1 time: 0.179358 Aug 04 23:14:44.758400 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 153/288] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:14:44 2022] DELETE /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 23:14:44.770810 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ceb66ebc-7662-480a-a8ba-585bcf334e39 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:44.771712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ceb66ebc-7662-480a-a8ba-585bcf334e39 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:44.780036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ceb66ebc-7662-480a-a8ba-585bcf334e39 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:44.780904 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ceb66ebc-7662-480a-a8ba-585bcf334e39 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:44.781641 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ceb66ebc-7662-480a-a8ba-585bcf334e39 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:44.782695 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ceb66ebc-7662-480a-a8ba-585bcf334e39 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:44.783374 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ceb66ebc-7662-480a-a8ba-585bcf334e39 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:44.784092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ceb66ebc-7662-480a-a8ba-585bcf334e39 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:44.979760 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-91ed1422-4428-4935-b404-5a7dd53e7bb3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:44.988764 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-91ed1422-4428-4935-b404-5a7dd53e7bb3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.318373 Aug 04 23:14:44.990608 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 136/289] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:44 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:45.005563 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ceb66ebc-7662-480a-a8ba-585bcf334e39 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:45.014245 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ceb66ebc-7662-480a-a8ba-585bcf334e39 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1552 microversion: 2.1 time: 0.254312 Aug 04 23:14:45.014915 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 154/290] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:44 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1552 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:46.012568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c084cf98-1a42-4e0f-b34f-ad1556ba0573 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:46.013163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c084cf98-1a42-4e0f-b34f-ad1556ba0573 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:46.025800 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c084cf98-1a42-4e0f-b34f-ad1556ba0573 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:46.025891 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c084cf98-1a42-4e0f-b34f-ad1556ba0573 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:46.026253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c084cf98-1a42-4e0f-b34f-ad1556ba0573 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:46.035222 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e968f73f-1f71-4ff4-bbef-8db13275976d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:46.035837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e968f73f-1f71-4ff4-bbef-8db13275976d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:46.051648 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e968f73f-1f71-4ff4-bbef-8db13275976d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:46.052243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c084cf98-1a42-4e0f-b34f-ad1556ba0573 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:46.052993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c084cf98-1a42-4e0f-b34f-ad1556ba0573 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:46.053968 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e968f73f-1f71-4ff4-bbef-8db13275976d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:46.058558 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e968f73f-1f71-4ff4-bbef-8db13275976d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:46.059930 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e968f73f-1f71-4ff4-bbef-8db13275976d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:46.060411 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e968f73f-1f71-4ff4-bbef-8db13275976d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:46.060848 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e968f73f-1f71-4ff4-bbef-8db13275976d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:46.062501 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c084cf98-1a42-4e0f-b34f-ad1556ba0573 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:46.337623 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c084cf98-1a42-4e0f-b34f-ad1556ba0573 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:46.347610 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c084cf98-1a42-4e0f-b34f-ad1556ba0573 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.340500 Aug 04 23:14:46.347812 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e968f73f-1f71-4ff4-bbef-8db13275976d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:46.348356 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 137/291] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:46 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:46.358217 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e968f73f-1f71-4ff4-bbef-8db13275976d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1552 microversion: 2.1 time: 0.326577 Aug 04 23:14:46.359836 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 155/292] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:46 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1552 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:47.370349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3fbfcf4a-81b3-4c51-9463-3ca85eef6a7f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:47.371964 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3fbfcf4a-81b3-4c51-9463-3ca85eef6a7f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:47.379073 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3fbfcf4a-81b3-4c51-9463-3ca85eef6a7f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:47.379548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3fbfcf4a-81b3-4c51-9463-3ca85eef6a7f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:47.384844 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-79dbbaee-5d69-417d-a5d7-cfcd2ec1012b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:47.385447 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-79dbbaee-5d69-417d-a5d7-cfcd2ec1012b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:47.389170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3fbfcf4a-81b3-4c51-9463-3ca85eef6a7f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:47.392456 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3fbfcf4a-81b3-4c51-9463-3ca85eef6a7f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:47.393347 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3fbfcf4a-81b3-4c51-9463-3ca85eef6a7f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:47.395325 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79dbbaee-5d69-417d-a5d7-cfcd2ec1012b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:47.396121 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3fbfcf4a-81b3-4c51-9463-3ca85eef6a7f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:47.400766 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79dbbaee-5d69-417d-a5d7-cfcd2ec1012b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:47.401532 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79dbbaee-5d69-417d-a5d7-cfcd2ec1012b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:47.403136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79dbbaee-5d69-417d-a5d7-cfcd2ec1012b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:47.403801 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79dbbaee-5d69-417d-a5d7-cfcd2ec1012b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:47.404457 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79dbbaee-5d69-417d-a5d7-cfcd2ec1012b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:47.786869 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-79dbbaee-5d69-417d-a5d7-cfcd2ec1012b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59a46485dc348bcb1786a087b3cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e946054af5c94e50b4a25431d601818b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:47.795334 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3fbfcf4a-81b3-4c51-9463-3ca85eef6a7f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:47.797976 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-79dbbaee-5d69-417d-a5d7-cfcd2ec1012b tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 200 len: 1552 microversion: 2.1 time: 0.416972 Aug 04 23:14:47.806424 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 156/293] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:47 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 1552 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:47.806424 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-ba42c363-b069-4240-828b-880e9dde10b5 req-674fa88a-d59d-432a-8e5d-f8065e9c8ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faea55ff-7fe8-496e-a691-cbd9ce467f0a", "name": "network-vif-deleted", "tag": "7c54c357-45ad-4b09-8da5-f5ebc9e3bd6b"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:14:47.815555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-ba42c363-b069-4240-828b-880e9dde10b5 req-674fa88a-d59d-432a-8e5d-f8065e9c8ea7 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:47.815858 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-ba42c363-b069-4240-828b-880e9dde10b5 req-674fa88a-d59d-432a-8e5d-f8065e9c8ea7 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:47.816219 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-ba42c363-b069-4240-828b-880e9dde10b5 req-674fa88a-d59d-432a-8e5d-f8065e9c8ea7 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:47.827857 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3fbfcf4a-81b3-4c51-9463-3ca85eef6a7f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.462080 Aug 04 23:14:47.828800 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 138/294] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:47 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:47.839115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-ba42c363-b069-4240-828b-880e9dde10b5 req-674fa88a-d59d-432a-8e5d-f8065e9c8ea7 service nova] Creating event network-vif-deleted:7c54c357-45ad-4b09-8da5-f5ebc9e3bd6b for instance faea55ff-7fe8-496e-a691-cbd9ce467f0a on hv-cinder-85221 Aug 04 23:14:47.845553 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-ba42c363-b069-4240-828b-880e9dde10b5 req-674fa88a-d59d-432a-8e5d-f8065e9c8ea7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045175 Aug 04 23:14:47.846325 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 157/295] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:14:48.819722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-dac3453c-68d0-4a32-9c54-618e0f23ea39 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:48.820414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-dac3453c-68d0-4a32-9c54-618e0f23ea39 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:48.828481 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dac3453c-68d0-4a32-9c54-618e0f23ea39 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:48.829206 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dac3453c-68d0-4a32-9c54-618e0f23ea39 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:48.829763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dac3453c-68d0-4a32-9c54-618e0f23ea39 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:48.830949 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dac3453c-68d0-4a32-9c54-618e0f23ea39 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:48.831405 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dac3453c-68d0-4a32-9c54-618e0f23ea39 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:48.831820 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dac3453c-68d0-4a32-9c54-618e0f23ea39 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:48.848333 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-dac3453c-68d0-4a32-9c54-618e0f23ea39 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] HTTP exception thrown: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. Aug 04 23:14:48.849506 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1029072c-340a-4f35-9876-b0933bbf8f0e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:48.851366 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1029072c-340a-4f35-9876-b0933bbf8f0e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:48.853662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-dac3453c-68d0-4a32-9c54-618e0f23ea39 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Request method failure captured: Aug 04 23:14:48.853662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a HTTP/1.1 Aug 04 23:14:48.853662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:14:48.853662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:14:48.853662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:14:48.853662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:14:48.853662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:14:48.853662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:14:48.853662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:14:48.853662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:14:48.853662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FJ-W6rBEWDwFFfOL2VTnv0_6xJTvKkQEOjAAg2Gd3JRKSRUH1O2hZmOw0DMO6kIzhzJT8RD3id9s-TdaA6a662AaThCIf7WkoymN9twGeIpbLigAIdI1XTafuHe64XE4R5wsEFTatEj6NG-eVUxKE2sH1mzmwYo3ygiqc03KfEcrjs Aug 04 23:14:48.853662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:14:48.853662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:14:48.853662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:14:48.853662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:14:48.853662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:14:48.853662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:14:48.853662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: e946054af5c94e50b4a25431d601818b Aug 04 23:14:48.853662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-DeleteServersTestJSON-951970725 Aug 04 23:14:48.853662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:14:48.853662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:14:48.854931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e946054af5c94e50b4a25431d601818b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e946054af5c94e50b4a25431d601818b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e946054af5c94e50b4a25431d601818b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e946054af5c94e50b4a25431d601818b"}]}] Aug 04 23:14:48.854931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-DeleteServersTestJSON-951970725 Aug 04 23:14:48.854931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: e946054af5c94e50b4a25431d601818b Aug 04 23:14:48.854931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-DeleteServersTestJSON-951970725 Aug 04 23:14:48.854931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-DeleteServersTestJSON-951970725-project Aug 04 23:14:48.854931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:14:48.854931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:14:48.854931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: c59a46485dc348bcb1786a087b3cd2e9 Aug 04 23:14:48.854931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-DeleteServersTestJSON-951970725-project Aug 04 23:14:48.854931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:14:48.854931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. Aug 04 23:14:48.854931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': 'faea55ff-7fe8-496e-a691-cbd9ce467f0a'} Aug 04 23:14:48.857098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:14:48.857098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:14:48.857098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:14:48.857098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:14:48.857098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:14:48.857098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:14:48.857098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:14:48.857098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:14:48.857098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:14:48.857098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:14:48.857098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. Aug 04 23:14:48.857098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:14:48.857098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:14:48.857098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:14:48.857098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:14:48.857098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:14:48.857098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:14:48.857098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:14:48.857098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:14:48.857098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:14:48.858265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:14:48.858265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:14:48.858265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:14:48.858265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:14:48.858265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:14:48.858265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:14:48.858265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:14:48.858265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. Aug 04 23:14:48.858265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:14:48.858265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:14:48.858265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:14:48.858265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:14:48.858265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:14:48.858265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:14:48.858265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:14:48.858265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:14:48.858265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. Aug 04 23:14:48.858265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:14:48.859282 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-dac3453c-68d0-4a32-9c54-618e0f23ea39 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Returning 404 to user: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:14:48.859282 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-dac3453c-68d0-4a32-9c54-618e0f23ea39 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 404 len: 111 microversion: 2.1 time: 0.039663 Aug 04 23:14:48.859282 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 139/296] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:48 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:14:48.861061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1029072c-340a-4f35-9876-b0933bbf8f0e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:48.861061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1029072c-340a-4f35-9876-b0933bbf8f0e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:48.861061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1029072c-340a-4f35-9876-b0933bbf8f0e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:48.861061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1029072c-340a-4f35-9876-b0933bbf8f0e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:48.861744 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1029072c-340a-4f35-9876-b0933bbf8f0e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:48.861744 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1029072c-340a-4f35-9876-b0933bbf8f0e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:48.985384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f2e684ea-9713-498e-a4ab-d6eae45286c4 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:48.988780 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f2e684ea-9713-498e-a4ab-d6eae45286c4 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:48.994776 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f2e684ea-9713-498e-a4ab-d6eae45286c4 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:48.995245 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f2e684ea-9713-498e-a4ab-d6eae45286c4 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:48.996656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f2e684ea-9713-498e-a4ab-d6eae45286c4 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:48.997716 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f2e684ea-9713-498e-a4ab-d6eae45286c4 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:48.998161 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f2e684ea-9713-498e-a4ab-d6eae45286c4 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:48.998610 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f2e684ea-9713-498e-a4ab-d6eae45286c4 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:49.012469 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-f2e684ea-9713-498e-a4ab-d6eae45286c4 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] HTTP exception thrown: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. Aug 04 23:14:49.014019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f2e684ea-9713-498e-a4ab-d6eae45286c4 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Request method failure captured: Aug 04 23:14:49.014019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a/os-volume_attachments HTTP/1.1 Aug 04 23:14:49.014019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:14:49.014019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:14:49.014019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:14:49.014019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:14:49.014019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:14:49.014019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:14:49.014019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:14:49.014019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:14:49.014019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FJ-W6rBEWDwFFfOL2VTnv0_6xJTvKkQEOjAAg2Gd3JRKSRUH1O2hZmOw0DMO6kIzhzJT8RD3id9s-TdaA6a662AaThCIf7WkoymN9twGeIpbLigAIdI1XTafuHe64XE4R5wsEFTatEj6NG-eVUxKE2sH1mzmwYo3ygiqc03KfEcrjs Aug 04 23:14:49.014019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:14:49.014019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:14:49.014019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:14:49.014019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:14:49.014019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:14:49.014019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:14:49.014019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: e946054af5c94e50b4a25431d601818b Aug 04 23:14:49.014019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-DeleteServersTestJSON-951970725 Aug 04 23:14:49.014019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:14:49.014019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:14:49.015428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e946054af5c94e50b4a25431d601818b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e946054af5c94e50b4a25431d601818b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e946054af5c94e50b4a25431d601818b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e946054af5c94e50b4a25431d601818b"}]}] Aug 04 23:14:49.015428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-DeleteServersTestJSON-951970725 Aug 04 23:14:49.015428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: e946054af5c94e50b4a25431d601818b Aug 04 23:14:49.015428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-DeleteServersTestJSON-951970725 Aug 04 23:14:49.015428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-DeleteServersTestJSON-951970725-project Aug 04 23:14:49.015428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:14:49.015428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:14:49.015428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: c59a46485dc348bcb1786a087b3cd2e9 Aug 04 23:14:49.015428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-DeleteServersTestJSON-951970725-project Aug 04 23:14:49.015428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:14:49.015428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. Aug 04 23:14:49.015428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'server_id': 'faea55ff-7fe8-496e-a691-cbd9ce467f0a'} Aug 04 23:14:49.016548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:14:49.016548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:14:49.016548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:14:49.016548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:14:49.016548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:14:49.016548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:14:49.016548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:14:49.016548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:14:49.016548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:14:49.016548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:14:49.016548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. Aug 04 23:14:49.016548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:14:49.016548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:14:49.016548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:14:49.016548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:14:49.016548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:14:49.016548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:14:49.016548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:14:49.016548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:14:49.016548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:14:49.018291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:14:49.018291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 23:14:49.018291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 23:14:49.018291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 23:14:49.018291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 23:14:49.018291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 04 23:14:49.018291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 04 23:14:49.018291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:14:49.018291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:14:49.018291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. Aug 04 23:14:49.018291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:14:49.018291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:14:49.018291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:14:49.018291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:14:49.018291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:14:49.018291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:14:49.018291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:14:49.018291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:14:49.018291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. Aug 04 23:14:49.018291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:14:49.020641 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f2e684ea-9713-498e-a4ab-d6eae45286c4 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Returning 404 to user: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:14:49.020641 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f2e684ea-9713-498e-a4ab-d6eae45286c4 tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033999 Aug 04 23:14:49.020641 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 140/297] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:14:48 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 23:14:49.074398 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1029072c-340a-4f35-9876-b0933bbf8f0e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:49.088960 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1029072c-340a-4f35-9876-b0933bbf8f0e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.244010 Aug 04 23:14:49.091139 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 158/298] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:48 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:49.969429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-32001d30-e39e-41e7-99b0-38ad87b3e03a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-925300342", "imageRef": "e1e9d70e-b252-44e5-9ecd-bf73cbf00160", "flavorRef": "452", "networks": [{"uuid": "05079a03-770c-4591-97d9-02de6301b472"}]}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:14:50.027921 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.network.neutron [None req-32001d30-e39e-41e7-99b0-38ad87b3e03a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] validate_networks() for [('05079a03-770c-4591-97d9-02de6301b472', None, None, None, None, None)] {{(pid=129790) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 23:14:50.111141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-34aa59f0-e32b-440a-835c-cb6616a56884 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:50.112250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-34aa59f0-e32b-440a-835c-cb6616a56884 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:50.119104 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-34aa59f0-e32b-440a-835c-cb6616a56884 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:50.121890 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-34aa59f0-e32b-440a-835c-cb6616a56884 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:50.122431 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-34aa59f0-e32b-440a-835c-cb6616a56884 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:50.127639 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-34aa59f0-e32b-440a-835c-cb6616a56884 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:50.128128 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-34aa59f0-e32b-440a-835c-cb6616a56884 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:50.128733 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-34aa59f0-e32b-440a-835c-cb6616a56884 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:50.366863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-34aa59f0-e32b-440a-835c-cb6616a56884 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:50.378488 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-34aa59f0-e32b-440a-835c-cb6616a56884 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.271045 Aug 04 23:14:50.379235 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 159/299] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:50 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:50.384234 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-cd937579-2166-4540-bb35-6936a084580d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:50.384925 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-cd937579-2166-4540-bb35-6936a084580d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:50.391786 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd937579-2166-4540-bb35-6936a084580d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:50.392615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd937579-2166-4540-bb35-6936a084580d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:50.393411 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd937579-2166-4540-bb35-6936a084580d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:50.394129 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd937579-2166-4540-bb35-6936a084580d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:50.394517 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd937579-2166-4540-bb35-6936a084580d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:50.394945 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd937579-2166-4540-bb35-6936a084580d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:50.413051 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-cd937579-2166-4540-bb35-6936a084580d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] HTTP exception thrown: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. Aug 04 23:14:50.418261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-cd937579-2166-4540-bb35-6936a084580d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Request method failure captured: Aug 04 23:14:50.418261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: DELETE /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a HTTP/1.1 Aug 04 23:14:50.418261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:14:50.418261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:14:50.418261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:14:50.418261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 0 Aug 04 23:14:50.418261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:14:50.418261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:14:50.418261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:14:50.418261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:14:50.418261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FJ-W6rBEWDwFFfOL2VTnv0_6xJTvKkQEOjAAg2Gd3JRKSRUH1O2hZmOw0DMO6kIzhzJT8RD3id9s-TdaA6a662AaThCIf7WkoymN9twGeIpbLigAIdI1XTafuHe64XE4R5wsEFTatEj6NG-eVUxKE2sH1mzmwYo3ygiqc03KfEcrjs Aug 04 23:14:50.418261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:14:50.418261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:14:50.418261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:14:50.418261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:14:50.418261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:14:50.418261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:14:50.418261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: e946054af5c94e50b4a25431d601818b Aug 04 23:14:50.418261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-DeleteServersTestJSON-951970725 Aug 04 23:14:50.418261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:14:50.418261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:14:50.419664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e946054af5c94e50b4a25431d601818b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e946054af5c94e50b4a25431d601818b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e946054af5c94e50b4a25431d601818b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e946054af5c94e50b4a25431d601818b"}]}] Aug 04 23:14:50.419664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-DeleteServersTestJSON-951970725 Aug 04 23:14:50.419664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: e946054af5c94e50b4a25431d601818b Aug 04 23:14:50.419664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-DeleteServersTestJSON-951970725 Aug 04 23:14:50.419664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-DeleteServersTestJSON-951970725-project Aug 04 23:14:50.419664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:14:50.419664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:14:50.419664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: c59a46485dc348bcb1786a087b3cd2e9 Aug 04 23:14:50.419664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-DeleteServersTestJSON-951970725-project Aug 04 23:14:50.419664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: > Aug 04 23:14:50.419664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. Aug 04 23:14:50.419664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'id': 'faea55ff-7fe8-496e-a691-cbd9ce467f0a'} Aug 04 23:14:50.420470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:14:50.420470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:14:50.420470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:14:50.420470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:14:50.420470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:14:50.420470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:14:50.420470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:14:50.420470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:14:50.420470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:14:50.420470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:14:50.420470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. Aug 04 23:14:50.420470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:14:50.420470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:14:50.420470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:14:50.420470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:14:50.420470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:14:50.420470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:14:50.420470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:14:50.420470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:14:50.420470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:14:50.421665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:14:50.421665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 23:14:50.421665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 23:14:50.421665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 23:14:50.421665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 23:14:50.421665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:14:50.421665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:14:50.421665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:14:50.421665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:14:50.421665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. Aug 04 23:14:50.421665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:14:50.421665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:14:50.421665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:14:50.421665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:14:50.421665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:14:50.421665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:14:50.421665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:14:50.421665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:14:50.421665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. Aug 04 23:14:50.421665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:14:50.423068 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-cd937579-2166-4540-bb35-6936a084580d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Returning 404 to user: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:14:50.423068 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-cd937579-2166-4540-bb35-6936a084580d tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "DELETE /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 404 len: 111 microversion: 2.1 time: 0.039450 Aug 04 23:14:50.423872 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 160/300] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:14:50 2022] DELETE /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:14:50.429032 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7063bdd8-2542-498c-9b71-5ecf9fe0c43a tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:50.429666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7063bdd8-2542-498c-9b71-5ecf9fe0c43a tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] [instance: faea55ff-7fe8-496e-a691-cbd9ce467f0a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:50.436546 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7063bdd8-2542-498c-9b71-5ecf9fe0c43a tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:50.437012 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7063bdd8-2542-498c-9b71-5ecf9fe0c43a tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:50.437475 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7063bdd8-2542-498c-9b71-5ecf9fe0c43a tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:50.438145 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7063bdd8-2542-498c-9b71-5ecf9fe0c43a tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:50.438646 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7063bdd8-2542-498c-9b71-5ecf9fe0c43a tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:50.439100 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7063bdd8-2542-498c-9b71-5ecf9fe0c43a tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:50.453443 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-7063bdd8-2542-498c-9b71-5ecf9fe0c43a tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] HTTP exception thrown: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. Aug 04 23:14:50.455125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7063bdd8-2542-498c-9b71-5ecf9fe0c43a tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Request method failure captured: Aug 04 23:14:50.455125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a HTTP/1.1 Aug 04 23:14:50.455125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:14:50.455125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:14:50.455125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:14:50.455125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 0 Aug 04 23:14:50.455125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:14:50.455125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:14:50.455125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:14:50.455125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:14:50.455125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FJ-W6rBEWDwFFfOL2VTnv0_6xJTvKkQEOjAAg2Gd3JRKSRUH1O2hZmOw0DMO6kIzhzJT8RD3id9s-TdaA6a662AaThCIf7WkoymN9twGeIpbLigAIdI1XTafuHe64XE4R5wsEFTatEj6NG-eVUxKE2sH1mzmwYo3ygiqc03KfEcrjs Aug 04 23:14:50.455125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:14:50.455125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:14:50.455125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:14:50.455125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:14:50.455125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:14:50.455125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:14:50.455125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: e946054af5c94e50b4a25431d601818b Aug 04 23:14:50.455125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-DeleteServersTestJSON-951970725 Aug 04 23:14:50.455125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:14:50.455125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:14:50.456718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e946054af5c94e50b4a25431d601818b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e946054af5c94e50b4a25431d601818b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e946054af5c94e50b4a25431d601818b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e946054af5c94e50b4a25431d601818b"}]}] Aug 04 23:14:50.456718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-DeleteServersTestJSON-951970725 Aug 04 23:14:50.456718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: e946054af5c94e50b4a25431d601818b Aug 04 23:14:50.456718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-DeleteServersTestJSON-951970725 Aug 04 23:14:50.456718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-DeleteServersTestJSON-951970725-project Aug 04 23:14:50.456718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:14:50.456718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:14:50.456718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: c59a46485dc348bcb1786a087b3cd2e9 Aug 04 23:14:50.456718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-DeleteServersTestJSON-951970725-project Aug 04 23:14:50.456718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: > Aug 04 23:14:50.456718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. Aug 04 23:14:50.456718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'id': 'faea55ff-7fe8-496e-a691-cbd9ce467f0a'} Aug 04 23:14:50.457798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:14:50.457798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:14:50.457798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:14:50.457798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:14:50.457798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:14:50.457798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:14:50.457798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:14:50.457798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:14:50.457798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:14:50.457798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:14:50.457798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. Aug 04 23:14:50.457798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:14:50.457798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:14:50.457798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:14:50.457798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:14:50.457798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:14:50.457798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:14:50.457798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:14:50.457798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:14:50.457798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:14:50.459141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:14:50.459141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:14:50.459141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:14:50.459141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:14:50.459141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:14:50.459141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:14:50.459141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:14:50.459141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. Aug 04 23:14:50.459141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:14:50.459141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:14:50.459141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:14:50.459141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:14:50.459141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:14:50.459141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:14:50.459141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:14:50.459141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:14:50.459141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. Aug 04 23:14:50.459141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:14:50.460378 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7063bdd8-2542-498c-9b71-5ecf9fe0c43a tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] Returning 404 to user: Instance faea55ff-7fe8-496e-a691-cbd9ce467f0a could not be found. {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:14:50.460378 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7063bdd8-2542-498c-9b71-5ecf9fe0c43a tempest-DeleteServersTestJSON-951970725 tempest-DeleteServersTestJSON-951970725-project] 10.222.0.33 "GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a" status: 404 len: 111 microversion: 2.1 time: 0.031638 Aug 04 23:14:50.465868 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 161/301] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:50 2022] GET /compute/v2.1/servers/faea55ff-7fe8-496e-a691-cbd9ce467f0a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:14:50.513213 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-32001d30-e39e-41e7-99b0-38ad87b3e03a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Flavor limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 23:14:50.513658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-32001d30-e39e-41e7-99b0-38ad87b3e03a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Image limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 23:14:50.514344 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-32001d30-e39e-41e7-99b0-38ad87b3e03a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Flavor pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 23:14:50.514774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-32001d30-e39e-41e7-99b0-38ad87b3e03a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Image pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 23:14:50.515381 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-32001d30-e39e-41e7-99b0-38ad87b3e03a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 23:14:50.524467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32001d30-e39e-41e7-99b0-38ad87b3e03a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:50.524940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32001d30-e39e-41e7-99b0-38ad87b3e03a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:50.525369 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32001d30-e39e-41e7-99b0-38ad87b3e03a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:50.526123 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32001d30-e39e-41e7-99b0-38ad87b3e03a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:50.526615 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32001d30-e39e-41e7-99b0-38ad87b3e03a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:50.527648 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32001d30-e39e-41e7-99b0-38ad87b3e03a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:50.546087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-32001d30-e39e-41e7-99b0-38ad87b3e03a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Getting quotas for project b69e8dd8254e4e1f813bc3fce0438b50. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:14:50.550142 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-32001d30-e39e-41e7-99b0-38ad87b3e03a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Getting quotas for user 9b3df18fff9343a1984468c0ea8517e4 and project b69e8dd8254e4e1f813bc3fce0438b50. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:14:50.561564 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-32001d30-e39e-41e7-99b0-38ad87b3e03a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Going to run 1 instances... {{(pid=129790) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 23:14:50.563941 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-32001d30-e39e-41e7-99b0-38ad87b3e03a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1e9d70e-b252-44e5-9ecd-bf73cbf00160',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129790) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 23:14:50.610486 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-32001d30-e39e-41e7-99b0-38ad87b3e03a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644724 Aug 04 23:14:50.611082 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 141/302] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Aug 4 23:14:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 23:14:50.624472 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f5c4a826-6066-48c3-845c-124851b72fee tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:50.625421 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f5c4a826-6066-48c3-845c-124851b72fee tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:50.704196 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f5c4a826-6066-48c3-845c-124851b72fee tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:50.710984 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f5c4a826-6066-48c3-845c-124851b72fee tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b" status: 200 len: 1213 microversion: 2.1 time: 0.092333 Aug 04 23:14:50.711996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 162/303] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:50 2022] GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:51.404070 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a5d9f4cc-ca2a-41ec-8944-1ebbfdfc8660 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:51.406337 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a5d9f4cc-ca2a-41ec-8944-1ebbfdfc8660 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:51.427465 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5d9f4cc-ca2a-41ec-8944-1ebbfdfc8660 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:51.429194 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5d9f4cc-ca2a-41ec-8944-1ebbfdfc8660 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:51.429842 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5d9f4cc-ca2a-41ec-8944-1ebbfdfc8660 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:51.431012 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5d9f4cc-ca2a-41ec-8944-1ebbfdfc8660 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:51.431700 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5d9f4cc-ca2a-41ec-8944-1ebbfdfc8660 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:51.433509 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5d9f4cc-ca2a-41ec-8944-1ebbfdfc8660 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:51.635599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a5d9f4cc-ca2a-41ec-8944-1ebbfdfc8660 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:51.657542 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a5d9f4cc-ca2a-41ec-8944-1ebbfdfc8660 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.260010 Aug 04 23:14:51.658497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 142/304] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:51 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:51.733951 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1a6bf270-d094-4a04-8c23-1de2c2d98de0 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:51.734603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1a6bf270-d094-4a04-8c23-1de2c2d98de0 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:51.743970 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a6bf270-d094-4a04-8c23-1de2c2d98de0 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:51.744927 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a6bf270-d094-4a04-8c23-1de2c2d98de0 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:51.747582 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a6bf270-d094-4a04-8c23-1de2c2d98de0 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:51.749679 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a6bf270-d094-4a04-8c23-1de2c2d98de0 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:51.750515 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a6bf270-d094-4a04-8c23-1de2c2d98de0 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:51.751166 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a6bf270-d094-4a04-8c23-1de2c2d98de0 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:51.837115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1a6bf270-d094-4a04-8c23-1de2c2d98de0 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:51.846410 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1a6bf270-d094-4a04-8c23-1de2c2d98de0 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b" status: 200 len: 1273 microversion: 2.1 time: 0.117667 Aug 04 23:14:51.847302 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 163/305] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:51 2022] GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b => generated 1273 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:52.680440 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d3be7bc1-78c9-4a9e-bcd8-53f4b4f1cdfb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:52.684361 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d3be7bc1-78c9-4a9e-bcd8-53f4b4f1cdfb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:52.692530 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3be7bc1-78c9-4a9e-bcd8-53f4b4f1cdfb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:52.693524 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3be7bc1-78c9-4a9e-bcd8-53f4b4f1cdfb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:52.694754 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3be7bc1-78c9-4a9e-bcd8-53f4b4f1cdfb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:52.696696 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3be7bc1-78c9-4a9e-bcd8-53f4b4f1cdfb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:52.697749 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3be7bc1-78c9-4a9e-bcd8-53f4b4f1cdfb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:52.698421 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3be7bc1-78c9-4a9e-bcd8-53f4b4f1cdfb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:52.867310 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e3ddcbca-9c5c-4ca6-b91c-61692845cede tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:52.867915 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e3ddcbca-9c5c-4ca6-b91c-61692845cede tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:52.879958 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d3be7bc1-78c9-4a9e-bcd8-53f4b4f1cdfb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:52.887364 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e3ddcbca-9c5c-4ca6-b91c-61692845cede tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:52.888097 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e3ddcbca-9c5c-4ca6-b91c-61692845cede tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:52.888532 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e3ddcbca-9c5c-4ca6-b91c-61692845cede tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:52.889237 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e3ddcbca-9c5c-4ca6-b91c-61692845cede tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:52.891584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d3be7bc1-78c9-4a9e-bcd8-53f4b4f1cdfb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.216094 Aug 04 23:14:52.893312 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 143/306] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:52 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:52.894128 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e3ddcbca-9c5c-4ca6-b91c-61692845cede tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:52.894751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e3ddcbca-9c5c-4ca6-b91c-61692845cede tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:52.971311 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e3ddcbca-9c5c-4ca6-b91c-61692845cede tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:52.993250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e3ddcbca-9c5c-4ca6-b91c-61692845cede tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b" status: 200 len: 1271 microversion: 2.1 time: 0.129808 Aug 04 23:14:52.993820 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 164/307] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:52 2022] GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b => generated 1271 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:53.922951 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2052319a-2b73-4236-904e-2c9fb4794b1b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:53.924738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2052319a-2b73-4236-904e-2c9fb4794b1b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:53.933853 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2052319a-2b73-4236-904e-2c9fb4794b1b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:53.934623 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2052319a-2b73-4236-904e-2c9fb4794b1b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:53.935220 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2052319a-2b73-4236-904e-2c9fb4794b1b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:53.936138 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2052319a-2b73-4236-904e-2c9fb4794b1b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:53.936757 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2052319a-2b73-4236-904e-2c9fb4794b1b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:53.940347 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2052319a-2b73-4236-904e-2c9fb4794b1b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:54.022820 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ec439126-a6c7-4af9-82da-6c4e1f8d9a03 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:54.024776 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ec439126-a6c7-4af9-82da-6c4e1f8d9a03 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:54.039829 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ec439126-a6c7-4af9-82da-6c4e1f8d9a03 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:54.040344 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ec439126-a6c7-4af9-82da-6c4e1f8d9a03 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:54.040793 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ec439126-a6c7-4af9-82da-6c4e1f8d9a03 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:54.041513 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ec439126-a6c7-4af9-82da-6c4e1f8d9a03 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:54.041974 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ec439126-a6c7-4af9-82da-6c4e1f8d9a03 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:54.044388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ec439126-a6c7-4af9-82da-6c4e1f8d9a03 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:54.257094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2052319a-2b73-4236-904e-2c9fb4794b1b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:54.269621 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2052319a-2b73-4236-904e-2c9fb4794b1b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.356914 Aug 04 23:14:54.282983 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 144/308] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:53 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:54.287300 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-cce18451-01f8-4081-9392-13c6a2ee3fc5 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-369673317", "imageRef": "e1e9d70e-b252-44e5-9ecd-bf73cbf00160", "flavorRef": "452"}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:14:54.316240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ec439126-a6c7-4af9-82da-6c4e1f8d9a03 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:54.324645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ec439126-a6c7-4af9-82da-6c4e1f8d9a03 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b" status: 200 len: 1313 microversion: 2.1 time: 0.309292 Aug 04 23:14:54.325211 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 165/309] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:54 2022] GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:54.337482 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-cc8a8e16-250d-45fa-a18f-75d8eff5ec47 req-1e453521-38a6-48cf-bc7f-fe1665ba4eba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b", "tag": "e7a800e1-01e7-436e-bd1f-d763c07b21ba"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:14:54.349793 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:14:54.360792 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.network.neutron [None req-cce18451-01f8-4081-9392-13c6a2ee3fc5 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] validate_networks() for None {{(pid=129790) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 23:14:54.360996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-cc8a8e16-250d-45fa-a18f-75d8eff5ec47 req-1e453521-38a6-48cf-bc7f-fe1665ba4eba service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:54.363888 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-cc8a8e16-250d-45fa-a18f-75d8eff5ec47 req-1e453521-38a6-48cf-bc7f-fe1665ba4eba service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:54.364344 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-cc8a8e16-250d-45fa-a18f-75d8eff5ec47 req-1e453521-38a6-48cf-bc7f-fe1665ba4eba service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:54.382154 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-cc8a8e16-250d-45fa-a18f-75d8eff5ec47 req-1e453521-38a6-48cf-bc7f-fe1665ba4eba service nova] Creating event network-changed:e7a800e1-01e7-436e-bd1f-d763c07b21ba for instance 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b on hv-cinder-85221 Aug 04 23:14:54.388179 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-cc8a8e16-250d-45fa-a18f-75d8eff5ec47 req-1e453521-38a6-48cf-bc7f-fe1665ba4eba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058392 Aug 04 23:14:54.389094 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 166/310] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:14:54.902788 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-cce18451-01f8-4081-9392-13c6a2ee3fc5 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Flavor limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 23:14:54.903302 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-cce18451-01f8-4081-9392-13c6a2ee3fc5 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Image limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 23:14:54.903784 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-cce18451-01f8-4081-9392-13c6a2ee3fc5 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Flavor pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 23:14:54.904183 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-cce18451-01f8-4081-9392-13c6a2ee3fc5 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Image pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 23:14:54.904689 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-cce18451-01f8-4081-9392-13c6a2ee3fc5 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 23:14:54.922448 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cce18451-01f8-4081-9392-13c6a2ee3fc5 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:54.923046 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cce18451-01f8-4081-9392-13c6a2ee3fc5 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:54.923563 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cce18451-01f8-4081-9392-13c6a2ee3fc5 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:54.924289 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cce18451-01f8-4081-9392-13c6a2ee3fc5 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:54.924806 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cce18451-01f8-4081-9392-13c6a2ee3fc5 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:54.925311 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cce18451-01f8-4081-9392-13c6a2ee3fc5 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:54.943818 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-cce18451-01f8-4081-9392-13c6a2ee3fc5 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Getting quotas for project 5ca328ac921141f1b604aeaa4ea5fd15. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:14:54.948110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-cce18451-01f8-4081-9392-13c6a2ee3fc5 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Getting quotas for user 236ef8a26e1f400a9c082f95712f44e3 and project 5ca328ac921141f1b604aeaa4ea5fd15. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:14:54.960769 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-cce18451-01f8-4081-9392-13c6a2ee3fc5 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Going to run 1 instances... {{(pid=129790) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 23:14:54.963453 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-cce18451-01f8-4081-9392-13c6a2ee3fc5 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1e9d70e-b252-44e5-9ecd-bf73cbf00160',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129790) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 23:14:55.017812 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-cce18451-01f8-4081-9392-13c6a2ee3fc5 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.746030 Aug 04 23:14:55.018336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 145/311] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Aug 4 23:14:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 23:14:55.029712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-90c67e69-854e-4630-97aa-79c57ebb3451 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:55.031059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-90c67e69-854e-4630-97aa-79c57ebb3451 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:55.099686 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-90c67e69-854e-4630-97aa-79c57ebb3451 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236ef8a26e1f400a9c082f95712f44e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca328ac921141f1b604aeaa4ea5fd15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:55.107892 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-90c67e69-854e-4630-97aa-79c57ebb3451 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] 10.222.0.33 "GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2" status: 200 len: 1214 microversion: 2.1 time: 0.082569 Aug 04 23:14:55.108475 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 167/312] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:55 2022] GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:55.295022 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a1a14045-863c-41af-9152-deff1c30a909 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:55.295947 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a1a14045-863c-41af-9152-deff1c30a909 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:55.325772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a1a14045-863c-41af-9152-deff1c30a909 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:55.326383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a1a14045-863c-41af-9152-deff1c30a909 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:55.326837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a1a14045-863c-41af-9152-deff1c30a909 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:55.331222 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a1a14045-863c-41af-9152-deff1c30a909 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:55.331714 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a1a14045-863c-41af-9152-deff1c30a909 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:55.332479 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a1a14045-863c-41af-9152-deff1c30a909 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:55.351567 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7e06a072-392c-4121-9443-7d6ed61ae07d tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:55.352982 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7e06a072-392c-4121-9443-7d6ed61ae07d tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:55.362057 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e06a072-392c-4121-9443-7d6ed61ae07d tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:55.363481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e06a072-392c-4121-9443-7d6ed61ae07d tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:55.364203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e06a072-392c-4121-9443-7d6ed61ae07d tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:55.365674 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e06a072-392c-4121-9443-7d6ed61ae07d tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:55.368815 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e06a072-392c-4121-9443-7d6ed61ae07d tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:55.371356 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e06a072-392c-4121-9443-7d6ed61ae07d tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:55.605163 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7e06a072-392c-4121-9443-7d6ed61ae07d tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:55.609170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a1a14045-863c-41af-9152-deff1c30a909 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:55.621995 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7e06a072-392c-4121-9443-7d6ed61ae07d tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b" status: 200 len: 1313 microversion: 2.1 time: 0.278415 Aug 04 23:14:55.622965 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 168/313] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:55 2022] GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:55.623181 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a1a14045-863c-41af-9152-deff1c30a909 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.333887 Aug 04 23:14:55.637215 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 146/314] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:55 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:56.128562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0f968092-f4d1-4f99-a1f5-92825fe83002 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:56.129201 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0f968092-f4d1-4f99-a1f5-92825fe83002 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:56.135486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f968092-f4d1-4f99-a1f5-92825fe83002 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:56.135966 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f968092-f4d1-4f99-a1f5-92825fe83002 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:56.136421 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f968092-f4d1-4f99-a1f5-92825fe83002 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:56.137111 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f968092-f4d1-4f99-a1f5-92825fe83002 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:56.137555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f968092-f4d1-4f99-a1f5-92825fe83002 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:56.137972 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f968092-f4d1-4f99-a1f5-92825fe83002 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:56.153538 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:14:56.201300 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0f968092-f4d1-4f99-a1f5-92825fe83002 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236ef8a26e1f400a9c082f95712f44e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca328ac921141f1b604aeaa4ea5fd15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:56.208920 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0f968092-f4d1-4f99-a1f5-92825fe83002 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] 10.222.0.33 "GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2" status: 200 len: 1218 microversion: 2.1 time: 0.083992 Aug 04 23:14:56.209488 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 169/315] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:56 2022] GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:56.643197 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7caa857e-f772-4acb-b375-787652c6f5a2 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:56.643720 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7b1c7e31-24f9-432e-821a-ab5940f5df53 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:56.643857 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7b1c7e31-24f9-432e-821a-ab5940f5df53 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:56.644115 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7caa857e-f772-4acb-b375-787652c6f5a2 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:56.649897 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7b1c7e31-24f9-432e-821a-ab5940f5df53 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:56.650630 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7b1c7e31-24f9-432e-821a-ab5940f5df53 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:56.651057 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7b1c7e31-24f9-432e-821a-ab5940f5df53 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:56.651811 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7b1c7e31-24f9-432e-821a-ab5940f5df53 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:56.652012 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7caa857e-f772-4acb-b375-787652c6f5a2 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:56.652395 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7b1c7e31-24f9-432e-821a-ab5940f5df53 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:56.652822 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7b1c7e31-24f9-432e-821a-ab5940f5df53 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:56.653528 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7caa857e-f772-4acb-b375-787652c6f5a2 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:56.654502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7caa857e-f772-4acb-b375-787652c6f5a2 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:56.655665 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7caa857e-f772-4acb-b375-787652c6f5a2 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:56.656342 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7caa857e-f772-4acb-b375-787652c6f5a2 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:56.656966 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7caa857e-f772-4acb-b375-787652c6f5a2 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:56.873609 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7caa857e-f772-4acb-b375-787652c6f5a2 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:56.876368 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7b1c7e31-24f9-432e-821a-ab5940f5df53 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:56.877472 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:14:56.884403 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7b1c7e31-24f9-432e-821a-ab5940f5df53 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.244823 Aug 04 23:14:56.885000 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 170/316] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:56 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:56.888632 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7caa857e-f772-4acb-b375-787652c6f5a2 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b" status: 200 len: 1313 microversion: 2.1 time: 0.245742 Aug 04 23:14:56.891573 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 147/317] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:56 2022] GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:57.233487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-556d4044-27dd-4e20-b4ec-4c110131ea2d tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:57.234137 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-556d4044-27dd-4e20-b4ec-4c110131ea2d tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:57.243633 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-556d4044-27dd-4e20-b4ec-4c110131ea2d tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:57.244379 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-556d4044-27dd-4e20-b4ec-4c110131ea2d tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:57.245065 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-556d4044-27dd-4e20-b4ec-4c110131ea2d tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:57.247307 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-556d4044-27dd-4e20-b4ec-4c110131ea2d tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:57.247967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-556d4044-27dd-4e20-b4ec-4c110131ea2d tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:57.248543 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-556d4044-27dd-4e20-b4ec-4c110131ea2d tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:57.322447 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-556d4044-27dd-4e20-b4ec-4c110131ea2d tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236ef8a26e1f400a9c082f95712f44e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca328ac921141f1b604aeaa4ea5fd15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:57.334108 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-556d4044-27dd-4e20-b4ec-4c110131ea2d tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] 10.222.0.33 "GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2" status: 200 len: 1210 microversion: 2.1 time: 0.105723 Aug 04 23:14:57.335294 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 171/318] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:57 2022] GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 => generated 1210 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:57.912008 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1b5a9dee-6999-4a49-b0fa-d6c67ef9fbb4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:57.912008 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1b5a9dee-6999-4a49-b0fa-d6c67ef9fbb4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:57.916493 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1b5a9dee-6999-4a49-b0fa-d6c67ef9fbb4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:57.917514 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4c57be46-875c-4f4b-9ae2-77ccd897a650 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:57.918197 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1b5a9dee-6999-4a49-b0fa-d6c67ef9fbb4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:57.918197 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1b5a9dee-6999-4a49-b0fa-d6c67ef9fbb4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:57.918427 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4c57be46-875c-4f4b-9ae2-77ccd897a650 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:57.919794 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1b5a9dee-6999-4a49-b0fa-d6c67ef9fbb4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:57.920343 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1b5a9dee-6999-4a49-b0fa-d6c67ef9fbb4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:57.921270 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1b5a9dee-6999-4a49-b0fa-d6c67ef9fbb4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:57.934040 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4c57be46-875c-4f4b-9ae2-77ccd897a650 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:57.934634 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4c57be46-875c-4f4b-9ae2-77ccd897a650 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:57.935127 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4c57be46-875c-4f4b-9ae2-77ccd897a650 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:57.935907 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4c57be46-875c-4f4b-9ae2-77ccd897a650 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:57.936459 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4c57be46-875c-4f4b-9ae2-77ccd897a650 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:57.936926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4c57be46-875c-4f4b-9ae2-77ccd897a650 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:58.114779 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1b5a9dee-6999-4a49-b0fa-d6c67ef9fbb4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:58.123545 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1b5a9dee-6999-4a49-b0fa-d6c67ef9fbb4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.222427 Aug 04 23:14:58.124186 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 148/319] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:57 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:58.142351 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4c57be46-875c-4f4b-9ae2-77ccd897a650 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:58.154032 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4c57be46-875c-4f4b-9ae2-77ccd897a650 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b" status: 200 len: 1313 microversion: 2.1 time: 0.237037 Aug 04 23:14:58.154032 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 172/320] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:57 2022] GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:58.356002 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4f73916a-612d-4c6b-8ed1-eac4875cc680 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:58.356691 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4f73916a-612d-4c6b-8ed1-eac4875cc680 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:58.363061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f73916a-612d-4c6b-8ed1-eac4875cc680 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:58.363616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f73916a-612d-4c6b-8ed1-eac4875cc680 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:58.364579 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f73916a-612d-4c6b-8ed1-eac4875cc680 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:58.364919 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f73916a-612d-4c6b-8ed1-eac4875cc680 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:58.365438 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f73916a-612d-4c6b-8ed1-eac4875cc680 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:58.365867 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f73916a-612d-4c6b-8ed1-eac4875cc680 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:58.429535 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4f73916a-612d-4c6b-8ed1-eac4875cc680 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236ef8a26e1f400a9c082f95712f44e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca328ac921141f1b604aeaa4ea5fd15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:58.438312 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4f73916a-612d-4c6b-8ed1-eac4875cc680 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] 10.222.0.33 "GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2" status: 200 len: 1266 microversion: 2.1 time: 0.086689 Aug 04 23:14:58.438919 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 149/321] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:58 2022] GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:59.145347 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e65de1a7-0e02-4123-8167-ae277b948e79 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:59.145778 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e65de1a7-0e02-4123-8167-ae277b948e79 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:59.152905 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e65de1a7-0e02-4123-8167-ae277b948e79 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:59.153754 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e65de1a7-0e02-4123-8167-ae277b948e79 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:59.154474 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e65de1a7-0e02-4123-8167-ae277b948e79 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:59.155439 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e65de1a7-0e02-4123-8167-ae277b948e79 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:59.156110 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e65de1a7-0e02-4123-8167-ae277b948e79 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:59.156751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e65de1a7-0e02-4123-8167-ae277b948e79 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:59.172931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-903de665-4f9c-4e19-ace0-7a9fdd2dee57 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:59.174244 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-903de665-4f9c-4e19-ace0-7a9fdd2dee57 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:59.184696 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-903de665-4f9c-4e19-ace0-7a9fdd2dee57 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:59.188883 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-903de665-4f9c-4e19-ace0-7a9fdd2dee57 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:59.189612 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-903de665-4f9c-4e19-ace0-7a9fdd2dee57 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:59.190990 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-903de665-4f9c-4e19-ace0-7a9fdd2dee57 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:59.191681 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-903de665-4f9c-4e19-ace0-7a9fdd2dee57 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:59.192765 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-903de665-4f9c-4e19-ace0-7a9fdd2dee57 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:59.454225 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-903de665-4f9c-4e19-ace0-7a9fdd2dee57 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:59.465474 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-903de665-4f9c-4e19-ace0-7a9fdd2dee57 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b" status: 200 len: 1313 microversion: 2.1 time: 0.295912 Aug 04 23:14:59.478386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 150/322] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:59 2022] GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:14:59.478386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3aa224b1-2d1e-46c2-b025-17367206cc52 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:14:59.478386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3aa224b1-2d1e-46c2-b025-17367206cc52 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:14:59.478748 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e65de1a7-0e02-4123-8167-ae277b948e79 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:59.481652 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3aa224b1-2d1e-46c2-b025-17367206cc52 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:59.483146 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3aa224b1-2d1e-46c2-b025-17367206cc52 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:59.483856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3aa224b1-2d1e-46c2-b025-17367206cc52 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:59.485331 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3aa224b1-2d1e-46c2-b025-17367206cc52 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:14:59.485848 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3aa224b1-2d1e-46c2-b025-17367206cc52 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:14:59.486630 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3aa224b1-2d1e-46c2-b025-17367206cc52 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:14:59.492820 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e65de1a7-0e02-4123-8167-ae277b948e79 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.351431 Aug 04 23:14:59.494495 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 173/323] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:59 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:14:59.591241 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3aa224b1-2d1e-46c2-b025-17367206cc52 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236ef8a26e1f400a9c082f95712f44e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca328ac921141f1b604aeaa4ea5fd15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:14:59.603129 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3aa224b1-2d1e-46c2-b025-17367206cc52 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] 10.222.0.33 "GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2" status: 200 len: 1272 microversion: 2.1 time: 0.135363 Aug 04 23:14:59.604947 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 151/324] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:14:59 2022] GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 => generated 1272 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:00.490603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-90053a90-9dd4-4bd6-a4ab-4b73f11a336e tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:00.491241 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-90053a90-9dd4-4bd6-a4ab-4b73f11a336e tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:00.498107 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-90053a90-9dd4-4bd6-a4ab-4b73f11a336e tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:00.498591 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-90053a90-9dd4-4bd6-a4ab-4b73f11a336e tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:00.499026 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-90053a90-9dd4-4bd6-a4ab-4b73f11a336e tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:00.499722 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-90053a90-9dd4-4bd6-a4ab-4b73f11a336e tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:00.500172 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-90053a90-9dd4-4bd6-a4ab-4b73f11a336e tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:00.500587 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-90053a90-9dd4-4bd6-a4ab-4b73f11a336e tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:00.513060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a60278f8-e117-4008-9fdf-644138fb119e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:00.514562 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a60278f8-e117-4008-9fdf-644138fb119e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:00.520939 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a60278f8-e117-4008-9fdf-644138fb119e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:00.521417 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a60278f8-e117-4008-9fdf-644138fb119e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:00.522216 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a60278f8-e117-4008-9fdf-644138fb119e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:00.522938 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a60278f8-e117-4008-9fdf-644138fb119e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:00.523382 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a60278f8-e117-4008-9fdf-644138fb119e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:00.524133 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a60278f8-e117-4008-9fdf-644138fb119e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:00.688907 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-90053a90-9dd4-4bd6-a4ab-4b73f11a336e tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:00.696956 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-90053a90-9dd4-4bd6-a4ab-4b73f11a336e tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b" status: 200 len: 1313 microversion: 2.1 time: 0.210315 Aug 04 23:15:00.698327 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 174/325] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:00 2022] GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:00.703950 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e2edde64-2d74-4319-b7bc-361e34b3f3dd tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:00.704904 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e2edde64-2d74-4319-b7bc-361e34b3f3dd tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:00.715045 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2edde64-2d74-4319-b7bc-361e34b3f3dd tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:00.715841 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2edde64-2d74-4319-b7bc-361e34b3f3dd tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:00.716556 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2edde64-2d74-4319-b7bc-361e34b3f3dd tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:00.717555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2edde64-2d74-4319-b7bc-361e34b3f3dd tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:00.718292 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2edde64-2d74-4319-b7bc-361e34b3f3dd tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:00.719009 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2edde64-2d74-4319-b7bc-361e34b3f3dd tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:00.927254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a60278f8-e117-4008-9fdf-644138fb119e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:00.935530 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a60278f8-e117-4008-9fdf-644138fb119e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1522 microversion: 2.1 time: 0.426266 Aug 04 23:15:00.947614 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 152/326] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:00 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1522 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:15:00.965522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e2edde64-2d74-4319-b7bc-361e34b3f3dd tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236ef8a26e1f400a9c082f95712f44e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca328ac921141f1b604aeaa4ea5fd15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:00.973872 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e2edde64-2d74-4319-b7bc-361e34b3f3dd tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] 10.222.0.33 "GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2" status: 200 len: 1314 microversion: 2.1 time: 0.274026 Aug 04 23:15:00.974453 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 175/327] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:00 2022] GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:01.257720 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-02ce8445-ee1f-44cf-9060-689cfd0ab253 req-69c8b484-26d4-4c4a-8f20-f166985ac8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d3619e-a1d3-4733-aa99-77fc99e9e7d2", "tag": "2504ae4a-43be-4f84-b551-e2f19a1601c0"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:15:01.267965 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-02ce8445-ee1f-44cf-9060-689cfd0ab253 req-69c8b484-26d4-4c4a-8f20-f166985ac8b8 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:01.268501 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-02ce8445-ee1f-44cf-9060-689cfd0ab253 req-69c8b484-26d4-4c4a-8f20-f166985ac8b8 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:01.269005 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-02ce8445-ee1f-44cf-9060-689cfd0ab253 req-69c8b484-26d4-4c4a-8f20-f166985ac8b8 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:01.280425 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-02ce8445-ee1f-44cf-9060-689cfd0ab253 req-69c8b484-26d4-4c4a-8f20-f166985ac8b8 service nova] Creating event network-changed:2504ae4a-43be-4f84-b551-e2f19a1601c0 for instance e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 on hv-cinder-85221 Aug 04 23:15:01.286114 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-02ce8445-ee1f-44cf-9060-689cfd0ab253 req-69c8b484-26d4-4c4a-8f20-f166985ac8b8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032028 Aug 04 23:15:01.286905 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 153/328] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:15:01.720945 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-24a7cd5d-06e5-4003-a757-b9938f5f02d3 req-fe996282-e15c-46ca-bfc8-08f69bec23de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b", "name": "network-vif-plugged", "status": "completed", "tag": "e7a800e1-01e7-436e-bd1f-d763c07b21ba"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:15:01.721506 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-45a8b464-1aef-4a95-8a8e-ba672022bb26 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:01.722065 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-45a8b464-1aef-4a95-8a8e-ba672022bb26 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:01.733297 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-45a8b464-1aef-4a95-8a8e-ba672022bb26 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:01.734655 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-45a8b464-1aef-4a95-8a8e-ba672022bb26 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:01.735470 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-45a8b464-1aef-4a95-8a8e-ba672022bb26 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:01.735641 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-24a7cd5d-06e5-4003-a757-b9938f5f02d3 req-fe996282-e15c-46ca-bfc8-08f69bec23de service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:01.736250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-24a7cd5d-06e5-4003-a757-b9938f5f02d3 req-fe996282-e15c-46ca-bfc8-08f69bec23de service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:01.736609 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-24a7cd5d-06e5-4003-a757-b9938f5f02d3 req-fe996282-e15c-46ca-bfc8-08f69bec23de service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:01.737187 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-45a8b464-1aef-4a95-8a8e-ba672022bb26 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:01.737796 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-45a8b464-1aef-4a95-8a8e-ba672022bb26 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:01.739294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-45a8b464-1aef-4a95-8a8e-ba672022bb26 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:01.756987 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-24a7cd5d-06e5-4003-a757-b9938f5f02d3 req-fe996282-e15c-46ca-bfc8-08f69bec23de service nova] Creating event network-vif-plugged:e7a800e1-01e7-436e-bd1f-d763c07b21ba for instance 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b on hv-cinder-85221 Aug 04 23:15:01.765549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-24a7cd5d-06e5-4003-a757-b9938f5f02d3 req-fe996282-e15c-46ca-bfc8-08f69bec23de service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048193 Aug 04 23:15:01.766428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 176/329] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:15:01.947040 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-45a8b464-1aef-4a95-8a8e-ba672022bb26 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:01.957980 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-45a8b464-1aef-4a95-8a8e-ba672022bb26 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b" status: 200 len: 1313 microversion: 2.1 time: 0.240982 Aug 04 23:15:01.958574 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 154/330] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:01 2022] GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:01.964100 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e01d3561-632b-4b01-8aea-991b36df8b88 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:01.964100 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e01d3561-632b-4b01-8aea-991b36df8b88 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:01.970768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e01d3561-632b-4b01-8aea-991b36df8b88 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:01.971252 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e01d3561-632b-4b01-8aea-991b36df8b88 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:01.971713 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e01d3561-632b-4b01-8aea-991b36df8b88 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:01.972438 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e01d3561-632b-4b01-8aea-991b36df8b88 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:01.972888 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e01d3561-632b-4b01-8aea-991b36df8b88 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:01.973306 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e01d3561-632b-4b01-8aea-991b36df8b88 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:01.997052 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6e076270-5578-4298-9f2b-4c7ca232ff5c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:01.997879 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6e076270-5578-4298-9f2b-4c7ca232ff5c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:02.004276 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e076270-5578-4298-9f2b-4c7ca232ff5c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:02.004755 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e076270-5578-4298-9f2b-4c7ca232ff5c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:02.005315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e076270-5578-4298-9f2b-4c7ca232ff5c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:02.006012 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e076270-5578-4298-9f2b-4c7ca232ff5c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:02.006619 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e076270-5578-4298-9f2b-4c7ca232ff5c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:02.007048 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e076270-5578-4298-9f2b-4c7ca232ff5c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:02.203396 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e01d3561-632b-4b01-8aea-991b36df8b88 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:02.207479 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6e076270-5578-4298-9f2b-4c7ca232ff5c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236ef8a26e1f400a9c082f95712f44e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca328ac921141f1b604aeaa4ea5fd15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:02.211305 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e01d3561-632b-4b01-8aea-991b36df8b88 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1502 microversion: 2.1 time: 0.254489 Aug 04 23:15:02.212145 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 177/331] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:01 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1502 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:15:02.215902 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6e076270-5578-4298-9f2b-4c7ca232ff5c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] 10.222.0.33 "GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2" status: 200 len: 1314 microversion: 2.1 time: 0.224014 Aug 04 23:15:02.216367 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 155/332] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:01 2022] GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:15:02.233280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-070ee4ba-3a55-44f7-a7e5-b04925462908 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:02.233888 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-070ee4ba-3a55-44f7-a7e5-b04925462908 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:02.239854 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-070ee4ba-3a55-44f7-a7e5-b04925462908 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:02.240331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-070ee4ba-3a55-44f7-a7e5-b04925462908 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:02.240759 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-070ee4ba-3a55-44f7-a7e5-b04925462908 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:02.241524 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-070ee4ba-3a55-44f7-a7e5-b04925462908 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:02.242056 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-070ee4ba-3a55-44f7-a7e5-b04925462908 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:02.242499 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-070ee4ba-3a55-44f7-a7e5-b04925462908 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:02.513649 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-070ee4ba-3a55-44f7-a7e5-b04925462908 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:02.521107 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-070ee4ba-3a55-44f7-a7e5-b04925462908 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1517 microversion: 2.1 time: 0.292390 Aug 04 23:15:02.521814 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 178/333] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:02 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1517 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:15:02.981462 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-431e69e5-46e0-4eea-95a3-9fc3daf235ad tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:02.982098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-431e69e5-46e0-4eea-95a3-9fc3daf235ad tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:02.989551 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-431e69e5-46e0-4eea-95a3-9fc3daf235ad tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:02.990032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-431e69e5-46e0-4eea-95a3-9fc3daf235ad tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:02.990811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-431e69e5-46e0-4eea-95a3-9fc3daf235ad tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:02.991469 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-431e69e5-46e0-4eea-95a3-9fc3daf235ad tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:02.992350 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-431e69e5-46e0-4eea-95a3-9fc3daf235ad tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:02.992717 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-431e69e5-46e0-4eea-95a3-9fc3daf235ad tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:03.132273 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-431e69e5-46e0-4eea-95a3-9fc3daf235ad tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:03.140539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-431e69e5-46e0-4eea-95a3-9fc3daf235ad tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b" status: 200 len: 1313 microversion: 2.1 time: 0.163094 Aug 04 23:15:03.141093 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 156/334] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:02 2022] GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:03.237099 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c4227460-29bd-4be2-abf3-396fb60d5a11 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:03.237704 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c4227460-29bd-4be2-abf3-396fb60d5a11 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:03.243698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c4227460-29bd-4be2-abf3-396fb60d5a11 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:03.244168 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c4227460-29bd-4be2-abf3-396fb60d5a11 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:03.244594 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c4227460-29bd-4be2-abf3-396fb60d5a11 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:03.245274 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c4227460-29bd-4be2-abf3-396fb60d5a11 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:03.245776 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c4227460-29bd-4be2-abf3-396fb60d5a11 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:03.246202 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c4227460-29bd-4be2-abf3-396fb60d5a11 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:03.373296 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c4227460-29bd-4be2-abf3-396fb60d5a11 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236ef8a26e1f400a9c082f95712f44e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca328ac921141f1b604aeaa4ea5fd15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:03.380592 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c4227460-29bd-4be2-abf3-396fb60d5a11 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] 10.222.0.33 "GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2" status: 200 len: 1314 microversion: 2.1 time: 0.147409 Aug 04 23:15:03.381155 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 179/335] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:03 2022] GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:03.926579 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8aa6c62f-8777-4027-a080-7dcdb489e1f2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:15:03.928774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8aa6c62f-8777-4027-a080-7dcdb489e1f2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:03.931233 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:15:03.937912 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8aa6c62f-8777-4027-a080-7dcdb489e1f2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:03.938427 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8aa6c62f-8777-4027-a080-7dcdb489e1f2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:03.938865 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8aa6c62f-8777-4027-a080-7dcdb489e1f2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:03.939579 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8aa6c62f-8777-4027-a080-7dcdb489e1f2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:03.940032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8aa6c62f-8777-4027-a080-7dcdb489e1f2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:03.940448 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8aa6c62f-8777-4027-a080-7dcdb489e1f2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:03.968020 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.objects.instance [None req-8aa6c62f-8777-4027-a080-7dcdb489e1f2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lazy-loading 'flavor' on Instance uuid 9b9e29c3-d35b-4e35-90fb-6184265d0ecf {{(pid=129790) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:15:04.091332 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8aa6c62f-8777-4027-a080-7dcdb489e1f2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "POST /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf/action" status: 200 len: 32 microversion: 2.1 time: 0.168055 Aug 04 23:15:04.092433 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 157/336] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Aug 4 23:15:03 2022] POST /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 23:15:04.106262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-28e855b5-7e8c-464d-acf2-fa1c01cb02a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:04.107878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-28e855b5-7e8c-464d-acf2-fa1c01cb02a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:04.118233 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28e855b5-7e8c-464d-acf2-fa1c01cb02a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:04.119063 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28e855b5-7e8c-464d-acf2-fa1c01cb02a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:04.119769 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28e855b5-7e8c-464d-acf2-fa1c01cb02a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:04.121482 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28e855b5-7e8c-464d-acf2-fa1c01cb02a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:04.122405 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28e855b5-7e8c-464d-acf2-fa1c01cb02a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:04.123121 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28e855b5-7e8c-464d-acf2-fa1c01cb02a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:04.162674 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-886588dc-2eac-423c-b71f-b3eacc600d72 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:04.163608 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-886588dc-2eac-423c-b71f-b3eacc600d72 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:04.171820 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-886588dc-2eac-423c-b71f-b3eacc600d72 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:04.172297 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-886588dc-2eac-423c-b71f-b3eacc600d72 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:04.172718 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-886588dc-2eac-423c-b71f-b3eacc600d72 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:04.173410 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-886588dc-2eac-423c-b71f-b3eacc600d72 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:04.173887 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-886588dc-2eac-423c-b71f-b3eacc600d72 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:04.174474 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-886588dc-2eac-423c-b71f-b3eacc600d72 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:04.599194 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-28e855b5-7e8c-464d-acf2-fa1c01cb02a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:04.608125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-28e855b5-7e8c-464d-acf2-fa1c01cb02a6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1523 microversion: 2.1 time: 0.509847 Aug 04 23:15:04.608780 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 180/337] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:04 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1523 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:04.609661 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-886588dc-2eac-423c-b71f-b3eacc600d72 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:04.614196 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1ea93450-33bd-469c-85c0-e3dd82a3fe7c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:04.614743 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1ea93450-33bd-469c-85c0-e3dd82a3fe7c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:04.621026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-886588dc-2eac-423c-b71f-b3eacc600d72 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b" status: 200 len: 1313 microversion: 2.1 time: 0.462698 Aug 04 23:15:04.621596 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ea93450-33bd-469c-85c0-e3dd82a3fe7c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:04.621747 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 158/338] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:04 2022] GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b => generated 1313 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:15:04.622383 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ea93450-33bd-469c-85c0-e3dd82a3fe7c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:04.622824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ea93450-33bd-469c-85c0-e3dd82a3fe7c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:04.623535 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ea93450-33bd-469c-85c0-e3dd82a3fe7c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:04.623992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ea93450-33bd-469c-85c0-e3dd82a3fe7c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:04.624414 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ea93450-33bd-469c-85c0-e3dd82a3fe7c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:04.766292 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1ea93450-33bd-469c-85c0-e3dd82a3fe7c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236ef8a26e1f400a9c082f95712f44e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca328ac921141f1b604aeaa4ea5fd15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:04.774062 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1ea93450-33bd-469c-85c0-e3dd82a3fe7c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] 10.222.0.33 "GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2" status: 200 len: 1314 microversion: 2.1 time: 0.164148 Aug 04 23:15:04.774665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 181/339] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:04 2022] GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:05.635531 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6719f6bd-dd64-4e74-aafb-b45ba7857eb2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:05.636166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6719f6bd-dd64-4e74-aafb-b45ba7857eb2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:05.638864 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=4 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:15:05.639521 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=12 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:15:05.643561 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9c622d61-7aa5-4dc1-beb5-f9a506a3dad0 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:05.644183 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9c622d61-7aa5-4dc1-beb5-f9a506a3dad0 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:05.646063 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6719f6bd-dd64-4e74-aafb-b45ba7857eb2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:05.646190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=4 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:15:05.646580 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6719f6bd-dd64-4e74-aafb-b45ba7857eb2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:05.647009 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6719f6bd-dd64-4e74-aafb-b45ba7857eb2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:05.647818 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6719f6bd-dd64-4e74-aafb-b45ba7857eb2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:05.648287 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6719f6bd-dd64-4e74-aafb-b45ba7857eb2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:05.648702 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6719f6bd-dd64-4e74-aafb-b45ba7857eb2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:05.654489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c622d61-7aa5-4dc1-beb5-f9a506a3dad0 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:05.655236 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c622d61-7aa5-4dc1-beb5-f9a506a3dad0 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:05.655670 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c622d61-7aa5-4dc1-beb5-f9a506a3dad0 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:05.656374 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c622d61-7aa5-4dc1-beb5-f9a506a3dad0 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:05.656938 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c622d61-7aa5-4dc1-beb5-f9a506a3dad0 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:05.657363 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c622d61-7aa5-4dc1-beb5-f9a506a3dad0 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:05.869024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6719f6bd-dd64-4e74-aafb-b45ba7857eb2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:05.872768 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6719f6bd-dd64-4e74-aafb-b45ba7857eb2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1523 microversion: 2.1 time: 0.240921 Aug 04 23:15:05.873751 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 159/340] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:05 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:05.883546 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9c622d61-7aa5-4dc1-beb5-f9a506a3dad0 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:05.889573 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-84ba5080-2cdd-4464-897e-cd3c5b661999 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:05.890451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9c622d61-7aa5-4dc1-beb5-f9a506a3dad0 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b" status: 200 len: 1313 microversion: 2.1 time: 0.250617 Aug 04 23:15:05.890628 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-84ba5080-2cdd-4464-897e-cd3c5b661999 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:05.892262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 182/341] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:05 2022] GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:05.897092 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-84ba5080-2cdd-4464-897e-cd3c5b661999 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:05.897640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-84ba5080-2cdd-4464-897e-cd3c5b661999 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:05.898142 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-84ba5080-2cdd-4464-897e-cd3c5b661999 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:05.898945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-84ba5080-2cdd-4464-897e-cd3c5b661999 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:05.899500 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-84ba5080-2cdd-4464-897e-cd3c5b661999 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:05.899922 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-84ba5080-2cdd-4464-897e-cd3c5b661999 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:06.043363 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-84ba5080-2cdd-4464-897e-cd3c5b661999 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236ef8a26e1f400a9c082f95712f44e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca328ac921141f1b604aeaa4ea5fd15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:06.055680 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-84ba5080-2cdd-4464-897e-cd3c5b661999 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] 10.222.0.33 "GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2" status: 200 len: 1314 microversion: 2.1 time: 0.180709 Aug 04 23:15:06.056269 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 160/342] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:05 2022] GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:06.893481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a8e93b9a-f9be-4cc8-a747-cecceea934ca tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:06.894081 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a8e93b9a-f9be-4cc8-a747-cecceea934ca tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:06.900196 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8e93b9a-f9be-4cc8-a747-cecceea934ca tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:06.900667 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8e93b9a-f9be-4cc8-a747-cecceea934ca tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:06.901090 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8e93b9a-f9be-4cc8-a747-cecceea934ca tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:06.901771 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8e93b9a-f9be-4cc8-a747-cecceea934ca tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:06.902796 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8e93b9a-f9be-4cc8-a747-cecceea934ca tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:06.903522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8e93b9a-f9be-4cc8-a747-cecceea934ca tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:06.913621 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8e3ea046-a907-4581-b10a-0d5244431872 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:06.914233 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8e3ea046-a907-4581-b10a-0d5244431872 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:06.921664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8e3ea046-a907-4581-b10a-0d5244431872 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:06.922148 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8e3ea046-a907-4581-b10a-0d5244431872 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:06.922621 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8e3ea046-a907-4581-b10a-0d5244431872 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:06.923329 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8e3ea046-a907-4581-b10a-0d5244431872 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:06.923761 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8e3ea046-a907-4581-b10a-0d5244431872 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:06.924182 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8e3ea046-a907-4581-b10a-0d5244431872 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:07.122136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a8e93b9a-f9be-4cc8-a747-cecceea934ca tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:07.126575 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8e3ea046-a907-4581-b10a-0d5244431872 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:07.131097 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a8e93b9a-f9be-4cc8-a747-cecceea934ca tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1523 microversion: 2.1 time: 0.241759 Aug 04 23:15:07.131768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 183/343] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:06 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:07.140131 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8e3ea046-a907-4581-b10a-0d5244431872 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b" status: 200 len: 1496 microversion: 2.1 time: 0.225206 Aug 04 23:15:07.140131 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 161/344] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:06 2022] GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b => generated 1496 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:07.143834 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-bddad95a-c975-452e-bbaf-8cfa8ffd812d tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:07.144511 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-bddad95a-c975-452e-bbaf-8cfa8ffd812d tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:07.150454 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bddad95a-c975-452e-bbaf-8cfa8ffd812d tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:07.151142 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bddad95a-c975-452e-bbaf-8cfa8ffd812d tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:07.151344 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bddad95a-c975-452e-bbaf-8cfa8ffd812d tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:07.152637 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bddad95a-c975-452e-bbaf-8cfa8ffd812d tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:07.153191 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bddad95a-c975-452e-bbaf-8cfa8ffd812d tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:07.153771 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bddad95a-c975-452e-bbaf-8cfa8ffd812d tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:07.301773 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-bddad95a-c975-452e-bbaf-8cfa8ffd812d tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236ef8a26e1f400a9c082f95712f44e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca328ac921141f1b604aeaa4ea5fd15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:07.311677 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-bddad95a-c975-452e-bbaf-8cfa8ffd812d tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] 10.222.0.33 "GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2" status: 200 len: 1314 microversion: 2.1 time: 0.175585 Aug 04 23:15:07.312264 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 162/345] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:07 2022] GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:07.599311 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a81bab3b-c827-47a1-9637-8bbd7e895b49 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:07.599857 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a81bab3b-c827-47a1-9637-8bbd7e895b49 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:07.606385 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a81bab3b-c827-47a1-9637-8bbd7e895b49 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:07.606870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a81bab3b-c827-47a1-9637-8bbd7e895b49 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:07.607293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a81bab3b-c827-47a1-9637-8bbd7e895b49 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:07.608161 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a81bab3b-c827-47a1-9637-8bbd7e895b49 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:07.608605 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a81bab3b-c827-47a1-9637-8bbd7e895b49 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:07.609018 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a81bab3b-c827-47a1-9637-8bbd7e895b49 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:07.637848 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a81bab3b-c827-47a1-9637-8bbd7e895b49 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b] Going to try to terminate instance {{(pid=129791) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 23:15:07.718628 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a81bab3b-c827-47a1-9637-8bbd7e895b49 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b" status: 204 len: 0 microversion: 2.1 time: 0.122624 Aug 04 23:15:07.722456 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 184/346] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:15:07 2022] DELETE /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 23:15:07.729588 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a02436ad-bbec-4c16-bc7d-b6c5e3eb7264 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:07.730225 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a02436ad-bbec-4c16-bc7d-b6c5e3eb7264 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:07.736281 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a02436ad-bbec-4c16-bc7d-b6c5e3eb7264 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:07.736766 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a02436ad-bbec-4c16-bc7d-b6c5e3eb7264 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:07.737198 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a02436ad-bbec-4c16-bc7d-b6c5e3eb7264 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:07.737898 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a02436ad-bbec-4c16-bc7d-b6c5e3eb7264 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:07.738485 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a02436ad-bbec-4c16-bc7d-b6c5e3eb7264 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:07.738915 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a02436ad-bbec-4c16-bc7d-b6c5e3eb7264 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:07.743377 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:15:07.885230 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a02436ad-bbec-4c16-bc7d-b6c5e3eb7264 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:07.893469 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a02436ad-bbec-4c16-bc7d-b6c5e3eb7264 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b" status: 200 len: 1502 microversion: 2.1 time: 0.169060 Aug 04 23:15:07.894032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 163/347] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:07 2022] GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:08.153836 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-707ab18e-b31a-4325-bc81-a4374d281e00 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:08.154504 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-707ab18e-b31a-4325-bc81-a4374d281e00 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:08.160488 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-707ab18e-b31a-4325-bc81-a4374d281e00 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:08.160969 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-707ab18e-b31a-4325-bc81-a4374d281e00 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:08.161400 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-707ab18e-b31a-4325-bc81-a4374d281e00 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:08.162085 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-707ab18e-b31a-4325-bc81-a4374d281e00 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:08.162565 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-707ab18e-b31a-4325-bc81-a4374d281e00 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:08.162988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-707ab18e-b31a-4325-bc81-a4374d281e00 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:08.165618 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:15:08.305115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-707ab18e-b31a-4325-bc81-a4374d281e00 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:08.313581 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-707ab18e-b31a-4325-bc81-a4374d281e00 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1523 microversion: 2.1 time: 0.164756 Aug 04 23:15:08.314336 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 185/348] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:08 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:08.332578 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f963dfc4-2d49-4160-bc85-16d77483bc12 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:08.333185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f963dfc4-2d49-4160-bc85-16d77483bc12 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:08.341129 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f963dfc4-2d49-4160-bc85-16d77483bc12 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:08.341599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f963dfc4-2d49-4160-bc85-16d77483bc12 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:08.342024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f963dfc4-2d49-4160-bc85-16d77483bc12 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:08.342742 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f963dfc4-2d49-4160-bc85-16d77483bc12 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:08.343188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f963dfc4-2d49-4160-bc85-16d77483bc12 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:08.343597 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f963dfc4-2d49-4160-bc85-16d77483bc12 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:08.486987 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f963dfc4-2d49-4160-bc85-16d77483bc12 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236ef8a26e1f400a9c082f95712f44e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca328ac921141f1b604aeaa4ea5fd15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:08.494404 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f963dfc4-2d49-4160-bc85-16d77483bc12 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] 10.222.0.33 "GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2" status: 200 len: 1314 microversion: 2.1 time: 0.165726 Aug 04 23:15:08.494966 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 164/349] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:08 2022] GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:08.914859 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-be1748bf-402c-40ca-90d2-e3105219b73c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:08.915524 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-be1748bf-402c-40ca-90d2-e3105219b73c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:08.921750 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be1748bf-402c-40ca-90d2-e3105219b73c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:08.922235 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be1748bf-402c-40ca-90d2-e3105219b73c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:08.922706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be1748bf-402c-40ca-90d2-e3105219b73c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:08.923407 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be1748bf-402c-40ca-90d2-e3105219b73c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:08.923850 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be1748bf-402c-40ca-90d2-e3105219b73c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:08.924275 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be1748bf-402c-40ca-90d2-e3105219b73c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:09.054175 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-be1748bf-402c-40ca-90d2-e3105219b73c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:09.062786 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-be1748bf-402c-40ca-90d2-e3105219b73c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b" status: 200 len: 1502 microversion: 2.1 time: 0.152184 Aug 04 23:15:09.063339 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 186/350] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:08 2022] GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:09.335103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b0f3f446-3302-49e7-a22b-65910fc67a48 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:09.335656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b0f3f446-3302-49e7-a22b-65910fc67a48 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:09.343105 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0f3f446-3302-49e7-a22b-65910fc67a48 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:09.343577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0f3f446-3302-49e7-a22b-65910fc67a48 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:09.343999 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0f3f446-3302-49e7-a22b-65910fc67a48 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:09.344674 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0f3f446-3302-49e7-a22b-65910fc67a48 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:09.345117 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0f3f446-3302-49e7-a22b-65910fc67a48 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:09.345562 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0f3f446-3302-49e7-a22b-65910fc67a48 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:09.475847 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b0f3f446-3302-49e7-a22b-65910fc67a48 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:09.483913 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b0f3f446-3302-49e7-a22b-65910fc67a48 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1523 microversion: 2.1 time: 0.152733 Aug 04 23:15:09.484471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 165/351] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:09 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:09.515765 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2070ce21-3fcd-4150-9872-e067307d1f4a tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:09.516381 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2070ce21-3fcd-4150-9872-e067307d1f4a tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:09.522427 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2070ce21-3fcd-4150-9872-e067307d1f4a tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:09.522907 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2070ce21-3fcd-4150-9872-e067307d1f4a tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:09.523333 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2070ce21-3fcd-4150-9872-e067307d1f4a tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:09.524060 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2070ce21-3fcd-4150-9872-e067307d1f4a tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:09.524504 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2070ce21-3fcd-4150-9872-e067307d1f4a tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:09.524918 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2070ce21-3fcd-4150-9872-e067307d1f4a tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:09.661613 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2070ce21-3fcd-4150-9872-e067307d1f4a tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236ef8a26e1f400a9c082f95712f44e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca328ac921141f1b604aeaa4ea5fd15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:09.672094 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2070ce21-3fcd-4150-9872-e067307d1f4a tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] 10.222.0.33 "GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2" status: 200 len: 1314 microversion: 2.1 time: 0.160278 Aug 04 23:15:09.682840 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 187/352] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:09 2022] GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:09.766917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-b82fd2b6-2dc4-4be0-ac51-3208fcb65089 req-0d298074-21f2-4d12-b421-0d8441d72f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d3619e-a1d3-4733-aa99-77fc99e9e7d2", "name": "network-vif-plugged", "status": "completed", "tag": "2504ae4a-43be-4f84-b551-e2f19a1601c0"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:15:09.780845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-b82fd2b6-2dc4-4be0-ac51-3208fcb65089 req-0d298074-21f2-4d12-b421-0d8441d72f8e service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:09.781612 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-b82fd2b6-2dc4-4be0-ac51-3208fcb65089 req-0d298074-21f2-4d12-b421-0d8441d72f8e service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:09.782234 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-b82fd2b6-2dc4-4be0-ac51-3208fcb65089 req-0d298074-21f2-4d12-b421-0d8441d72f8e service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:09.802468 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-b82fd2b6-2dc4-4be0-ac51-3208fcb65089 req-0d298074-21f2-4d12-b421-0d8441d72f8e service nova] Creating event network-vif-plugged:2504ae4a-43be-4f84-b551-e2f19a1601c0 for instance e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 on hv-cinder-85221 Aug 04 23:15:09.811990 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-b82fd2b6-2dc4-4be0-ac51-3208fcb65089 req-0d298074-21f2-4d12-b421-0d8441d72f8e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048348 Aug 04 23:15:09.813820 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 166/353] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:15:10.034243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-156523d2-cd49-4d6c-ab1a-c61815d17046 req-09b56e22-b6c0-40fa-bb35-3f3102a20ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b", "name": "network-vif-deleted", "tag": "e7a800e1-01e7-436e-bd1f-d763c07b21ba"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:15:10.049085 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-156523d2-cd49-4d6c-ab1a-c61815d17046 req-09b56e22-b6c0-40fa-bb35-3f3102a20ed5 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:10.049563 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-156523d2-cd49-4d6c-ab1a-c61815d17046 req-09b56e22-b6c0-40fa-bb35-3f3102a20ed5 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:10.049983 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-156523d2-cd49-4d6c-ab1a-c61815d17046 req-09b56e22-b6c0-40fa-bb35-3f3102a20ed5 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:10.063169 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-156523d2-cd49-4d6c-ab1a-c61815d17046 req-09b56e22-b6c0-40fa-bb35-3f3102a20ed5 service nova] Creating event network-vif-deleted:e7a800e1-01e7-436e-bd1f-d763c07b21ba for instance 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b on hv-cinder-85221 Aug 04 23:15:10.069739 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-156523d2-cd49-4d6c-ab1a-c61815d17046 req-09b56e22-b6c0-40fa-bb35-3f3102a20ed5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043089 Aug 04 23:15:10.070400 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 188/354] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:15:10.085099 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3832a582-cc24-4ed6-b32f-e0aabb8e4b8b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:10.085810 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3832a582-cc24-4ed6-b32f-e0aabb8e4b8b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:10.094256 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3832a582-cc24-4ed6-b32f-e0aabb8e4b8b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:10.094963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3832a582-cc24-4ed6-b32f-e0aabb8e4b8b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:10.095437 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3832a582-cc24-4ed6-b32f-e0aabb8e4b8b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:10.096152 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3832a582-cc24-4ed6-b32f-e0aabb8e4b8b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:10.096608 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3832a582-cc24-4ed6-b32f-e0aabb8e4b8b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:10.097034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3832a582-cc24-4ed6-b32f-e0aabb8e4b8b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:10.165314 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3832a582-cc24-4ed6-b32f-e0aabb8e4b8b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:10.173890 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3832a582-cc24-4ed6-b32f-e0aabb8e4b8b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b" status: 200 len: 1298 microversion: 2.1 time: 0.092887 Aug 04 23:15:10.174683 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 167/355] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:10 2022] GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:10.505560 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-28591a9b-d57f-4b0a-b19f-160f9dca72f7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:10.506414 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-28591a9b-d57f-4b0a-b19f-160f9dca72f7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:10.512775 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28591a9b-d57f-4b0a-b19f-160f9dca72f7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:10.513248 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28591a9b-d57f-4b0a-b19f-160f9dca72f7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:10.513681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28591a9b-d57f-4b0a-b19f-160f9dca72f7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:10.514392 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28591a9b-d57f-4b0a-b19f-160f9dca72f7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:10.514848 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28591a9b-d57f-4b0a-b19f-160f9dca72f7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:10.515319 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28591a9b-d57f-4b0a-b19f-160f9dca72f7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:10.652660 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-28591a9b-d57f-4b0a-b19f-160f9dca72f7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:10.660276 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-28591a9b-d57f-4b0a-b19f-160f9dca72f7 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1523 microversion: 2.1 time: 0.159005 Aug 04 23:15:10.660836 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 189/356] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:10 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:10.694173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-999d37c8-dc7d-4c5b-a681-44241cdae661 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:10.694857 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-999d37c8-dc7d-4c5b-a681-44241cdae661 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:10.701610 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-999d37c8-dc7d-4c5b-a681-44241cdae661 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:10.702096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-999d37c8-dc7d-4c5b-a681-44241cdae661 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:10.702568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-999d37c8-dc7d-4c5b-a681-44241cdae661 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:10.703268 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-999d37c8-dc7d-4c5b-a681-44241cdae661 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:10.703716 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-999d37c8-dc7d-4c5b-a681-44241cdae661 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:10.704141 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-999d37c8-dc7d-4c5b-a681-44241cdae661 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:10.841584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-999d37c8-dc7d-4c5b-a681-44241cdae661 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236ef8a26e1f400a9c082f95712f44e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca328ac921141f1b604aeaa4ea5fd15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:10.849493 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-999d37c8-dc7d-4c5b-a681-44241cdae661 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] 10.222.0.33 "GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2" status: 200 len: 1314 microversion: 2.1 time: 0.159150 Aug 04 23:15:10.850046 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 168/357] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:10 2022] GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:11.197163 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-17c0d74e-2f52-4ea7-9972-42896010b9d4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:11.197757 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-17c0d74e-2f52-4ea7-9972-42896010b9d4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:11.204625 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-17c0d74e-2f52-4ea7-9972-42896010b9d4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:11.205141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-17c0d74e-2f52-4ea7-9972-42896010b9d4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:11.205576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-17c0d74e-2f52-4ea7-9972-42896010b9d4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:11.206276 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-17c0d74e-2f52-4ea7-9972-42896010b9d4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:11.206766 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-17c0d74e-2f52-4ea7-9972-42896010b9d4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:11.207217 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-17c0d74e-2f52-4ea7-9972-42896010b9d4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:11.241349 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-17c0d74e-2f52-4ea7-9972-42896010b9d4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:11.241829 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-17c0d74e-2f52-4ea7-9972-42896010b9d4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:11.242269 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-17c0d74e-2f52-4ea7-9972-42896010b9d4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:11.242744 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.objects.instance [None req-17c0d74e-2f52-4ea7-9972-42896010b9d4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lazy-loading 'fault' on Instance uuid 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b {{(pid=129791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:15:11.290852 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-17c0d74e-2f52-4ea7-9972-42896010b9d4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:11.304128 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-17c0d74e-2f52-4ea7-9972-42896010b9d4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b" status: 200 len: 1303 microversion: 2.1 time: 0.110787 Aug 04 23:15:11.304710 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 190/358] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:11 2022] GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b => generated 1303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:11.691719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1d76f2c7-547c-4517-a745-c24aafd7c6ac tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:11.691719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1d76f2c7-547c-4517-a745-c24aafd7c6ac tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:11.693253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1d76f2c7-547c-4517-a745-c24aafd7c6ac tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:11.693738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1d76f2c7-547c-4517-a745-c24aafd7c6ac tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:11.694226 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1d76f2c7-547c-4517-a745-c24aafd7c6ac tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:11.694976 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1d76f2c7-547c-4517-a745-c24aafd7c6ac tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:11.695305 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1d76f2c7-547c-4517-a745-c24aafd7c6ac tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:11.695719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1d76f2c7-547c-4517-a745-c24aafd7c6ac tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:11.850262 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1d76f2c7-547c-4517-a745-c24aafd7c6ac tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:11.858374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1d76f2c7-547c-4517-a745-c24aafd7c6ac tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1523 microversion: 2.1 time: 0.176126 Aug 04 23:15:11.858934 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 169/359] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:11 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:11.869910 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-73b9f22f-cf3b-4da2-b88c-0ce6a313a3d0 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:11.870553 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-73b9f22f-cf3b-4da2-b88c-0ce6a313a3d0 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:11.876966 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-73b9f22f-cf3b-4da2-b88c-0ce6a313a3d0 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:11.877437 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-73b9f22f-cf3b-4da2-b88c-0ce6a313a3d0 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:11.877860 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-73b9f22f-cf3b-4da2-b88c-0ce6a313a3d0 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:11.878575 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-73b9f22f-cf3b-4da2-b88c-0ce6a313a3d0 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:11.879020 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-73b9f22f-cf3b-4da2-b88c-0ce6a313a3d0 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:11.879430 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-73b9f22f-cf3b-4da2-b88c-0ce6a313a3d0 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:12.015206 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-73b9f22f-cf3b-4da2-b88c-0ce6a313a3d0 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236ef8a26e1f400a9c082f95712f44e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca328ac921141f1b604aeaa4ea5fd15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:12.022698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-73b9f22f-cf3b-4da2-b88c-0ce6a313a3d0 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] 10.222.0.33 "GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2" status: 200 len: 1314 microversion: 2.1 time: 0.156581 Aug 04 23:15:12.023258 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 191/360] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:11 2022] GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:12.325499 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-355235ea-6cb1-4e5d-b8b8-109602fc7bf5 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:12.326065 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-355235ea-6cb1-4e5d-b8b8-109602fc7bf5 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:12.332047 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-355235ea-6cb1-4e5d-b8b8-109602fc7bf5 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:12.332523 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-355235ea-6cb1-4e5d-b8b8-109602fc7bf5 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:12.332952 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-355235ea-6cb1-4e5d-b8b8-109602fc7bf5 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:12.333630 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-355235ea-6cb1-4e5d-b8b8-109602fc7bf5 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:12.334075 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-355235ea-6cb1-4e5d-b8b8-109602fc7bf5 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:12.334520 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-355235ea-6cb1-4e5d-b8b8-109602fc7bf5 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:12.347992 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-355235ea-6cb1-4e5d-b8b8-109602fc7bf5 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] HTTP exception thrown: Instance 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b could not be found. Aug 04 23:15:12.349601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-355235ea-6cb1-4e5d-b8b8-109602fc7bf5 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Request method failure captured: Aug 04 23:15:12.349601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b HTTP/1.1 Aug 04 23:15:12.349601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:15:12.349601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:15:12.349601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:15:12.349601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:15:12.349601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:15:12.349601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:15:12.349601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:15:12.349601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:15:12.349601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FLoWU510KU44fEaNQJNYYm7XtAy1os0j902Xu9VohXGpuaXpEj9DFzcYCwdJbL1DmPErcLYzmcvGTrcjD5ojPbXvRc9ttkPeGuSPtYtrwaDvLbTOSN5NBSvPyIlHOXj02c7nG1nnVPf2WJKSf6FSHMCAjoSong-AbB42Oh_whhYPuI Aug 04 23:15:12.349601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:15:12.349601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:15:12.349601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:15:12.349601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:15:12.349601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:15:12.349601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:15:12.349601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: b69e8dd8254e4e1f813bc3fce0438b50 Aug 04 23:15:12.349601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-VolumesActionsTest-1787306269 Aug 04 23:15:12.349601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:15:12.349601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:15:12.351175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b69e8dd8254e4e1f813bc3fce0438b50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b69e8dd8254e4e1f813bc3fce0438b50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b69e8dd8254e4e1f813bc3fce0438b50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b69e8dd8254e4e1f813bc3fce0438b50"}]}] Aug 04 23:15:12.351175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-VolumesActionsTest-1787306269 Aug 04 23:15:12.351175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: b69e8dd8254e4e1f813bc3fce0438b50 Aug 04 23:15:12.351175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-VolumesActionsTest-1787306269 Aug 04 23:15:12.351175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-VolumesActionsTest-1787306269-project Aug 04 23:15:12.351175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:15:12.351175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:15:12.351175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: 9b3df18fff9343a1984468c0ea8517e4 Aug 04 23:15:12.351175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-VolumesActionsTest-1787306269-project Aug 04 23:15:12.351175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:15:12.351175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Instance 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b could not be found. Aug 04 23:15:12.351175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': '7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b'} Aug 04 23:15:12.351946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:15:12.351946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:15:12.351946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:15:12.351946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:15:12.351946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:15:12.351946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:15:12.351946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:15:12.351946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:15:12.351946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:15:12.351946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:15:12.351946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b could not be found. Aug 04 23:15:12.351946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:15:12.351946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:15:12.351946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:15:12.351946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:15:12.351946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:15:12.351946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:15:12.351946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:15:12.351946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:15:12.351946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:15:12.353307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:15:12.353307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:15:12.353307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:15:12.353307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:15:12.353307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:15:12.353307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:15:12.353307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:15:12.353307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b could not be found. Aug 04 23:15:12.353307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:15:12.353307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:15:12.353307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:15:12.353307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:15:12.353307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:15:12.353307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:15:12.353307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:15:12.353307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:15:12.353307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b could not be found. Aug 04 23:15:12.353307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:15:12.354353 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-355235ea-6cb1-4e5d-b8b8-109602fc7bf5 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Returning 404 to user: Instance 7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:15:12.354353 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-355235ea-6cb1-4e5d-b8b8-109602fc7bf5 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b" status: 404 len: 111 microversion: 2.1 time: 0.029511 Aug 04 23:15:12.354353 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 170/361] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:12 2022] GET /compute/v2.1/servers/7fc34ea5-1cbb-49d5-b1ae-35e1561acc5b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:15:12.453714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b54c5b68-4c8a-4d3d-80df-839f34236ba9 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-814096058", "imageRef": "e1e9d70e-b252-44e5-9ecd-bf73cbf00160", "flavorRef": "452", "networks": [{"uuid": "05079a03-770c-4591-97d9-02de6301b472"}]}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:15:12.508979 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.network.neutron [None req-b54c5b68-4c8a-4d3d-80df-839f34236ba9 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] validate_networks() for [('05079a03-770c-4591-97d9-02de6301b472', None, None, None, None, None)] {{(pid=129791) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 23:15:12.866657 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-b54c5b68-4c8a-4d3d-80df-839f34236ba9 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Flavor limits 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 23:15:12.867249 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-b54c5b68-4c8a-4d3d-80df-839f34236ba9 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Image limits 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 23:15:12.867722 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-b54c5b68-4c8a-4d3d-80df-839f34236ba9 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Flavor pref 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 23:15:12.868124 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-b54c5b68-4c8a-4d3d-80df-839f34236ba9 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Image pref 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 23:15:12.868532 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-b54c5b68-4c8a-4d3d-80df-839f34236ba9 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 23:15:12.879405 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-86c2234d-3553-4e7c-ac5b-e12f6ec87835 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:12.881892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-86c2234d-3553-4e7c-ac5b-e12f6ec87835 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:12.883560 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b54c5b68-4c8a-4d3d-80df-839f34236ba9 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:12.884391 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b54c5b68-4c8a-4d3d-80df-839f34236ba9 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:12.885355 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b54c5b68-4c8a-4d3d-80df-839f34236ba9 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:12.885757 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b54c5b68-4c8a-4d3d-80df-839f34236ba9 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:12.886205 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b54c5b68-4c8a-4d3d-80df-839f34236ba9 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:12.887735 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b54c5b68-4c8a-4d3d-80df-839f34236ba9 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:12.892719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86c2234d-3553-4e7c-ac5b-e12f6ec87835 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:12.893208 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86c2234d-3553-4e7c-ac5b-e12f6ec87835 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:12.893741 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86c2234d-3553-4e7c-ac5b-e12f6ec87835 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:12.894336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86c2234d-3553-4e7c-ac5b-e12f6ec87835 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:12.895164 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86c2234d-3553-4e7c-ac5b-e12f6ec87835 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:12.895643 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86c2234d-3553-4e7c-ac5b-e12f6ec87835 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:12.908429 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-b54c5b68-4c8a-4d3d-80df-839f34236ba9 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Getting quotas for project b69e8dd8254e4e1f813bc3fce0438b50. Resources: {'ram', 'instances', 'cores'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:15:12.912451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-b54c5b68-4c8a-4d3d-80df-839f34236ba9 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Getting quotas for user 9b3df18fff9343a1984468c0ea8517e4 and project b69e8dd8254e4e1f813bc3fce0438b50. Resources: {'ram', 'instances', 'cores'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:15:12.925793 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b54c5b68-4c8a-4d3d-80df-839f34236ba9 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Going to run 1 instances... {{(pid=129791) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 23:15:12.928086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b54c5b68-4c8a-4d3d-80df-839f34236ba9 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: d510bd73-8106-4691-b351-101786b6dcd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1e9d70e-b252-44e5-9ecd-bf73cbf00160',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 23:15:12.975814 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b54c5b68-4c8a-4d3d-80df-839f34236ba9 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526500 Aug 04 23:15:12.976932 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 192/362] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Aug 4 23:15:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 23:15:12.989433 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-112b4ff3-93c9-45d1-8209-8295df7ba5cd tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:12.991211 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-112b4ff3-93c9-45d1-8209-8295df7ba5cd tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: d510bd73-8106-4691-b351-101786b6dcd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:13.068861 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-112b4ff3-93c9-45d1-8209-8295df7ba5cd tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:13.078828 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-112b4ff3-93c9-45d1-8209-8295df7ba5cd tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4" status: 200 len: 1213 microversion: 2.1 time: 0.093868 Aug 04 23:15:13.079479 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 193/363] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:12 2022] GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:13.086653 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-86c2234d-3553-4e7c-ac5b-e12f6ec87835 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:13.093634 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-86c2234d-3553-4e7c-ac5b-e12f6ec87835 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1523 microversion: 2.1 time: 0.218318 Aug 04 23:15:13.094764 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 171/364] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:12 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:15:13.094900 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-021818a6-4b6d-417b-85cc-e207f881a969 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:13.095386 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-021818a6-4b6d-417b-85cc-e207f881a969 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:13.101695 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-021818a6-4b6d-417b-85cc-e207f881a969 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:13.102171 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-021818a6-4b6d-417b-85cc-e207f881a969 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:13.102633 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-021818a6-4b6d-417b-85cc-e207f881a969 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:13.103326 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-021818a6-4b6d-417b-85cc-e207f881a969 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:13.103866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-021818a6-4b6d-417b-85cc-e207f881a969 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:13.104289 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-021818a6-4b6d-417b-85cc-e207f881a969 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:13.244511 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-021818a6-4b6d-417b-85cc-e207f881a969 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236ef8a26e1f400a9c082f95712f44e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca328ac921141f1b604aeaa4ea5fd15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:13.252411 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-021818a6-4b6d-417b-85cc-e207f881a969 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] 10.222.0.33 "GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2" status: 200 len: 1463 microversion: 2.1 time: 0.163251 Aug 04 23:15:13.252972 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 194/365] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:13 2022] GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 => generated 1463 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:13.299603 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-97277e95-13c4-4e28-b2b0-666ffae02407 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:13.300097 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-97277e95-13c4-4e28-b2b0-666ffae02407 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:13.306037 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-97277e95-13c4-4e28-b2b0-666ffae02407 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:13.306621 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-97277e95-13c4-4e28-b2b0-666ffae02407 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:13.307042 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-97277e95-13c4-4e28-b2b0-666ffae02407 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:13.307685 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-97277e95-13c4-4e28-b2b0-666ffae02407 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:13.308116 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-97277e95-13c4-4e28-b2b0-666ffae02407 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:13.309120 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-97277e95-13c4-4e28-b2b0-666ffae02407 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:13.336164 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-97277e95-13c4-4e28-b2b0-666ffae02407 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] Going to try to terminate instance {{(pid=129790) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 23:15:13.430387 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-97277e95-13c4-4e28-b2b0-666ffae02407 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2" status: 204 len: 0 microversion: 2.1 time: 0.134288 Aug 04 23:15:13.431182 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 172/366] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:15:13 2022] DELETE /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 23:15:13.441099 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-15e4af99-f716-48b4-bb53-494ec4bb436c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:13.441950 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-15e4af99-f716-48b4-bb53-494ec4bb436c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:13.448161 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-15e4af99-f716-48b4-bb53-494ec4bb436c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:13.448647 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-15e4af99-f716-48b4-bb53-494ec4bb436c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:13.449502 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-15e4af99-f716-48b4-bb53-494ec4bb436c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:13.450211 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-15e4af99-f716-48b4-bb53-494ec4bb436c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:13.450697 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-15e4af99-f716-48b4-bb53-494ec4bb436c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:13.451126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-15e4af99-f716-48b4-bb53-494ec4bb436c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:13.587931 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-15e4af99-f716-48b4-bb53-494ec4bb436c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236ef8a26e1f400a9c082f95712f44e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca328ac921141f1b604aeaa4ea5fd15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:13.596585 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-15e4af99-f716-48b4-bb53-494ec4bb436c tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] 10.222.0.33 "GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2" status: 200 len: 1469 microversion: 2.1 time: 0.159762 Aug 04 23:15:13.597162 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 195/367] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:13 2022] GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:14.101637 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9e130ece-a07e-48cc-b29e-7924e63ee91b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:14.102251 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9e130ece-a07e-48cc-b29e-7924e63ee91b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: d510bd73-8106-4691-b351-101786b6dcd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:14.111712 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9e130ece-a07e-48cc-b29e-7924e63ee91b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:14.112194 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9e130ece-a07e-48cc-b29e-7924e63ee91b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:14.112620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9e130ece-a07e-48cc-b29e-7924e63ee91b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:14.113310 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9e130ece-a07e-48cc-b29e-7924e63ee91b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:14.113752 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9e130ece-a07e-48cc-b29e-7924e63ee91b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:14.114166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9e130ece-a07e-48cc-b29e-7924e63ee91b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:14.116076 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6ca5f864-b190-49b0-92ab-2e83d3867d61 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:14.119180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6ca5f864-b190-49b0-92ab-2e83d3867d61 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:14.126447 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ca5f864-b190-49b0-92ab-2e83d3867d61 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:14.127012 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ca5f864-b190-49b0-92ab-2e83d3867d61 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:14.127545 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ca5f864-b190-49b0-92ab-2e83d3867d61 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:14.128515 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ca5f864-b190-49b0-92ab-2e83d3867d61 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:14.129038 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ca5f864-b190-49b0-92ab-2e83d3867d61 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:14.129532 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ca5f864-b190-49b0-92ab-2e83d3867d61 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:14.186014 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9e130ece-a07e-48cc-b29e-7924e63ee91b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:14.194083 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9e130ece-a07e-48cc-b29e-7924e63ee91b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4" status: 200 len: 1209 microversion: 2.1 time: 0.096468 Aug 04 23:15:14.194547 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 173/368] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:14 2022] GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4 => generated 1209 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:15:14.296036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6ca5f864-b190-49b0-92ab-2e83d3867d61 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:14.303035 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6ca5f864-b190-49b0-92ab-2e83d3867d61 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1523 microversion: 2.1 time: 0.191120 Aug 04 23:15:14.303611 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 196/369] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:14 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:15:14.617575 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a8674006-b690-4747-b463-be77b9d5706f tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:14.618192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a8674006-b690-4747-b463-be77b9d5706f tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:14.625947 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8674006-b690-4747-b463-be77b9d5706f tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:14.626568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8674006-b690-4747-b463-be77b9d5706f tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:14.627080 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8674006-b690-4747-b463-be77b9d5706f tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:14.627704 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8674006-b690-4747-b463-be77b9d5706f tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:14.628184 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8674006-b690-4747-b463-be77b9d5706f tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:14.628603 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8674006-b690-4747-b463-be77b9d5706f tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:14.777541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a8674006-b690-4747-b463-be77b9d5706f tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236ef8a26e1f400a9c082f95712f44e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca328ac921141f1b604aeaa4ea5fd15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:14.785403 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a8674006-b690-4747-b463-be77b9d5706f tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] 10.222.0.33 "GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2" status: 200 len: 1469 microversion: 2.1 time: 0.171673 Aug 04 23:15:14.785978 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 174/370] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:14 2022] GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 => generated 1469 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:15.216941 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-34f2210a-cd42-4123-af8d-367a0c160fa1 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:15.217556 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-34f2210a-cd42-4123-af8d-367a0c160fa1 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: d510bd73-8106-4691-b351-101786b6dcd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:15.223631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-34f2210a-cd42-4123-af8d-367a0c160fa1 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:15.224110 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-34f2210a-cd42-4123-af8d-367a0c160fa1 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:15.224544 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-34f2210a-cd42-4123-af8d-367a0c160fa1 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:15.225233 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-34f2210a-cd42-4123-af8d-367a0c160fa1 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:15.225690 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-34f2210a-cd42-4123-af8d-367a0c160fa1 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:15.226109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-34f2210a-cd42-4123-af8d-367a0c160fa1 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:15.289648 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-34f2210a-cd42-4123-af8d-367a0c160fa1 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:15.300656 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-34f2210a-cd42-4123-af8d-367a0c160fa1 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4" status: 200 len: 1265 microversion: 2.1 time: 0.088261 Aug 04 23:15:15.301134 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 197/371] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:15 2022] GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4 => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:15.327312 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5ef8c653-72de-42f4-a48f-d2f58d83a4b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:15.328552 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5ef8c653-72de-42f4-a48f-d2f58d83a4b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:15.336793 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5ef8c653-72de-42f4-a48f-d2f58d83a4b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:15.337917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5ef8c653-72de-42f4-a48f-d2f58d83a4b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:15.338642 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5ef8c653-72de-42f4-a48f-d2f58d83a4b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:15.340418 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5ef8c653-72de-42f4-a48f-d2f58d83a4b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:15.341253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5ef8c653-72de-42f4-a48f-d2f58d83a4b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:15.341899 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5ef8c653-72de-42f4-a48f-d2f58d83a4b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:15.539536 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5ef8c653-72de-42f4-a48f-d2f58d83a4b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:15.553163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5ef8c653-72de-42f4-a48f-d2f58d83a4b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1523 microversion: 2.1 time: 0.231284 Aug 04 23:15:15.562535 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 175/372] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:15 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:15.807966 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-afe84e22-845b-473c-b686-df2ef6f89c28 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:15.809380 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-afe84e22-845b-473c-b686-df2ef6f89c28 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:15.817160 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-afe84e22-845b-473c-b686-df2ef6f89c28 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:15.818223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-afe84e22-845b-473c-b686-df2ef6f89c28 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:15.819359 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-afe84e22-845b-473c-b686-df2ef6f89c28 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:15.820099 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-afe84e22-845b-473c-b686-df2ef6f89c28 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:15.820914 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-afe84e22-845b-473c-b686-df2ef6f89c28 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:15.821670 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-afe84e22-845b-473c-b686-df2ef6f89c28 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:16.002574 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-afe84e22-845b-473c-b686-df2ef6f89c28 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236ef8a26e1f400a9c082f95712f44e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca328ac921141f1b604aeaa4ea5fd15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:16.010887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-afe84e22-845b-473c-b686-df2ef6f89c28 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] 10.222.0.33 "GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2" status: 200 len: 1469 microversion: 2.1 time: 0.207703 Aug 04 23:15:16.011881 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 198/373] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:15 2022] GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 => generated 1469 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:15:16.322035 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-eb6da8ab-692d-47a9-96d2-4c3376c1b9d7 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:16.322679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-eb6da8ab-692d-47a9-96d2-4c3376c1b9d7 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: d510bd73-8106-4691-b351-101786b6dcd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:16.330059 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb6da8ab-692d-47a9-96d2-4c3376c1b9d7 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:16.330828 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb6da8ab-692d-47a9-96d2-4c3376c1b9d7 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:16.331127 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb6da8ab-692d-47a9-96d2-4c3376c1b9d7 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:16.331821 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb6da8ab-692d-47a9-96d2-4c3376c1b9d7 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:16.332269 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb6da8ab-692d-47a9-96d2-4c3376c1b9d7 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:16.332711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb6da8ab-692d-47a9-96d2-4c3376c1b9d7 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:16.400439 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-eb6da8ab-692d-47a9-96d2-4c3376c1b9d7 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:16.410232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-eb6da8ab-692d-47a9-96d2-4c3376c1b9d7 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4" status: 200 len: 1271 microversion: 2.1 time: 0.092570 Aug 04 23:15:16.416915 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 176/374] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:16 2022] GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:15:16.502680 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-19747f5a-af29-478f-8daf-f9ac50660758 req-14a67293-32ab-453a-a378-f11ebe7061d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d3619e-a1d3-4733-aa99-77fc99e9e7d2", "name": "network-vif-deleted", "tag": "2504ae4a-43be-4f84-b551-e2f19a1601c0"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:15:16.516676 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-19747f5a-af29-478f-8daf-f9ac50660758 req-14a67293-32ab-453a-a378-f11ebe7061d5 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:16.517424 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-19747f5a-af29-478f-8daf-f9ac50660758 req-14a67293-32ab-453a-a378-f11ebe7061d5 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:16.518049 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-19747f5a-af29-478f-8daf-f9ac50660758 req-14a67293-32ab-453a-a378-f11ebe7061d5 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:16.546313 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-19747f5a-af29-478f-8daf-f9ac50660758 req-14a67293-32ab-453a-a378-f11ebe7061d5 service nova] Creating event network-vif-deleted:2504ae4a-43be-4f84-b551-e2f19a1601c0 for instance e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 on hv-cinder-85221 Aug 04 23:15:16.553834 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-19747f5a-af29-478f-8daf-f9ac50660758 req-14a67293-32ab-453a-a378-f11ebe7061d5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054791 Aug 04 23:15:16.554656 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 199/375] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:15:16.583308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-825904e3-f08b-43b8-a1db-6b5d7b5e1c32 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:16.583979 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-825904e3-f08b-43b8-a1db-6b5d7b5e1c32 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:16.593495 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-825904e3-f08b-43b8-a1db-6b5d7b5e1c32 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:16.593989 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-825904e3-f08b-43b8-a1db-6b5d7b5e1c32 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:16.597258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-825904e3-f08b-43b8-a1db-6b5d7b5e1c32 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:16.600088 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-825904e3-f08b-43b8-a1db-6b5d7b5e1c32 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:16.601031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-825904e3-f08b-43b8-a1db-6b5d7b5e1c32 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:16.601781 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-825904e3-f08b-43b8-a1db-6b5d7b5e1c32 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:16.752212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-825904e3-f08b-43b8-a1db-6b5d7b5e1c32 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:16.762892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-825904e3-f08b-43b8-a1db-6b5d7b5e1c32 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1523 microversion: 2.1 time: 0.190244 Aug 04 23:15:16.763088 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 177/376] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:16 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:17.039407 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-551cb5ff-c6ea-4543-8f96-79c574c5bec6 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:17.040599 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-551cb5ff-c6ea-4543-8f96-79c574c5bec6 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:17.055084 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-551cb5ff-c6ea-4543-8f96-79c574c5bec6 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:17.055467 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-551cb5ff-c6ea-4543-8f96-79c574c5bec6 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:17.055797 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-551cb5ff-c6ea-4543-8f96-79c574c5bec6 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:17.056705 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-551cb5ff-c6ea-4543-8f96-79c574c5bec6 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:17.057166 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-551cb5ff-c6ea-4543-8f96-79c574c5bec6 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:17.057568 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-551cb5ff-c6ea-4543-8f96-79c574c5bec6 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:17.108697 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-551cb5ff-c6ea-4543-8f96-79c574c5bec6 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:17.109336 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-551cb5ff-c6ea-4543-8f96-79c574c5bec6 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:17.110079 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-551cb5ff-c6ea-4543-8f96-79c574c5bec6 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:17.110710 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.objects.instance [None req-551cb5ff-c6ea-4543-8f96-79c574c5bec6 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lazy-loading 'fault' on Instance uuid e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 {{(pid=129791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:15:17.169680 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-551cb5ff-c6ea-4543-8f96-79c574c5bec6 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236ef8a26e1f400a9c082f95712f44e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca328ac921141f1b604aeaa4ea5fd15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:17.184690 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-551cb5ff-c6ea-4543-8f96-79c574c5bec6 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] 10.222.0.33 "GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2" status: 200 len: 1304 microversion: 2.1 time: 0.153282 Aug 04 23:15:17.185395 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 200/377] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:17 2022] GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 => generated 1304 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:17.434816 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-057c03c5-96ef-4b8f-8f6d-5418683efedf tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:17.435797 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-057c03c5-96ef-4b8f-8f6d-5418683efedf tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: d510bd73-8106-4691-b351-101786b6dcd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:17.444790 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-057c03c5-96ef-4b8f-8f6d-5418683efedf tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:17.445417 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-057c03c5-96ef-4b8f-8f6d-5418683efedf tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:17.446063 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-057c03c5-96ef-4b8f-8f6d-5418683efedf tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:17.447054 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-057c03c5-96ef-4b8f-8f6d-5418683efedf tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:17.447590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-057c03c5-96ef-4b8f-8f6d-5418683efedf tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:17.448143 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-057c03c5-96ef-4b8f-8f6d-5418683efedf tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:17.596691 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-057c03c5-96ef-4b8f-8f6d-5418683efedf tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:17.604505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-057c03c5-96ef-4b8f-8f6d-5418683efedf tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4" status: 200 len: 1313 microversion: 2.1 time: 0.176287 Aug 04 23:15:17.605719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 178/378] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:17 2022] GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:17.784128 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6e695128-f317-45a2-89ef-2374adf70ea0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:17.784681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6e695128-f317-45a2-89ef-2374adf70ea0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:17.790760 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e695128-f317-45a2-89ef-2374adf70ea0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:17.791241 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e695128-f317-45a2-89ef-2374adf70ea0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:17.791670 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e695128-f317-45a2-89ef-2374adf70ea0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:17.792369 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e695128-f317-45a2-89ef-2374adf70ea0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:17.793446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e695128-f317-45a2-89ef-2374adf70ea0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:17.793868 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e695128-f317-45a2-89ef-2374adf70ea0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:17.939984 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6e695128-f317-45a2-89ef-2374adf70ea0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:17.952577 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6e695128-f317-45a2-89ef-2374adf70ea0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1523 microversion: 2.1 time: 0.172477 Aug 04 23:15:17.953774 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 201/379] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:17 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:18.206151 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b914b23c-0d33-461f-84fe-b2d9c7a11235 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:18.208064 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b914b23c-0d33-461f-84fe-b2d9c7a11235 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] [instance: e8d3619e-a1d3-4733-aa99-77fc99e9e7d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:18.214880 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b914b23c-0d33-461f-84fe-b2d9c7a11235 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:18.215630 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b914b23c-0d33-461f-84fe-b2d9c7a11235 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:18.216054 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b914b23c-0d33-461f-84fe-b2d9c7a11235 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:18.216753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b914b23c-0d33-461f-84fe-b2d9c7a11235 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:18.217200 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b914b23c-0d33-461f-84fe-b2d9c7a11235 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:18.217653 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b914b23c-0d33-461f-84fe-b2d9c7a11235 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:18.232450 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-b914b23c-0d33-461f-84fe-b2d9c7a11235 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] HTTP exception thrown: Instance e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 could not be found. Aug 04 23:15:18.234087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b914b23c-0d33-461f-84fe-b2d9c7a11235 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Request method failure captured: Aug 04 23:15:18.234087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 HTTP/1.1 Aug 04 23:15:18.234087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:15:18.234087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:15:18.234087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:15:18.234087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:15:18.234087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:15:18.234087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:15:18.234087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:15:18.234087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:15:18.234087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FLs8HjPAgsQv9gqzMU3_Zp0DS2AEHVOhIlh_gZoxTpmeuwGxxEWN0ikKyO2MdlBj6sqVnFgo9sNhSwLsrcFhXbsRe5d9HwjJTitKtUS4Th6p1LZC7y23NhCL_-pW49lA7v0bD2tiDs6pRa4y5Ap-nNYdNOyMUH61fNEev1Gy0-6QVU Aug 04 23:15:18.234087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:15:18.234087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:15:18.234087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:15:18.234087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:15:18.234087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:15:18.234087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:15:18.234087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: 5ca328ac921141f1b604aeaa4ea5fd15 Aug 04 23:15:18.234087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-VolumesNegativeTest-513894203 Aug 04 23:15:18.234087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:15:18.234087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:15:18.235467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5ca328ac921141f1b604aeaa4ea5fd15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5ca328ac921141f1b604aeaa4ea5fd15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5ca328ac921141f1b604aeaa4ea5fd15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5ca328ac921141f1b604aeaa4ea5fd15"}]}] Aug 04 23:15:18.235467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-VolumesNegativeTest-513894203 Aug 04 23:15:18.235467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: 5ca328ac921141f1b604aeaa4ea5fd15 Aug 04 23:15:18.235467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-VolumesNegativeTest-513894203 Aug 04 23:15:18.235467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-VolumesNegativeTest-513894203-project Aug 04 23:15:18.235467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:15:18.235467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:15:18.235467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: 236ef8a26e1f400a9c082f95712f44e3 Aug 04 23:15:18.235467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-VolumesNegativeTest-513894203-project Aug 04 23:15:18.235467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:15:18.235467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Instance e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 could not be found. Aug 04 23:15:18.235467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': 'e8d3619e-a1d3-4733-aa99-77fc99e9e7d2'} Aug 04 23:15:18.236265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:15:18.236265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:15:18.236265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:15:18.236265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:15:18.236265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:15:18.236265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:15:18.236265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:15:18.236265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:15:18.236265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:15:18.236265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:15:18.236265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 could not be found. Aug 04 23:15:18.236265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:15:18.236265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:15:18.236265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:15:18.236265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:15:18.236265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:15:18.236265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:15:18.236265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:15:18.236265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:15:18.236265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:15:18.237928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:15:18.237928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:15:18.237928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:15:18.237928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:15:18.237928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:15:18.237928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:15:18.237928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:15:18.237928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 could not be found. Aug 04 23:15:18.237928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:15:18.237928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:15:18.237928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:15:18.237928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:15:18.237928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:15:18.237928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:15:18.237928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:15:18.237928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:15:18.237928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 could not be found. Aug 04 23:15:18.237928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:15:18.244533 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b914b23c-0d33-461f-84fe-b2d9c7a11235 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] Returning 404 to user: Instance e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:15:18.244533 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b914b23c-0d33-461f-84fe-b2d9c7a11235 tempest-VolumesNegativeTest-513894203 tempest-VolumesNegativeTest-513894203-project] 10.222.0.33 "GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2" status: 404 len: 111 microversion: 2.1 time: 0.033277 Aug 04 23:15:18.244533 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 179/380] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:18 2022] GET /compute/v2.1/servers/e8d3619e-a1d3-4733-aa99-77fc99e9e7d2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:15:18.572181 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-0a3f1828-3ed8-489c-a2aa-d80a16671c99 req-260c693e-9bf9-4abb-b898-b69e1b7e1c41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d510bd73-8106-4691-b351-101786b6dcd4", "tag": "f16172af-fcd2-4968-8555-270d2192f774"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:15:18.578522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:15:18.588182 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-0a3f1828-3ed8-489c-a2aa-d80a16671c99 req-260c693e-9bf9-4abb-b898-b69e1b7e1c41 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:18.588634 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-0a3f1828-3ed8-489c-a2aa-d80a16671c99 req-260c693e-9bf9-4abb-b898-b69e1b7e1c41 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:18.589017 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-0a3f1828-3ed8-489c-a2aa-d80a16671c99 req-260c693e-9bf9-4abb-b898-b69e1b7e1c41 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:18.608396 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-0a3f1828-3ed8-489c-a2aa-d80a16671c99 req-260c693e-9bf9-4abb-b898-b69e1b7e1c41 service nova] Creating event network-changed:f16172af-fcd2-4968-8555-270d2192f774 for instance d510bd73-8106-4691-b351-101786b6dcd4 on hv-cinder-85221 Aug 04 23:15:18.613533 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-0a3f1828-3ed8-489c-a2aa-d80a16671c99 req-260c693e-9bf9-4abb-b898-b69e1b7e1c41 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046484 Aug 04 23:15:18.614302 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 202/381] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:15:18.626075 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f32b6502-ea05-4470-bd72-91e18eedb828 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:18.626719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f32b6502-ea05-4470-bd72-91e18eedb828 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: d510bd73-8106-4691-b351-101786b6dcd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:18.632866 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f32b6502-ea05-4470-bd72-91e18eedb828 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:18.633552 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f32b6502-ea05-4470-bd72-91e18eedb828 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:18.633994 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f32b6502-ea05-4470-bd72-91e18eedb828 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:18.634727 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f32b6502-ea05-4470-bd72-91e18eedb828 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:18.635186 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f32b6502-ea05-4470-bd72-91e18eedb828 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:18.635619 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f32b6502-ea05-4470-bd72-91e18eedb828 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:18.653466 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:15:18.825356 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f32b6502-ea05-4470-bd72-91e18eedb828 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:18.849596 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f32b6502-ea05-4470-bd72-91e18eedb828 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4" status: 200 len: 1313 microversion: 2.1 time: 0.228137 Aug 04 23:15:18.851254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 180/382] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:18 2022] GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:18.975643 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-64f851f9-adab-4733-8b6c-7f69374a43ae tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:18.975643 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-64f851f9-adab-4733-8b6c-7f69374a43ae tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:18.982500 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-64f851f9-adab-4733-8b6c-7f69374a43ae tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:18.983014 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-64f851f9-adab-4733-8b6c-7f69374a43ae tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:18.983399 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-64f851f9-adab-4733-8b6c-7f69374a43ae tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:18.984396 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-64f851f9-adab-4733-8b6c-7f69374a43ae tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:18.984852 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-64f851f9-adab-4733-8b6c-7f69374a43ae tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:18.985338 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-64f851f9-adab-4733-8b6c-7f69374a43ae tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:19.163291 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-64f851f9-adab-4733-8b6c-7f69374a43ae tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:19.174857 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-64f851f9-adab-4733-8b6c-7f69374a43ae tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1523 microversion: 2.1 time: 0.204033 Aug 04 23:15:19.176024 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 203/383] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:18 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:19.871331 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6484121f-d1f2-45ee-8228-535d475852b2 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:19.872699 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6484121f-d1f2-45ee-8228-535d475852b2 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: d510bd73-8106-4691-b351-101786b6dcd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:19.881785 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6484121f-d1f2-45ee-8228-535d475852b2 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:19.882277 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6484121f-d1f2-45ee-8228-535d475852b2 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:19.882913 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6484121f-d1f2-45ee-8228-535d475852b2 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:19.883693 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6484121f-d1f2-45ee-8228-535d475852b2 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:19.884146 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6484121f-d1f2-45ee-8228-535d475852b2 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:19.884601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6484121f-d1f2-45ee-8228-535d475852b2 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:20.044523 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6484121f-d1f2-45ee-8228-535d475852b2 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:20.052776 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6484121f-d1f2-45ee-8228-535d475852b2 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4" status: 200 len: 1313 microversion: 2.1 time: 0.185634 Aug 04 23:15:20.053567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 181/384] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:19 2022] GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:20.196951 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0c67b2c8-4cac-43ab-8846-6351f0718573 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:20.197658 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0c67b2c8-4cac-43ab-8846-6351f0718573 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:20.204813 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c67b2c8-4cac-43ab-8846-6351f0718573 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:20.205361 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c67b2c8-4cac-43ab-8846-6351f0718573 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:20.205795 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c67b2c8-4cac-43ab-8846-6351f0718573 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:20.206521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c67b2c8-4cac-43ab-8846-6351f0718573 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:20.206967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c67b2c8-4cac-43ab-8846-6351f0718573 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:20.207382 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c67b2c8-4cac-43ab-8846-6351f0718573 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:20.348247 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0c67b2c8-4cac-43ab-8846-6351f0718573 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:20.350964 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:15:20.359245 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0c67b2c8-4cac-43ab-8846-6351f0718573 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1523 microversion: 2.1 time: 0.166023 Aug 04 23:15:20.359813 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 204/385] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:20 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:21.075856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2b4b5c92-88ed-45c2-ae65-d6a54eef08fd tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:21.076899 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2b4b5c92-88ed-45c2-ae65-d6a54eef08fd tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: d510bd73-8106-4691-b351-101786b6dcd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:21.083711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2b4b5c92-88ed-45c2-ae65-d6a54eef08fd tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:21.084195 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2b4b5c92-88ed-45c2-ae65-d6a54eef08fd tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:21.084627 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2b4b5c92-88ed-45c2-ae65-d6a54eef08fd tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:21.085408 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2b4b5c92-88ed-45c2-ae65-d6a54eef08fd tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:21.085780 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2b4b5c92-88ed-45c2-ae65-d6a54eef08fd tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:21.088758 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2b4b5c92-88ed-45c2-ae65-d6a54eef08fd tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:21.243492 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2b4b5c92-88ed-45c2-ae65-d6a54eef08fd tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:21.252373 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2b4b5c92-88ed-45c2-ae65-d6a54eef08fd tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4" status: 200 len: 1313 microversion: 2.1 time: 0.180895 Aug 04 23:15:21.253185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 182/386] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:21 2022] GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:21.382153 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fe27725e-21bf-42b2-aeee-2646b1e65b4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:21.383839 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-fe27725e-21bf-42b2-aeee-2646b1e65b4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:21.397942 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fe27725e-21bf-42b2-aeee-2646b1e65b4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:21.397942 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fe27725e-21bf-42b2-aeee-2646b1e65b4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:21.397942 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fe27725e-21bf-42b2-aeee-2646b1e65b4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:21.397942 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fe27725e-21bf-42b2-aeee-2646b1e65b4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:21.398858 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fe27725e-21bf-42b2-aeee-2646b1e65b4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:21.398858 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fe27725e-21bf-42b2-aeee-2646b1e65b4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:21.565156 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fe27725e-21bf-42b2-aeee-2646b1e65b4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:21.577740 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-fe27725e-21bf-42b2-aeee-2646b1e65b4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1523 microversion: 2.1 time: 0.200221 Aug 04 23:15:21.586257 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 205/387] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:21 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:22.273047 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ac726974-103e-41b4-8b68-fbee84af93ab tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:22.273602 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ac726974-103e-41b4-8b68-fbee84af93ab tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: d510bd73-8106-4691-b351-101786b6dcd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:22.280105 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac726974-103e-41b4-8b68-fbee84af93ab tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:22.280575 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac726974-103e-41b4-8b68-fbee84af93ab tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:22.281007 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac726974-103e-41b4-8b68-fbee84af93ab tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:22.281688 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac726974-103e-41b4-8b68-fbee84af93ab tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:22.282132 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac726974-103e-41b4-8b68-fbee84af93ab tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:22.282581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac726974-103e-41b4-8b68-fbee84af93ab tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:22.413525 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ac726974-103e-41b4-8b68-fbee84af93ab tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:22.421842 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ac726974-103e-41b4-8b68-fbee84af93ab tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4" status: 200 len: 1313 microversion: 2.1 time: 0.152722 Aug 04 23:15:22.422412 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 183/388] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:22 2022] GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:22.609061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-97965855-ecfa-4ce1-ab95-f8a3cac9a7da tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:22.609625 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-97965855-ecfa-4ce1-ab95-f8a3cac9a7da tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:22.615740 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97965855-ecfa-4ce1-ab95-f8a3cac9a7da tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:22.616223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97965855-ecfa-4ce1-ab95-f8a3cac9a7da tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:22.616659 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97965855-ecfa-4ce1-ab95-f8a3cac9a7da tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:22.617360 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97965855-ecfa-4ce1-ab95-f8a3cac9a7da tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:22.617814 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97965855-ecfa-4ce1-ab95-f8a3cac9a7da tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:22.618235 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97965855-ecfa-4ce1-ab95-f8a3cac9a7da tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:22.773487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-97965855-ecfa-4ce1-ab95-f8a3cac9a7da tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:22.783576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-97965855-ecfa-4ce1-ab95-f8a3cac9a7da tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1523 microversion: 2.1 time: 0.179112 Aug 04 23:15:22.784057 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 206/389] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:22 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:23.445673 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e44991d2-f2e1-4a6f-9c0b-d079e723ce3b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:23.446539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e44991d2-f2e1-4a6f-9c0b-d079e723ce3b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: d510bd73-8106-4691-b351-101786b6dcd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:23.456193 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e44991d2-f2e1-4a6f-9c0b-d079e723ce3b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:23.457582 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e44991d2-f2e1-4a6f-9c0b-d079e723ce3b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:23.458276 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e44991d2-f2e1-4a6f-9c0b-d079e723ce3b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:23.459458 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e44991d2-f2e1-4a6f-9c0b-d079e723ce3b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:23.460119 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e44991d2-f2e1-4a6f-9c0b-d079e723ce3b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:23.460750 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e44991d2-f2e1-4a6f-9c0b-d079e723ce3b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:23.717912 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e44991d2-f2e1-4a6f-9c0b-d079e723ce3b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:23.734071 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e44991d2-f2e1-4a6f-9c0b-d079e723ce3b tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4" status: 200 len: 1313 microversion: 2.1 time: 0.293304 Aug 04 23:15:23.735178 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 184/390] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:23 2022] GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4 => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:23.806891 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e24df74d-0122-4f82-b1ee-96d1c4006825 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:23.818619 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e24df74d-0122-4f82-b1ee-96d1c4006825 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:23.827853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=2 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:15:23.828763 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=8 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:15:23.830472 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e24df74d-0122-4f82-b1ee-96d1c4006825 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:23.831128 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e24df74d-0122-4f82-b1ee-96d1c4006825 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:23.831534 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e24df74d-0122-4f82-b1ee-96d1c4006825 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:23.832254 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e24df74d-0122-4f82-b1ee-96d1c4006825 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:23.832719 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e24df74d-0122-4f82-b1ee-96d1c4006825 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:23.833153 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e24df74d-0122-4f82-b1ee-96d1c4006825 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:24.013621 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e24df74d-0122-4f82-b1ee-96d1c4006825 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:24.021666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e24df74d-0122-4f82-b1ee-96d1c4006825 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1503 microversion: 2.1 time: 0.219129 Aug 04 23:15:24.022890 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 207/391] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:23 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1503 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:24.047712 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-335b534b-d7b8-4247-922b-5f78fd0f0373 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa0d33de-f564-49e3-8732-79e6d7200779"}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:15:24.050203 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-335b534b-d7b8-4247-922b-5f78fd0f0373 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:24.057453 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-335b534b-d7b8-4247-922b-5f78fd0f0373 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:24.057994 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-335b534b-d7b8-4247-922b-5f78fd0f0373 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:24.059259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-335b534b-d7b8-4247-922b-5f78fd0f0373 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:24.060052 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-335b534b-d7b8-4247-922b-5f78fd0f0373 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:24.060638 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-335b534b-d7b8-4247-922b-5f78fd0f0373 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:24.061199 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-335b534b-d7b8-4247-922b-5f78fd0f0373 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:24.087263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-335b534b-d7b8-4247-922b-5f78fd0f0373 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] HTTP exception thrown: Cannot 'attach_volume' instance 9b9e29c3-d35b-4e35-90fb-6184265d0ecf while it is in vm_state rescued Aug 04 23:15:24.088871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-335b534b-d7b8-4247-922b-5f78fd0f0373 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Request method failure captured: Aug 04 23:15:24.088871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: POST /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf/os-volume_attachments HTTP/1.1 Aug 04 23:15:24.088871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:15:24.088871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:15:24.088871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:15:24.088871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 74 Aug 04 23:15:24.088871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:15:24.088871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:15:24.088871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:15:24.088871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:15:24.088871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FJ6RKYMdfsISiTgYEMvks0x5d50WB4Vbj1WQgE1v6AQbUxoUYQTrWgb9IvdiKRoAPbIyfnSaCOdg5gEaB9t_gZ5C6HO6cjgM58wzr3Oq1EOqCSLuKxKWCkjyonkLQBDSxbLmeiJH_Z9CWvDApSZl7vw3VKIMJPpD2CVXPZhXNad-G8 Aug 04 23:15:24.088871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:15:24.088871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:15:24.088871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:15:24.088871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:15:24.088871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:15:24.088871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:15:24.088871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: f50215d0b0ec4a109e14979c183a52a3 Aug 04 23:15:24.088871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-475500057 Aug 04 23:15:24.088871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:15:24.088871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:15:24.090679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f50215d0b0ec4a109e14979c183a52a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f50215d0b0ec4a109e14979c183a52a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f50215d0b0ec4a109e14979c183a52a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f50215d0b0ec4a109e14979c183a52a3"}]}] Aug 04 23:15:24.090679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-ServerRescueNegativeTestJSON-475500057 Aug 04 23:15:24.090679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: f50215d0b0ec4a109e14979c183a52a3 Aug 04 23:15:24.090679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-475500057 Aug 04 23:15:24.090679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-ServerRescueNegativeTestJSON-475500057-project Aug 04 23:15:24.090679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:15:24.090679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:15:24.090679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: 51af2dbb470849a4a044f6f78eef2d45 Aug 04 23:15:24.090679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-ServerRescueNegativeTestJSON-475500057-project Aug 04 23:15:24.090679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Aug 04 23:15:24.090679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {"volumeAttachment": {"volumeId": "fa0d33de-f564-49e3-8732-79e6d7200779"}} Aug 04 23:15:24.090679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:15:24.091639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Cannot 'attach_volume' instance 9b9e29c3-d35b-4e35-90fb-6184265d0ecf while it is in vm_state rescued Aug 04 23:15:24.091639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'server_id': '9b9e29c3-d35b-4e35-90fb-6184265d0ecf', 'body': {'volumeAttachment': {'volumeId': 'fa0d33de-f564-49e3-8732-79e6d7200779'}}} Aug 04 23:15:24.091639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:15:24.091639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:15:24.091639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 23:15:24.091639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 23:15:24.091639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 23:15:24.091639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 23:15:24.091639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 23:15:24.091639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 23:15:24.091639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9b9e29c3-d35b-4e35-90fb-6184265d0ecf in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 04 23:15:24.091639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:15:24.091639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:15:24.091639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:15:24.091639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:15:24.091639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:15:24.091639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:15:24.091639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:15:24.091639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:15:24.092993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:15:24.092993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:15:24.092993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 23:15:24.092993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 23:15:24.092993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 23:15:24.092993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 23:15:24.092993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 23:15:24.092993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 23:15:24.092993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 04 23:15:24.092993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 23:15:24.092993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 23:15:24.092993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 23:15:24.092993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9b9e29c3-d35b-4e35-90fb-6184265d0ecf while it is in vm_state rescued Aug 04 23:15:24.092993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:15:24.092993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:15:24.092993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:15:24.092993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:15:24.092993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:15:24.092993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:15:24.094084 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:15:24.094084 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:15:24.094084 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9b9e29c3-d35b-4e35-90fb-6184265d0ecf while it is in vm_state rescued Aug 04 23:15:24.094084 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:15:24.094084 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-335b534b-d7b8-4247-922b-5f78fd0f0373 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Returning 409 to user: Cannot 'attach_volume' instance 9b9e29c3-d35b-4e35-90fb-6184265d0ecf while it is in vm_state rescued {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:15:24.094084 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-335b534b-d7b8-4247-922b-5f78fd0f0373 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "POST /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047544 Aug 04 23:15:24.094084 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 185/392] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Aug 4 23:15:24 2022] POST /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 04 23:15:24.101636 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c2fe7b7b-eb00-41e0-956b-888e6060f740 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:15:24.102173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c2fe7b7b-eb00-41e0-956b-888e6060f740 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:24.108378 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2fe7b7b-eb00-41e0-956b-888e6060f740 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:24.108857 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2fe7b7b-eb00-41e0-956b-888e6060f740 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:24.109287 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2fe7b7b-eb00-41e0-956b-888e6060f740 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:24.109991 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2fe7b7b-eb00-41e0-956b-888e6060f740 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:24.110467 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2fe7b7b-eb00-41e0-956b-888e6060f740 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:24.110891 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2fe7b7b-eb00-41e0-956b-888e6060f740 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:24.189265 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c2fe7b7b-eb00-41e0-956b-888e6060f740 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "POST /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf/action" status: 202 len: 0 microversion: 2.1 time: 0.091551 Aug 04 23:15:24.189964 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 208/393] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Aug 4 23:15:24 2022] POST /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:15:24.208096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-24d68d35-eb4e-4b5f-ba4f-f75950ec0fcb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:24.208805 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-24d68d35-eb4e-4b5f-ba4f-f75950ec0fcb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:24.216420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24d68d35-eb4e-4b5f-ba4f-f75950ec0fcb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:24.216974 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24d68d35-eb4e-4b5f-ba4f-f75950ec0fcb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:24.217738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24d68d35-eb4e-4b5f-ba4f-f75950ec0fcb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:24.219108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24d68d35-eb4e-4b5f-ba4f-f75950ec0fcb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:24.219108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24d68d35-eb4e-4b5f-ba4f-f75950ec0fcb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:24.219540 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24d68d35-eb4e-4b5f-ba4f-f75950ec0fcb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:24.419989 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-24d68d35-eb4e-4b5f-ba4f-f75950ec0fcb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:24.430308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-24d68d35-eb4e-4b5f-ba4f-f75950ec0fcb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1511 microversion: 2.1 time: 0.235979 Aug 04 23:15:24.431479 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 186/394] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:24 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1511 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:15:24.762521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5ef8be26-0c28-4e1a-a6b4-901db63762f8 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:24.764099 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5ef8be26-0c28-4e1a-a6b4-901db63762f8 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: d510bd73-8106-4691-b351-101786b6dcd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:24.771768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ef8be26-0c28-4e1a-a6b4-901db63762f8 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:24.772628 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ef8be26-0c28-4e1a-a6b4-901db63762f8 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:24.773189 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ef8be26-0c28-4e1a-a6b4-901db63762f8 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:24.774274 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ef8be26-0c28-4e1a-a6b4-901db63762f8 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:24.774912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ef8be26-0c28-4e1a-a6b4-901db63762f8 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:24.775507 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ef8be26-0c28-4e1a-a6b4-901db63762f8 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:24.947041 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5ef8be26-0c28-4e1a-a6b4-901db63762f8 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:24.958766 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5ef8be26-0c28-4e1a-a6b4-901db63762f8 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4" status: 200 len: 1313 microversion: 2.1 time: 0.204793 Aug 04 23:15:24.959226 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 209/395] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:24 2022] GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:25.453491 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2e34dc14-bc77-4f7e-bbc1-085eb4018f55 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:25.454196 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2e34dc14-bc77-4f7e-bbc1-085eb4018f55 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:25.460965 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e34dc14-bc77-4f7e-bbc1-085eb4018f55 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:25.461379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e34dc14-bc77-4f7e-bbc1-085eb4018f55 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:25.461814 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e34dc14-bc77-4f7e-bbc1-085eb4018f55 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:25.462858 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e34dc14-bc77-4f7e-bbc1-085eb4018f55 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:25.463312 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e34dc14-bc77-4f7e-bbc1-085eb4018f55 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:25.463733 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e34dc14-bc77-4f7e-bbc1-085eb4018f55 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:25.602186 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2e34dc14-bc77-4f7e-bbc1-085eb4018f55 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:25.610581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2e34dc14-bc77-4f7e-bbc1-085eb4018f55 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1511 microversion: 2.1 time: 0.161559 Aug 04 23:15:25.611170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 187/396] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:25 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:25.804182 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-21e9747f-432b-4918-bf4c-77b8cc0fca02 req-ed97c495-f8bc-4f32-bacf-319455b80f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d510bd73-8106-4691-b351-101786b6dcd4", "name": "network-vif-plugged", "status": "completed", "tag": "f16172af-fcd2-4968-8555-270d2192f774"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:15:25.819856 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-21e9747f-432b-4918-bf4c-77b8cc0fca02 req-ed97c495-f8bc-4f32-bacf-319455b80f50 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:25.820377 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-21e9747f-432b-4918-bf4c-77b8cc0fca02 req-ed97c495-f8bc-4f32-bacf-319455b80f50 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:25.821007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-21e9747f-432b-4918-bf4c-77b8cc0fca02 req-ed97c495-f8bc-4f32-bacf-319455b80f50 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:25.840286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-21e9747f-432b-4918-bf4c-77b8cc0fca02 req-ed97c495-f8bc-4f32-bacf-319455b80f50 service nova] Creating event network-vif-plugged:f16172af-fcd2-4968-8555-270d2192f774 for instance d510bd73-8106-4691-b351-101786b6dcd4 on hv-cinder-85221 Aug 04 23:15:25.846019 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-21e9747f-432b-4918-bf4c-77b8cc0fca02 req-ed97c495-f8bc-4f32-bacf-319455b80f50 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044878 Aug 04 23:15:25.846919 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 210/397] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:15:25.980831 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4b22fb9f-2fd9-4663-abf6-60fdf10f6fe1 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:25.981452 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4b22fb9f-2fd9-4663-abf6-60fdf10f6fe1 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: d510bd73-8106-4691-b351-101786b6dcd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:25.987449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b22fb9f-2fd9-4663-abf6-60fdf10f6fe1 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:25.987978 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b22fb9f-2fd9-4663-abf6-60fdf10f6fe1 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:25.988370 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b22fb9f-2fd9-4663-abf6-60fdf10f6fe1 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:25.989070 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b22fb9f-2fd9-4663-abf6-60fdf10f6fe1 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:25.989522 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b22fb9f-2fd9-4663-abf6-60fdf10f6fe1 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:25.989947 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b22fb9f-2fd9-4663-abf6-60fdf10f6fe1 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:26.130875 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4b22fb9f-2fd9-4663-abf6-60fdf10f6fe1 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:26.138965 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4b22fb9f-2fd9-4663-abf6-60fdf10f6fe1 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4" status: 200 len: 1313 microversion: 2.1 time: 0.162108 Aug 04 23:15:26.139858 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 188/398] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:25 2022] GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:26.633168 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-51b69ba0-39f5-4235-bed5-5b2bfa5f0e37 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:26.633768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-51b69ba0-39f5-4235-bed5-5b2bfa5f0e37 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:26.640103 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51b69ba0-39f5-4235-bed5-5b2bfa5f0e37 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:26.640576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51b69ba0-39f5-4235-bed5-5b2bfa5f0e37 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:26.641004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51b69ba0-39f5-4235-bed5-5b2bfa5f0e37 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:26.641694 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51b69ba0-39f5-4235-bed5-5b2bfa5f0e37 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:26.642142 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51b69ba0-39f5-4235-bed5-5b2bfa5f0e37 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:26.642604 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51b69ba0-39f5-4235-bed5-5b2bfa5f0e37 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:26.792434 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-51b69ba0-39f5-4235-bed5-5b2bfa5f0e37 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:26.802325 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-51b69ba0-39f5-4235-bed5-5b2bfa5f0e37 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1511 microversion: 2.1 time: 0.173406 Aug 04 23:15:26.802926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 211/399] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:26 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:27.162116 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d162bec0-1809-4078-a00d-8226deecb81d tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:27.162805 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d162bec0-1809-4078-a00d-8226deecb81d tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: d510bd73-8106-4691-b351-101786b6dcd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:27.170389 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d162bec0-1809-4078-a00d-8226deecb81d tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:27.171067 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d162bec0-1809-4078-a00d-8226deecb81d tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:27.171581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d162bec0-1809-4078-a00d-8226deecb81d tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:27.172206 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d162bec0-1809-4078-a00d-8226deecb81d tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:27.172703 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d162bec0-1809-4078-a00d-8226deecb81d tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:27.173092 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d162bec0-1809-4078-a00d-8226deecb81d tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:27.325539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d162bec0-1809-4078-a00d-8226deecb81d tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:27.333484 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d162bec0-1809-4078-a00d-8226deecb81d tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4" status: 200 len: 1313 microversion: 2.1 time: 0.176546 Aug 04 23:15:27.334060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 189/400] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:27 2022] GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:27.832832 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-26e2f2f5-fb19-40d2-9120-20341b0bd0e2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:27.833454 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-26e2f2f5-fb19-40d2-9120-20341b0bd0e2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:27.841214 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26e2f2f5-fb19-40d2-9120-20341b0bd0e2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:27.841398 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26e2f2f5-fb19-40d2-9120-20341b0bd0e2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:27.841756 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26e2f2f5-fb19-40d2-9120-20341b0bd0e2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:27.842567 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26e2f2f5-fb19-40d2-9120-20341b0bd0e2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:27.843250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26e2f2f5-fb19-40d2-9120-20341b0bd0e2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:27.843416 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26e2f2f5-fb19-40d2-9120-20341b0bd0e2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:27.993799 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-26e2f2f5-fb19-40d2-9120-20341b0bd0e2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:28.002813 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-26e2f2f5-fb19-40d2-9120-20341b0bd0e2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1517 microversion: 2.1 time: 0.173596 Aug 04 23:15:28.006413 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 212/401] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:27 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:15:28.358641 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-85bc9de1-1ee9-4307-a5bc-ef5225fbc99a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:28.358641 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-85bc9de1-1ee9-4307-a5bc-ef5225fbc99a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: d510bd73-8106-4691-b351-101786b6dcd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:28.365440 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85bc9de1-1ee9-4307-a5bc-ef5225fbc99a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:28.366114 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85bc9de1-1ee9-4307-a5bc-ef5225fbc99a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:28.366657 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85bc9de1-1ee9-4307-a5bc-ef5225fbc99a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:28.367541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85bc9de1-1ee9-4307-a5bc-ef5225fbc99a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:28.368065 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85bc9de1-1ee9-4307-a5bc-ef5225fbc99a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:28.368490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85bc9de1-1ee9-4307-a5bc-ef5225fbc99a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:28.525235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-85bc9de1-1ee9-4307-a5bc-ef5225fbc99a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:28.533696 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-85bc9de1-1ee9-4307-a5bc-ef5225fbc99a tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4" status: 200 len: 1313 microversion: 2.1 time: 0.180522 Aug 04 23:15:28.534276 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 190/402] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:28 2022] GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:29.431252 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a49b3d1d-2e39-492a-a3bc-768f9a0364f9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Action: 'create', calling method: .version_select at 0x7f6d267dda60>, body: {"keypair": {"name": "tempest-keypair-1577644367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSCkQwV9i0sIzQFnf7UOwVRCpYH9O0HkS7e8IEzpF4WkOax8lfDgJjifxESxGejqMJd+oZV3dAg0IwPbEMUIxIzqDrLamkPp2mMsM3Xu6zv/LS93jNcMyAbuAXPAQ67vQ=="}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:15:29.458889 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-a49b3d1d-2e39-492a-a3bc-768f9a0364f9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Getting quotas for project f50215d0b0ec4a109e14979c183a52a3. Resources: {'key_pairs'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:15:29.465492 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-a49b3d1d-2e39-492a-a3bc-768f9a0364f9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Getting quotas for user 51af2dbb470849a4a044f6f78eef2d45 and project f50215d0b0ec4a109e14979c183a52a3. Resources: {'key_pairs'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:15:29.507944 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a49b3d1d-2e39-492a-a3bc-768f9a0364f9 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.081700 Aug 04 23:15:29.509075 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 213/403] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Aug 4 23:15:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:15:29.558947 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6ac694a4-29c5-41a2-a226-4034462923e6 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:29.560352 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6ac694a4-29c5-41a2-a226-4034462923e6 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: d510bd73-8106-4691-b351-101786b6dcd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:29.567521 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ac694a4-29c5-41a2-a226-4034462923e6 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:29.568011 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ac694a4-29c5-41a2-a226-4034462923e6 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:29.568557 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ac694a4-29c5-41a2-a226-4034462923e6 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:29.569274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ac694a4-29c5-41a2-a226-4034462923e6 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:29.569786 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ac694a4-29c5-41a2-a226-4034462923e6 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:29.570269 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ac694a4-29c5-41a2-a226-4034462923e6 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:29.742301 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6ac694a4-29c5-41a2-a226-4034462923e6 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:29.750730 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6ac694a4-29c5-41a2-a226-4034462923e6 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4" status: 200 len: 1496 microversion: 2.1 time: 0.198808 Aug 04 23:15:29.751304 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 191/404] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:29 2022] GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4 => generated 1496 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:30.640258 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a8fc4b5b-bcc4-4f64-b2e7-a502f6cde97c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:30.640866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a8fc4b5b-bcc4-4f64-b2e7-a502f6cde97c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: d510bd73-8106-4691-b351-101786b6dcd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:30.647520 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8fc4b5b-bcc4-4f64-b2e7-a502f6cde97c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:30.648009 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8fc4b5b-bcc4-4f64-b2e7-a502f6cde97c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:30.648540 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8fc4b5b-bcc4-4f64-b2e7-a502f6cde97c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:30.649839 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8fc4b5b-bcc4-4f64-b2e7-a502f6cde97c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:30.649839 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8fc4b5b-bcc4-4f64-b2e7-a502f6cde97c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:30.650316 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8fc4b5b-bcc4-4f64-b2e7-a502f6cde97c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:30.680837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a8fc4b5b-bcc4-4f64-b2e7-a502f6cde97c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: d510bd73-8106-4691-b351-101786b6dcd4] Going to try to terminate instance {{(pid=129791) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 23:15:30.779358 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a8fc4b5b-bcc4-4f64-b2e7-a502f6cde97c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4" status: 204 len: 0 microversion: 2.1 time: 0.141551 Aug 04 23:15:30.780338 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 214/405] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:15:30 2022] DELETE /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 23:15:30.792236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b524bbbe-7e51-496c-9828-f0b0759c53a4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:30.793957 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b524bbbe-7e51-496c-9828-f0b0759c53a4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: d510bd73-8106-4691-b351-101786b6dcd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:30.803969 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b524bbbe-7e51-496c-9828-f0b0759c53a4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:30.805060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b524bbbe-7e51-496c-9828-f0b0759c53a4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:30.805815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b524bbbe-7e51-496c-9828-f0b0759c53a4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:30.807069 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b524bbbe-7e51-496c-9828-f0b0759c53a4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:30.807986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b524bbbe-7e51-496c-9828-f0b0759c53a4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:30.815707 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b524bbbe-7e51-496c-9828-f0b0759c53a4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:31.076414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b524bbbe-7e51-496c-9828-f0b0759c53a4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:31.085997 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b524bbbe-7e51-496c-9828-f0b0759c53a4 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4" status: 200 len: 1502 microversion: 2.1 time: 0.299152 Aug 04 23:15:31.085997 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 192/406] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:30 2022] GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4 => generated 1502 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:31.312479 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-05693f9a-788c-4ed3-87be-850130807d4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1129209740", "imageRef": "e1e9d70e-b252-44e5-9ecd-bf73cbf00160", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7107f474-309d-4f6e-8900-fb5164d73cfb"}], "security_groups": [{"name": "tempest-securitygroup--1545607011"}], "key_name": "tempest-keypair-1577644367", "user_data": "}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:15:31.427155 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.network.neutron [None req-05693f9a-788c-4ed3-87be-850130807d4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] validate_networks() for [('7107f474-309d-4f6e-8900-fb5164d73cfb', None, None, None, None, None)] {{(pid=129791) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 23:15:31.821939 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-05693f9a-788c-4ed3-87be-850130807d4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Flavor limits 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 23:15:31.822609 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-05693f9a-788c-4ed3-87be-850130807d4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Image limits 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 23:15:31.822872 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-05693f9a-788c-4ed3-87be-850130807d4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Flavor pref 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 23:15:31.823271 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-05693f9a-788c-4ed3-87be-850130807d4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Image pref 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 23:15:31.823670 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-05693f9a-788c-4ed3-87be-850130807d4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 23:15:31.834093 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05693f9a-788c-4ed3-87be-850130807d4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:31.834643 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05693f9a-788c-4ed3-87be-850130807d4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:31.835076 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05693f9a-788c-4ed3-87be-850130807d4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:31.835923 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05693f9a-788c-4ed3-87be-850130807d4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:31.836237 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05693f9a-788c-4ed3-87be-850130807d4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:31.836654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05693f9a-788c-4ed3-87be-850130807d4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:31.854598 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-05693f9a-788c-4ed3-87be-850130807d4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Getting quotas for project f50215d0b0ec4a109e14979c183a52a3. Resources: {'ram', 'instances', 'cores'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:15:31.859377 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-05693f9a-788c-4ed3-87be-850130807d4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Getting quotas for user 51af2dbb470849a4a044f6f78eef2d45 and project f50215d0b0ec4a109e14979c183a52a3. Resources: {'ram', 'instances', 'cores'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:15:31.870886 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-05693f9a-788c-4ed3-87be-850130807d4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Going to run 1 instances... {{(pid=129791) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 23:15:31.873570 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-05693f9a-788c-4ed3-87be-850130807d4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1e9d70e-b252-44e5-9ecd-bf73cbf00160',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 23:15:31.923709 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-05693f9a-788c-4ed3-87be-850130807d4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.616374 Aug 04 23:15:31.924456 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 215/407] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Aug 4 23:15:31 2022] POST /compute/v2.1/servers => generated 409 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 23:15:31.935849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ffd39ed0-dce5-41f7-bff9-0fde97c7b90e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:31.936569 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ffd39ed0-dce5-41f7-bff9-0fde97c7b90e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:31.994935 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ffd39ed0-dce5-41f7-bff9-0fde97c7b90e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:32.002738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ffd39ed0-dce5-41f7-bff9-0fde97c7b90e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1246 microversion: 2.1 time: 0.071084 Aug 04 23:15:32.003624 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 193/408] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:31 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1246 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:32.109014 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b31ea0bb-8869-40fb-8715-316001b3e524 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:32.109636 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b31ea0bb-8869-40fb-8715-316001b3e524 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: d510bd73-8106-4691-b351-101786b6dcd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:32.116866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b31ea0bb-8869-40fb-8715-316001b3e524 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:32.117355 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b31ea0bb-8869-40fb-8715-316001b3e524 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:32.117786 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b31ea0bb-8869-40fb-8715-316001b3e524 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:32.118522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b31ea0bb-8869-40fb-8715-316001b3e524 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:32.118975 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b31ea0bb-8869-40fb-8715-316001b3e524 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:32.119396 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b31ea0bb-8869-40fb-8715-316001b3e524 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:32.275484 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b31ea0bb-8869-40fb-8715-316001b3e524 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:32.283638 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b31ea0bb-8869-40fb-8715-316001b3e524 tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4" status: 200 len: 1502 microversion: 2.1 time: 0.178372 Aug 04 23:15:32.287570 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 216/409] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:32 2022] GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4 => generated 1502 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:32.989810 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-d28a147d-b660-4a92-a246-8d6d86054d9f req-b68bf572-39e4-4b3d-aa63-9a9b6bfc045e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d510bd73-8106-4691-b351-101786b6dcd4", "name": "network-vif-deleted", "tag": "f16172af-fcd2-4968-8555-270d2192f774"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:15:33.005325 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-d28a147d-b660-4a92-a246-8d6d86054d9f req-b68bf572-39e4-4b3d-aa63-9a9b6bfc045e service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:33.006052 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-d28a147d-b660-4a92-a246-8d6d86054d9f req-b68bf572-39e4-4b3d-aa63-9a9b6bfc045e service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:33.006524 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-d28a147d-b660-4a92-a246-8d6d86054d9f req-b68bf572-39e4-4b3d-aa63-9a9b6bfc045e service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:33.018097 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-d28a147d-b660-4a92-a246-8d6d86054d9f req-b68bf572-39e4-4b3d-aa63-9a9b6bfc045e service nova] Creating event network-vif-deleted:f16172af-fcd2-4968-8555-270d2192f774 for instance d510bd73-8106-4691-b351-101786b6dcd4 on hv-cinder-85221 Aug 04 23:15:33.024363 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-d28a147d-b660-4a92-a246-8d6d86054d9f req-b68bf572-39e4-4b3d-aa63-9a9b6bfc045e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038602 Aug 04 23:15:33.024949 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 194/410] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:15:33.029830 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-bb9d0a84-257e-4283-810a-7142ea0596df tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:33.030699 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-bb9d0a84-257e-4283-810a-7142ea0596df tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:33.052608 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bb9d0a84-257e-4283-810a-7142ea0596df tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:33.053515 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bb9d0a84-257e-4283-810a-7142ea0596df tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:33.054316 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bb9d0a84-257e-4283-810a-7142ea0596df tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:33.055643 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bb9d0a84-257e-4283-810a-7142ea0596df tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:33.056484 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bb9d0a84-257e-4283-810a-7142ea0596df tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:33.057263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bb9d0a84-257e-4283-810a-7142ea0596df tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:33.203741 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-bb9d0a84-257e-4283-810a-7142ea0596df tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:33.216431 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-bb9d0a84-257e-4283-810a-7142ea0596df tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1306 microversion: 2.1 time: 0.192938 Aug 04 23:15:33.217108 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 217/411] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:33 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1306 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:15:33.309668 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-dea6ab8b-1b30-429c-8080-bd8d4bc54f5c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:33.310436 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-dea6ab8b-1b30-429c-8080-bd8d4bc54f5c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: d510bd73-8106-4691-b351-101786b6dcd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:33.316594 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dea6ab8b-1b30-429c-8080-bd8d4bc54f5c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:33.317074 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dea6ab8b-1b30-429c-8080-bd8d4bc54f5c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:33.317536 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dea6ab8b-1b30-429c-8080-bd8d4bc54f5c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:33.318224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dea6ab8b-1b30-429c-8080-bd8d4bc54f5c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:33.318704 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dea6ab8b-1b30-429c-8080-bd8d4bc54f5c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:33.319301 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dea6ab8b-1b30-429c-8080-bd8d4bc54f5c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:33.351634 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dea6ab8b-1b30-429c-8080-bd8d4bc54f5c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:33.352108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dea6ab8b-1b30-429c-8080-bd8d4bc54f5c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:33.352543 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dea6ab8b-1b30-429c-8080-bd8d4bc54f5c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:33.352986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.objects.instance [None req-dea6ab8b-1b30-429c-8080-bd8d4bc54f5c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lazy-loading 'fault' on Instance uuid d510bd73-8106-4691-b351-101786b6dcd4 {{(pid=129790) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:15:33.401758 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-dea6ab8b-1b30-429c-8080-bd8d4bc54f5c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3df18fff9343a1984468c0ea8517e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b69e8dd8254e4e1f813bc3fce0438b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:33.409774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-dea6ab8b-1b30-429c-8080-bd8d4bc54f5c tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4" status: 200 len: 1303 microversion: 2.1 time: 0.105332 Aug 04 23:15:33.410375 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 195/412] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:33 2022] GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4 => generated 1303 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:34.238018 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-bd780009-b380-42c6-b822-07ff03564533 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:34.238928 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-bd780009-b380-42c6-b822-07ff03564533 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:34.247363 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd780009-b380-42c6-b822-07ff03564533 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:34.248156 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd780009-b380-42c6-b822-07ff03564533 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:34.248841 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd780009-b380-42c6-b822-07ff03564533 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:34.250101 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd780009-b380-42c6-b822-07ff03564533 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:34.251084 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd780009-b380-42c6-b822-07ff03564533 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:34.251830 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd780009-b380-42c6-b822-07ff03564533 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:34.439487 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4b17254d-1bca-4869-b971-ee2333852ffc tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:34.444058 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4b17254d-1bca-4869-b971-ee2333852ffc tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] [instance: d510bd73-8106-4691-b351-101786b6dcd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:34.447248 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:15:34.456207 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b17254d-1bca-4869-b971-ee2333852ffc tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:34.456876 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b17254d-1bca-4869-b971-ee2333852ffc tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:34.457403 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b17254d-1bca-4869-b971-ee2333852ffc tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:34.460250 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b17254d-1bca-4869-b971-ee2333852ffc tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:34.460250 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b17254d-1bca-4869-b971-ee2333852ffc tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:34.460250 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b17254d-1bca-4869-b971-ee2333852ffc tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:34.478049 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-bd780009-b380-42c6-b822-07ff03564533 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:34.479885 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-4b17254d-1bca-4869-b971-ee2333852ffc tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] HTTP exception thrown: Instance d510bd73-8106-4691-b351-101786b6dcd4 could not be found. Aug 04 23:15:34.482173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4b17254d-1bca-4869-b971-ee2333852ffc tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Request method failure captured: Aug 04 23:15:34.482173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4 HTTP/1.1 Aug 04 23:15:34.482173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:15:34.482173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:15:34.482173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:15:34.482173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:15:34.482173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:15:34.482173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:15:34.482173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:15:34.482173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:15:34.482173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FLoWU510KU44fEaNQJNYYm7XtAy1os0j902Xu9VohXGpuaXpEj9DFzcYCwdJbL1DmPErcLYzmcvGTrcjD5ojPbXvRc9ttkPeGuSPtYtrwaDvLbTOSN5NBSvPyIlHOXj02c7nG1nnVPf2WJKSf6FSHMCAjoSong-AbB42Oh_whhYPuI Aug 04 23:15:34.482173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:15:34.482173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:15:34.482173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:15:34.482173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:15:34.482173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:15:34.482173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:15:34.482173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: b69e8dd8254e4e1f813bc3fce0438b50 Aug 04 23:15:34.482173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-VolumesActionsTest-1787306269 Aug 04 23:15:34.482173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:15:34.482173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:15:34.483835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b69e8dd8254e4e1f813bc3fce0438b50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b69e8dd8254e4e1f813bc3fce0438b50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b69e8dd8254e4e1f813bc3fce0438b50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b69e8dd8254e4e1f813bc3fce0438b50"}]}] Aug 04 23:15:34.483835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-VolumesActionsTest-1787306269 Aug 04 23:15:34.483835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: b69e8dd8254e4e1f813bc3fce0438b50 Aug 04 23:15:34.483835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-VolumesActionsTest-1787306269 Aug 04 23:15:34.483835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-VolumesActionsTest-1787306269-project Aug 04 23:15:34.483835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:15:34.483835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:15:34.483835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: 9b3df18fff9343a1984468c0ea8517e4 Aug 04 23:15:34.483835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-VolumesActionsTest-1787306269-project Aug 04 23:15:34.483835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:15:34.483835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Instance d510bd73-8106-4691-b351-101786b6dcd4 could not be found. Aug 04 23:15:34.483835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': 'd510bd73-8106-4691-b351-101786b6dcd4'} Aug 04 23:15:34.484567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:15:34.484567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:15:34.484567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:15:34.484567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:15:34.484567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:15:34.484567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:15:34.484567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:15:34.484567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:15:34.484567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:15:34.484567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:15:34.484567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d510bd73-8106-4691-b351-101786b6dcd4 could not be found. Aug 04 23:15:34.484567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:15:34.484567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:15:34.484567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:15:34.484567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:15:34.484567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:15:34.484567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:15:34.484567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:15:34.484567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:15:34.484567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:15:34.485772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:15:34.485772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:15:34.485772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:15:34.485772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:15:34.485772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:15:34.485772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:15:34.485772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:15:34.485772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d510bd73-8106-4691-b351-101786b6dcd4 could not be found. Aug 04 23:15:34.485772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:15:34.485772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:15:34.485772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:15:34.485772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:15:34.485772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:15:34.485772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:15:34.485772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:15:34.485772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:15:34.485772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d510bd73-8106-4691-b351-101786b6dcd4 could not be found. Aug 04 23:15:34.485772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:15:34.487960 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4b17254d-1bca-4869-b971-ee2333852ffc tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] Returning 404 to user: Instance d510bd73-8106-4691-b351-101786b6dcd4 could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:15:34.487960 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4b17254d-1bca-4869-b971-ee2333852ffc tempest-VolumesActionsTest-1787306269 tempest-VolumesActionsTest-1787306269-project] 10.222.0.33 "GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4" status: 404 len: 111 microversion: 2.1 time: 0.055233 Aug 04 23:15:34.487960 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 196/413] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:34 2022] GET /compute/v2.1/servers/d510bd73-8106-4691-b351-101786b6dcd4 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:15:34.501247 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-bd780009-b380-42c6-b822-07ff03564533 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1372 microversion: 2.1 time: 0.267299 Aug 04 23:15:34.502196 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 218/414] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:34 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1372 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:35.107102 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-0fd4f6ac-fbe5-46c1-9580-4b386b5f3d30 req-82a8c55b-07f9-4521-a2dd-9e8ffed4fbe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13d950e0-48a6-44d6-9aae-723354b66c48", "tag": "e81f804d-489a-45c5-bf6d-27259b247ae5"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:15:35.136701 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-0fd4f6ac-fbe5-46c1-9580-4b386b5f3d30 req-82a8c55b-07f9-4521-a2dd-9e8ffed4fbe3 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:35.137770 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-0fd4f6ac-fbe5-46c1-9580-4b386b5f3d30 req-82a8c55b-07f9-4521-a2dd-9e8ffed4fbe3 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:35.138808 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-0fd4f6ac-fbe5-46c1-9580-4b386b5f3d30 req-82a8c55b-07f9-4521-a2dd-9e8ffed4fbe3 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:35.182134 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-0fd4f6ac-fbe5-46c1-9580-4b386b5f3d30 req-82a8c55b-07f9-4521-a2dd-9e8ffed4fbe3 service nova] Creating event network-changed:e81f804d-489a-45c5-bf6d-27259b247ae5 for instance 13d950e0-48a6-44d6-9aae-723354b66c48 on hv-cinder-85221 Aug 04 23:15:35.192393 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-0fd4f6ac-fbe5-46c1-9580-4b386b5f3d30 req-82a8c55b-07f9-4521-a2dd-9e8ffed4fbe3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099811 Aug 04 23:15:35.193373 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 197/415] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:15:35.536743 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-00f60258-69f8-4152-8805-032972a22f8d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:35.538736 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-00f60258-69f8-4152-8805-032972a22f8d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:35.547762 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-00f60258-69f8-4152-8805-032972a22f8d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:35.548418 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-00f60258-69f8-4152-8805-032972a22f8d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:35.549149 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-00f60258-69f8-4152-8805-032972a22f8d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:35.550004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-00f60258-69f8-4152-8805-032972a22f8d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:35.550578 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-00f60258-69f8-4152-8805-032972a22f8d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:35.551077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-00f60258-69f8-4152-8805-032972a22f8d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:35.750575 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-00f60258-69f8-4152-8805-032972a22f8d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:35.759766 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-00f60258-69f8-4152-8805-032972a22f8d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1372 microversion: 2.1 time: 0.227536 Aug 04 23:15:35.761148 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 219/416] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:35 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1372 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:36.782018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-95843a06-5f45-4941-8ad0-d5d8affeaaf2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:36.782763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-95843a06-5f45-4941-8ad0-d5d8affeaaf2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:36.789626 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-95843a06-5f45-4941-8ad0-d5d8affeaaf2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:36.790112 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-95843a06-5f45-4941-8ad0-d5d8affeaaf2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:36.790589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-95843a06-5f45-4941-8ad0-d5d8affeaaf2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:36.791293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-95843a06-5f45-4941-8ad0-d5d8affeaaf2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:36.791754 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-95843a06-5f45-4941-8ad0-d5d8affeaaf2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:36.792177 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-95843a06-5f45-4941-8ad0-d5d8affeaaf2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:36.943174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-95843a06-5f45-4941-8ad0-d5d8affeaaf2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:36.951764 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-95843a06-5f45-4941-8ad0-d5d8affeaaf2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1372 microversion: 2.1 time: 0.174562 Aug 04 23:15:36.952325 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 198/417] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:36 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:37.973811 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-05b9c115-ed17-49fa-ad9b-6c1cb2e06b59 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:37.974411 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-05b9c115-ed17-49fa-ad9b-6c1cb2e06b59 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:37.981118 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05b9c115-ed17-49fa-ad9b-6c1cb2e06b59 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:37.981608 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05b9c115-ed17-49fa-ad9b-6c1cb2e06b59 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:37.982038 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05b9c115-ed17-49fa-ad9b-6c1cb2e06b59 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:37.982764 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05b9c115-ed17-49fa-ad9b-6c1cb2e06b59 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:37.983207 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05b9c115-ed17-49fa-ad9b-6c1cb2e06b59 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:37.983618 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05b9c115-ed17-49fa-ad9b-6c1cb2e06b59 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:38.134825 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-05b9c115-ed17-49fa-ad9b-6c1cb2e06b59 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:38.143402 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-05b9c115-ed17-49fa-ad9b-6c1cb2e06b59 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1372 microversion: 2.1 time: 0.173334 Aug 04 23:15:38.143985 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 220/418] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:37 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:39.166704 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9d022e9b-1c08-4987-a2ad-d63bcdd727b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:39.167319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9d022e9b-1c08-4987-a2ad-d63bcdd727b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:39.175181 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d022e9b-1c08-4987-a2ad-d63bcdd727b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:39.175667 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d022e9b-1c08-4987-a2ad-d63bcdd727b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:39.176097 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d022e9b-1c08-4987-a2ad-d63bcdd727b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:39.176797 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d022e9b-1c08-4987-a2ad-d63bcdd727b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:39.177237 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d022e9b-1c08-4987-a2ad-d63bcdd727b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:39.177652 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d022e9b-1c08-4987-a2ad-d63bcdd727b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:39.311937 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9d022e9b-1c08-4987-a2ad-d63bcdd727b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:39.315538 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:15:39.320564 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9d022e9b-1c08-4987-a2ad-d63bcdd727b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1372 microversion: 2.1 time: 0.157778 Aug 04 23:15:39.321126 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 199/419] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:39 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:40.342722 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0f00c358-7ed7-4fd0-b7f1-b150da1c795c tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:40.343509 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0f00c358-7ed7-4fd0-b7f1-b150da1c795c tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:40.349853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f00c358-7ed7-4fd0-b7f1-b150da1c795c tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:40.350340 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f00c358-7ed7-4fd0-b7f1-b150da1c795c tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:40.350812 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f00c358-7ed7-4fd0-b7f1-b150da1c795c tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:40.351520 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f00c358-7ed7-4fd0-b7f1-b150da1c795c tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:40.351969 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f00c358-7ed7-4fd0-b7f1-b150da1c795c tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:40.352397 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f00c358-7ed7-4fd0-b7f1-b150da1c795c tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:40.355807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:15:40.492570 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0f00c358-7ed7-4fd0-b7f1-b150da1c795c tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:40.502006 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0f00c358-7ed7-4fd0-b7f1-b150da1c795c tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1372 microversion: 2.1 time: 0.163662 Aug 04 23:15:40.509754 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 221/420] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:40 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:41.524037 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-41ced2d4-b5f9-499e-a5ca-7c87f8bb2e1d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:41.524659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-41ced2d4-b5f9-499e-a5ca-7c87f8bb2e1d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:41.533708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-41ced2d4-b5f9-499e-a5ca-7c87f8bb2e1d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:41.534053 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-41ced2d4-b5f9-499e-a5ca-7c87f8bb2e1d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:41.534523 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-41ced2d4-b5f9-499e-a5ca-7c87f8bb2e1d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:41.535569 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-41ced2d4-b5f9-499e-a5ca-7c87f8bb2e1d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:41.536028 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-41ced2d4-b5f9-499e-a5ca-7c87f8bb2e1d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:41.536448 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-41ced2d4-b5f9-499e-a5ca-7c87f8bb2e1d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:41.704406 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-41ced2d4-b5f9-499e-a5ca-7c87f8bb2e1d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:41.711988 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-41ced2d4-b5f9-499e-a5ca-7c87f8bb2e1d tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1372 microversion: 2.1 time: 0.192522 Aug 04 23:15:41.712826 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 200/421] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:41 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1372 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:42.735833 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fed8b3bf-5743-4e59-8be7-104f6848a992 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:42.738060 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-fed8b3bf-5743-4e59-8be7-104f6848a992 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:42.750587 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=2 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:15:42.752041 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=10 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:15:42.754934 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fed8b3bf-5743-4e59-8be7-104f6848a992 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:42.756021 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fed8b3bf-5743-4e59-8be7-104f6848a992 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:42.756777 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fed8b3bf-5743-4e59-8be7-104f6848a992 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:42.758224 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fed8b3bf-5743-4e59-8be7-104f6848a992 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:42.759547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fed8b3bf-5743-4e59-8be7-104f6848a992 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:42.760172 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fed8b3bf-5743-4e59-8be7-104f6848a992 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:42.966681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fed8b3bf-5743-4e59-8be7-104f6848a992 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:42.976411 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-fed8b3bf-5743-4e59-8be7-104f6848a992 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1372 microversion: 2.1 time: 0.245510 Aug 04 23:15:42.978733 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 222/422] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:42 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1372 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:44.001795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-97dc8f16-b6a8-4652-b482-8bbbe6d3e363 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:44.002424 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-97dc8f16-b6a8-4652-b482-8bbbe6d3e363 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:44.016328 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=2 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:15:44.019982 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-97dc8f16-b6a8-4652-b482-8bbbe6d3e363 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:44.020803 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-97dc8f16-b6a8-4652-b482-8bbbe6d3e363 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:44.021579 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-97dc8f16-b6a8-4652-b482-8bbbe6d3e363 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:44.022490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-97dc8f16-b6a8-4652-b482-8bbbe6d3e363 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:44.024225 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-97dc8f16-b6a8-4652-b482-8bbbe6d3e363 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:44.028460 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-97dc8f16-b6a8-4652-b482-8bbbe6d3e363 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:44.280412 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-97dc8f16-b6a8-4652-b482-8bbbe6d3e363 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:44.288014 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-97dc8f16-b6a8-4652-b482-8bbbe6d3e363 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1372 microversion: 2.1 time: 0.291259 Aug 04 23:15:44.289126 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 201/423] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:43 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1372 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:45.309619 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0c377fd1-3286-416d-a1f4-6b110a3409cf tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:45.310985 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0c377fd1-3286-416d-a1f4-6b110a3409cf tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:45.318220 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c377fd1-3286-416d-a1f4-6b110a3409cf tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:45.318731 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c377fd1-3286-416d-a1f4-6b110a3409cf tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:45.319172 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c377fd1-3286-416d-a1f4-6b110a3409cf tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:45.320084 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c377fd1-3286-416d-a1f4-6b110a3409cf tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:45.320537 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c377fd1-3286-416d-a1f4-6b110a3409cf tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:45.320961 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c377fd1-3286-416d-a1f4-6b110a3409cf tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:45.480816 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0c377fd1-3286-416d-a1f4-6b110a3409cf tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:45.492451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0c377fd1-3286-416d-a1f4-6b110a3409cf tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1372 microversion: 2.1 time: 0.187295 Aug 04 23:15:45.493055 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 223/424] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:45 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1372 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:15:46.017185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-d6913663-b011-4592-9ff8-4ee3f620f573 req-e71b7b55-7cef-45d7-a1ea-277f33f4ff90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13d950e0-48a6-44d6-9aae-723354b66c48", "name": "network-vif-plugged", "status": "completed", "tag": "e81f804d-489a-45c5-bf6d-27259b247ae5"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:15:46.027499 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-d6913663-b011-4592-9ff8-4ee3f620f573 req-e71b7b55-7cef-45d7-a1ea-277f33f4ff90 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:46.028302 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-d6913663-b011-4592-9ff8-4ee3f620f573 req-e71b7b55-7cef-45d7-a1ea-277f33f4ff90 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:46.028951 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-d6913663-b011-4592-9ff8-4ee3f620f573 req-e71b7b55-7cef-45d7-a1ea-277f33f4ff90 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:46.049419 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-d6913663-b011-4592-9ff8-4ee3f620f573 req-e71b7b55-7cef-45d7-a1ea-277f33f4ff90 service nova] Creating event network-vif-plugged:e81f804d-489a-45c5-bf6d-27259b247ae5 for instance 13d950e0-48a6-44d6-9aae-723354b66c48 on hv-cinder-85221 Aug 04 23:15:46.054837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-d6913663-b011-4592-9ff8-4ee3f620f573 req-e71b7b55-7cef-45d7-a1ea-277f33f4ff90 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042267 Aug 04 23:15:46.055827 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 202/425] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:15:46.515594 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-339256de-285d-4b11-8113-13f692296d69 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:46.516309 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-339256de-285d-4b11-8113-13f692296d69 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:46.524910 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-339256de-285d-4b11-8113-13f692296d69 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:46.525945 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-339256de-285d-4b11-8113-13f692296d69 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:46.526726 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-339256de-285d-4b11-8113-13f692296d69 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:46.527813 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-339256de-285d-4b11-8113-13f692296d69 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:46.528550 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-339256de-285d-4b11-8113-13f692296d69 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:46.529295 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-339256de-285d-4b11-8113-13f692296d69 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:46.720552 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-339256de-285d-4b11-8113-13f692296d69 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:46.729214 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-339256de-285d-4b11-8113-13f692296d69 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1372 microversion: 2.1 time: 0.219449 Aug 04 23:15:46.729837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 224/426] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:46 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1372 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:47.730853 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a1f63ce5-c3ec-4bd4-b013-a0395ab28de3 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:47.733742 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a1f63ce5-c3ec-4bd4-b013-a0395ab28de3 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:47.743065 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a1f63ce5-c3ec-4bd4-b013-a0395ab28de3 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:47.744582 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a1f63ce5-c3ec-4bd4-b013-a0395ab28de3 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:47.745285 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a1f63ce5-c3ec-4bd4-b013-a0395ab28de3 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:47.746313 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a1f63ce5-c3ec-4bd4-b013-a0395ab28de3 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:47.747627 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a1f63ce5-c3ec-4bd4-b013-a0395ab28de3 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:47.748397 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a1f63ce5-c3ec-4bd4-b013-a0395ab28de3 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:47.754507 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-21a1a7bf-9653-4e08-b498-aeb9fd32004b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:47.755866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-21a1a7bf-9653-4e08-b498-aeb9fd32004b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:47.768375 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21a1a7bf-9653-4e08-b498-aeb9fd32004b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:47.772475 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21a1a7bf-9653-4e08-b498-aeb9fd32004b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:47.773351 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21a1a7bf-9653-4e08-b498-aeb9fd32004b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:47.775953 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21a1a7bf-9653-4e08-b498-aeb9fd32004b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:47.779332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21a1a7bf-9653-4e08-b498-aeb9fd32004b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:47.780078 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21a1a7bf-9653-4e08-b498-aeb9fd32004b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:47.821668 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a1f63ce5-c3ec-4bd4-b013-a0395ab28de3 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/ips" status: 200 len: 150 microversion: 2.1 time: 0.095153 Aug 04 23:15:47.826569 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 203/427] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Aug 4 23:15:47 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/ips => generated 150 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:15:48.000705 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-21a1a7bf-9653-4e08-b498-aeb9fd32004b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:48.012059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-21a1a7bf-9653-4e08-b498-aeb9fd32004b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1372 microversion: 2.1 time: 0.261029 Aug 04 23:15:48.014885 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 225/428] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:47 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1372 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:49.037609 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7c771bbc-0ed0-41a7-a809-c7a4e789a5d0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:49.039797 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7c771bbc-0ed0-41a7-a809-c7a4e789a5d0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:49.049697 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7c771bbc-0ed0-41a7-a809-c7a4e789a5d0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:49.050518 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7c771bbc-0ed0-41a7-a809-c7a4e789a5d0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:49.051456 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7c771bbc-0ed0-41a7-a809-c7a4e789a5d0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:49.052450 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7c771bbc-0ed0-41a7-a809-c7a4e789a5d0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:49.053257 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7c771bbc-0ed0-41a7-a809-c7a4e789a5d0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:49.054277 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7c771bbc-0ed0-41a7-a809-c7a4e789a5d0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:49.261482 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7c771bbc-0ed0-41a7-a809-c7a4e789a5d0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:15:49.271107 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7c771bbc-0ed0-41a7-a809-c7a4e789a5d0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1566 microversion: 2.1 time: 0.237696 Aug 04 23:15:49.286895 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 204/429] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:15:49 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1566 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:15:49.295225 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6aac1902-f44c-4181-91bc-4f31ac941e5e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:15:49.296373 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6aac1902-f44c-4181-91bc-4f31ac941e5e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:49.302115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:15:49.304562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6aac1902-f44c-4181-91bc-4f31ac941e5e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:49.305437 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6aac1902-f44c-4181-91bc-4f31ac941e5e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:49.306052 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6aac1902-f44c-4181-91bc-4f31ac941e5e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:49.307182 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6aac1902-f44c-4181-91bc-4f31ac941e5e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:49.307801 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6aac1902-f44c-4181-91bc-4f31ac941e5e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:49.308408 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6aac1902-f44c-4181-91bc-4f31ac941e5e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:49.440680 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6aac1902-f44c-4181-91bc-4f31ac941e5e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.150541 Aug 04 23:15:49.442114 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 226/430] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Aug 4 23:15:49 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:15:49.619365 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4d99353a-3d1d-4f8e-8ab2-a1de6e672ec0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d8a4f39-7a1a-4b16-8dff-23113c2c52ae"}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:15:49.623179 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4d99353a-3d1d-4f8e-8ab2-a1de6e672ec0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:15:49.634639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4d99353a-3d1d-4f8e-8ab2-a1de6e672ec0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:49.635466 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4d99353a-3d1d-4f8e-8ab2-a1de6e672ec0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:49.638485 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4d99353a-3d1d-4f8e-8ab2-a1de6e672ec0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:49.639512 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4d99353a-3d1d-4f8e-8ab2-a1de6e672ec0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:49.640383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4d99353a-3d1d-4f8e-8ab2-a1de6e672ec0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:49.642176 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4d99353a-3d1d-4f8e-8ab2-a1de6e672ec0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:50.016631 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4d99353a-3d1d-4f8e-8ab2-a1de6e672ec0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "POST /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.404042 Aug 04 23:15:50.017709 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 205/431] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Aug 4 23:15:49 2022] POST /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/os-volume_attachments => generated 194 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 04 23:15:51.122337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-397ef4c6-d116-4f96-8bcf-6270ba545cdc req-4f1c1215-cd5b-4766-aa94-6ce34369e434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13d950e0-48a6-44d6-9aae-723354b66c48", "tag": "e81f804d-489a-45c5-bf6d-27259b247ae5"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:15:51.136704 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-397ef4c6-d116-4f96-8bcf-6270ba545cdc req-4f1c1215-cd5b-4766-aa94-6ce34369e434 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:15:51.137756 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-397ef4c6-d116-4f96-8bcf-6270ba545cdc req-4f1c1215-cd5b-4766-aa94-6ce34369e434 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:15:51.138449 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-397ef4c6-d116-4f96-8bcf-6270ba545cdc req-4f1c1215-cd5b-4766-aa94-6ce34369e434 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:15:51.151930 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-397ef4c6-d116-4f96-8bcf-6270ba545cdc req-4f1c1215-cd5b-4766-aa94-6ce34369e434 service nova] Creating event network-changed:e81f804d-489a-45c5-bf6d-27259b247ae5 for instance 13d950e0-48a6-44d6-9aae-723354b66c48 on hv-cinder-85221 Aug 04 23:15:51.159031 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-397ef4c6-d116-4f96-8bcf-6270ba545cdc req-4f1c1215-cd5b-4766-aa94-6ce34369e434 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040253 Aug 04 23:15:51.160508 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 227/432] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:16:01.148138 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=19 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:16:01.148935 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:16:01.154043 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-740abf78-3e7b-4eee-80e4-d3b5c7f7bfc3 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Action: 'create', calling method: .version_select at 0x7f6d25f29040>, body: {"keypair": {"name": "tempest-keypair-1913887147", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITq6WYLgnnKXCpp9vw9q6IvrswSkyoLOYNtCRsBz7As2cSTA3aDbehz5s37h+Xx725QDS/ePLqMnvNdrRYdAYjIgF4UDyPrQ1xfKG+BOxT5416Elf6fned3KCVZ5YMHNw=="}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:16:01.174846 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-740abf78-3e7b-4eee-80e4-d3b5c7f7bfc3 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Getting quotas for project 0422afbb853d4ef2924edf221499971c. Resources: {'key_pairs'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:16:01.178921 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-740abf78-3e7b-4eee-80e4-d3b5c7f7bfc3 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Getting quotas for user b2ceb35afcc046218bdce1ab4983d9f9 and project 0422afbb853d4ef2924edf221499971c. Resources: {'key_pairs'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:16:01.190907 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR oslo.messaging._drivers.impl_rabbit [None req-740abf78-3e7b-4eee-80e4-d3b5c7f7bfc3 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [b96003f9-b314-4a23-b8ad-ce66a5546d8b] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 23:16:02.198467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [None req-740abf78-3e7b-4eee-80e4-d3b5c7f7bfc3 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [b96003f9-b314-4a23-b8ad-ce66a5546d8b] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56154. Aug 04 23:16:02.215148 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-740abf78-3e7b-4eee-80e4-d3b5c7f7bfc3 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.068563 Aug 04 23:16:02.216900 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 206/433] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Aug 4 23:16:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:16:03.753903 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-74c1b3f0-ce3a-496e-a5c3-cdfd7347cfb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1266596876", "imageRef": "e1e9d70e-b252-44e5-9ecd-bf73cbf00160", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df517527-9f13-4f5f-b34b-4a2b6e5d80c8"}], "security_groups": [{"name": "tempest-securitygroup--1755708667"}], "key_name": "tempest-keypair-1913887147", "user_data": "}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:16:03.762116 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=3 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:16:03.763170 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=35 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:16:03.862203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.network.neutron [None req-74c1b3f0-ce3a-496e-a5c3-cdfd7347cfb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] validate_networks() for [('df517527-9f13-4f5f-b34b-4a2b6e5d80c8', None, None, None, None, None)] {{(pid=129791) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 23:16:04.245682 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-74c1b3f0-ce3a-496e-a5c3-cdfd7347cfb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Flavor limits 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 23:16:04.246102 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-74c1b3f0-ce3a-496e-a5c3-cdfd7347cfb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Image limits 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 23:16:04.247292 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-74c1b3f0-ce3a-496e-a5c3-cdfd7347cfb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Flavor pref 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 23:16:04.247841 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-74c1b3f0-ce3a-496e-a5c3-cdfd7347cfb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Image pref 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 23:16:04.248112 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-74c1b3f0-ce3a-496e-a5c3-cdfd7347cfb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 23:16:04.256900 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-74c1b3f0-ce3a-496e-a5c3-cdfd7347cfb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:04.257373 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-74c1b3f0-ce3a-496e-a5c3-cdfd7347cfb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:04.257803 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-74c1b3f0-ce3a-496e-a5c3-cdfd7347cfb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:04.258662 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-74c1b3f0-ce3a-496e-a5c3-cdfd7347cfb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:04.259113 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-74c1b3f0-ce3a-496e-a5c3-cdfd7347cfb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:04.259531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-74c1b3f0-ce3a-496e-a5c3-cdfd7347cfb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:04.276790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-74c1b3f0-ce3a-496e-a5c3-cdfd7347cfb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Getting quotas for project 0422afbb853d4ef2924edf221499971c. Resources: {'ram', 'instances', 'cores'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:16:04.280896 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-74c1b3f0-ce3a-496e-a5c3-cdfd7347cfb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Getting quotas for user b2ceb35afcc046218bdce1ab4983d9f9 and project 0422afbb853d4ef2924edf221499971c. Resources: {'ram', 'instances', 'cores'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:16:04.291804 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-74c1b3f0-ce3a-496e-a5c3-cdfd7347cfb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Going to run 1 instances... {{(pid=129791) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 23:16:04.294721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-74c1b3f0-ce3a-496e-a5c3-cdfd7347cfb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1e9d70e-b252-44e5-9ecd-bf73cbf00160',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 23:16:04.341530 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-74c1b3f0-ce3a-496e-a5c3-cdfd7347cfb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.592131 Aug 04 23:16:04.342174 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 228/434] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Aug 4 23:16:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 23:16:04.354270 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0207cd5a-1dbc-4b6f-9004-028ceee1920e tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:04.356701 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0207cd5a-1dbc-4b6f-9004-028ceee1920e tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:04.416318 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0207cd5a-1dbc-4b6f-9004-028ceee1920e tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:04.424536 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0207cd5a-1dbc-4b6f-9004-028ceee1920e tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 200 len: 1242 microversion: 2.1 time: 0.075373 Aug 04 23:16:04.425107 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 207/435] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:16:04 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:16:05.447113 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-42dda33a-68d1-429c-8f68-ed9c44c3e6f4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:05.447743 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-42dda33a-68d1-429c-8f68-ed9c44c3e6f4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:05.454983 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-42dda33a-68d1-429c-8f68-ed9c44c3e6f4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:05.455454 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-42dda33a-68d1-429c-8f68-ed9c44c3e6f4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:05.455885 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-42dda33a-68d1-429c-8f68-ed9c44c3e6f4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:05.456574 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-42dda33a-68d1-429c-8f68-ed9c44c3e6f4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:05.457076 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-42dda33a-68d1-429c-8f68-ed9c44c3e6f4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:05.457489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-42dda33a-68d1-429c-8f68-ed9c44c3e6f4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:05.523083 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-42dda33a-68d1-429c-8f68-ed9c44c3e6f4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:05.530895 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-42dda33a-68d1-429c-8f68-ed9c44c3e6f4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 200 len: 1294 microversion: 2.1 time: 0.088907 Aug 04 23:16:05.531456 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 229/436] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:16:05 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:16:06.553034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a73b75b5-87dc-4585-ab6a-673f86baf968 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:06.554069 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a73b75b5-87dc-4585-ab6a-673f86baf968 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:06.566450 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a73b75b5-87dc-4585-ab6a-673f86baf968 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:06.566981 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a73b75b5-87dc-4585-ab6a-673f86baf968 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:06.567718 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a73b75b5-87dc-4585-ab6a-673f86baf968 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:06.568687 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a73b75b5-87dc-4585-ab6a-673f86baf968 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:06.569138 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a73b75b5-87dc-4585-ab6a-673f86baf968 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:06.569786 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a73b75b5-87dc-4585-ab6a-673f86baf968 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:06.823501 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a73b75b5-87dc-4585-ab6a-673f86baf968 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:06.838384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a73b75b5-87dc-4585-ab6a-673f86baf968 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 200 len: 1368 microversion: 2.1 time: 0.289283 Aug 04 23:16:06.839424 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 208/437] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:16:06 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 1368 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:16:07.251071 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-ccc38c02-3166-4cc6-a558-e98e1d690fc0 req-3e27ce14-e725-4cb2-bf56-f48680b20a3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcc205d5-c1d3-4f3d-a37f-af9769b7067f", "tag": "92c1d7ad-c2a7-4f80-a282-fafe6db674a6"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:16:07.261321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-ccc38c02-3166-4cc6-a558-e98e1d690fc0 req-3e27ce14-e725-4cb2-bf56-f48680b20a3c service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:07.261940 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-ccc38c02-3166-4cc6-a558-e98e1d690fc0 req-3e27ce14-e725-4cb2-bf56-f48680b20a3c service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:07.262912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-ccc38c02-3166-4cc6-a558-e98e1d690fc0 req-3e27ce14-e725-4cb2-bf56-f48680b20a3c service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:07.276524 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-ccc38c02-3166-4cc6-a558-e98e1d690fc0 req-3e27ce14-e725-4cb2-bf56-f48680b20a3c service nova] Creating event network-changed:92c1d7ad-c2a7-4f80-a282-fafe6db674a6 for instance fcc205d5-c1d3-4f3d-a37f-af9769b7067f on hv-cinder-85221 Aug 04 23:16:07.282712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-ccc38c02-3166-4cc6-a558-e98e1d690fc0 req-3e27ce14-e725-4cb2-bf56-f48680b20a3c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037035 Aug 04 23:16:07.283662 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 230/438] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:16:07.861556 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-09e8affc-0e6e-426f-b651-d10279ba5764 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:07.862170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-09e8affc-0e6e-426f-b651-d10279ba5764 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:07.868795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09e8affc-0e6e-426f-b651-d10279ba5764 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:07.869279 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09e8affc-0e6e-426f-b651-d10279ba5764 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:07.869714 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09e8affc-0e6e-426f-b651-d10279ba5764 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:07.870424 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09e8affc-0e6e-426f-b651-d10279ba5764 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:07.870873 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09e8affc-0e6e-426f-b651-d10279ba5764 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:07.871289 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09e8affc-0e6e-426f-b651-d10279ba5764 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:08.009558 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-09e8affc-0e6e-426f-b651-d10279ba5764 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:08.017691 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-09e8affc-0e6e-426f-b651-d10279ba5764 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 200 len: 1368 microversion: 2.1 time: 0.160205 Aug 04 23:16:08.018254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 209/439] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:16:07 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:16:09.039521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-26e261e7-d64b-4669-8021-4b5c3ced2ebf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:09.040226 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-26e261e7-d64b-4669-8021-4b5c3ced2ebf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:09.046997 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26e261e7-d64b-4669-8021-4b5c3ced2ebf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:09.047496 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26e261e7-d64b-4669-8021-4b5c3ced2ebf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:09.047928 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26e261e7-d64b-4669-8021-4b5c3ced2ebf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:09.048617 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26e261e7-d64b-4669-8021-4b5c3ced2ebf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:09.049098 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26e261e7-d64b-4669-8021-4b5c3ced2ebf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:09.049521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26e261e7-d64b-4669-8021-4b5c3ced2ebf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:09.184300 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-26e261e7-d64b-4669-8021-4b5c3ced2ebf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:09.191838 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-26e261e7-d64b-4669-8021-4b5c3ced2ebf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 200 len: 1368 microversion: 2.1 time: 0.156496 Aug 04 23:16:09.192395 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 231/440] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:16:09 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:16:10.212895 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c6c12033-9c54-43c7-8e65-f0e09026af08 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:10.213508 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c6c12033-9c54-43c7-8e65-f0e09026af08 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:10.220669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6c12033-9c54-43c7-8e65-f0e09026af08 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:10.221149 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6c12033-9c54-43c7-8e65-f0e09026af08 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:10.221584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6c12033-9c54-43c7-8e65-f0e09026af08 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:10.222277 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6c12033-9c54-43c7-8e65-f0e09026af08 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:10.222758 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6c12033-9c54-43c7-8e65-f0e09026af08 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:10.223185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6c12033-9c54-43c7-8e65-f0e09026af08 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:10.355800 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c6c12033-9c54-43c7-8e65-f0e09026af08 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:10.363423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c6c12033-9c54-43c7-8e65-f0e09026af08 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 200 len: 1368 microversion: 2.1 time: 0.154617 Aug 04 23:16:10.363989 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 210/441] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:16:10 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:16:11.384855 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-469476d8-c504-4776-b712-d4a79ea29e63 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:11.385374 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-469476d8-c504-4776-b712-d4a79ea29e63 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:11.392103 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-469476d8-c504-4776-b712-d4a79ea29e63 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:11.392574 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-469476d8-c504-4776-b712-d4a79ea29e63 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:11.392997 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-469476d8-c504-4776-b712-d4a79ea29e63 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:11.393677 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-469476d8-c504-4776-b712-d4a79ea29e63 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:11.394141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-469476d8-c504-4776-b712-d4a79ea29e63 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:11.394566 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-469476d8-c504-4776-b712-d4a79ea29e63 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:11.539632 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-469476d8-c504-4776-b712-d4a79ea29e63 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:11.547994 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-469476d8-c504-4776-b712-d4a79ea29e63 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 200 len: 1368 microversion: 2.1 time: 0.167140 Aug 04 23:16:11.548602 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 232/442] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:16:11 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:16:12.570967 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-702b104d-b368-4674-90b2-ec698415277b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:12.571628 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-702b104d-b368-4674-90b2-ec698415277b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:12.578792 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-702b104d-b368-4674-90b2-ec698415277b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:12.579308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-702b104d-b368-4674-90b2-ec698415277b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:12.579719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-702b104d-b368-4674-90b2-ec698415277b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:12.580432 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-702b104d-b368-4674-90b2-ec698415277b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:12.580981 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-702b104d-b368-4674-90b2-ec698415277b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:12.581358 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-702b104d-b368-4674-90b2-ec698415277b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:12.737697 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-702b104d-b368-4674-90b2-ec698415277b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:12.745422 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-702b104d-b368-4674-90b2-ec698415277b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 200 len: 1368 microversion: 2.1 time: 0.178230 Aug 04 23:16:12.745993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 211/443] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:16:12 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:16:13.768089 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-124ee502-38f7-49c8-a8ae-f2eb9bdd1df8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:13.768699 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-124ee502-38f7-49c8-a8ae-f2eb9bdd1df8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:13.774612 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-124ee502-38f7-49c8-a8ae-f2eb9bdd1df8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:13.775083 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-124ee502-38f7-49c8-a8ae-f2eb9bdd1df8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:13.775521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-124ee502-38f7-49c8-a8ae-f2eb9bdd1df8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:13.776187 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-124ee502-38f7-49c8-a8ae-f2eb9bdd1df8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:13.776626 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-124ee502-38f7-49c8-a8ae-f2eb9bdd1df8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:13.777038 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-124ee502-38f7-49c8-a8ae-f2eb9bdd1df8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:13.919133 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-124ee502-38f7-49c8-a8ae-f2eb9bdd1df8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:13.927147 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-124ee502-38f7-49c8-a8ae-f2eb9bdd1df8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 200 len: 1368 microversion: 2.1 time: 0.162820 Aug 04 23:16:13.927705 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 233/444] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:16:13 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:16:14.948508 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b4db93a1-3048-4d09-8dad-c8bde7aba5f2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:14.949111 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b4db93a1-3048-4d09-8dad-c8bde7aba5f2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:14.952643 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=6 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:16:14.958889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b4db93a1-3048-4d09-8dad-c8bde7aba5f2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:14.959380 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b4db93a1-3048-4d09-8dad-c8bde7aba5f2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:14.959832 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b4db93a1-3048-4d09-8dad-c8bde7aba5f2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:14.960537 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b4db93a1-3048-4d09-8dad-c8bde7aba5f2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:14.961000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b4db93a1-3048-4d09-8dad-c8bde7aba5f2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:14.961426 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b4db93a1-3048-4d09-8dad-c8bde7aba5f2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:15.099312 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b4db93a1-3048-4d09-8dad-c8bde7aba5f2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:15.107315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b4db93a1-3048-4d09-8dad-c8bde7aba5f2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 200 len: 1368 microversion: 2.1 time: 0.162186 Aug 04 23:16:15.107536 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 212/445] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:16:14 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:16:16.128966 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-172a2d4c-1baa-4e78-85c4-4608d0394008 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:16.130314 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-172a2d4c-1baa-4e78-85c4-4608d0394008 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:16.132394 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=2 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:16:16.133084 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=6 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:16:16.139338 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-172a2d4c-1baa-4e78-85c4-4608d0394008 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:16.139845 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-172a2d4c-1baa-4e78-85c4-4608d0394008 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:16.140274 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-172a2d4c-1baa-4e78-85c4-4608d0394008 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:16.140971 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-172a2d4c-1baa-4e78-85c4-4608d0394008 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:16.141418 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-172a2d4c-1baa-4e78-85c4-4608d0394008 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:16.141834 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-172a2d4c-1baa-4e78-85c4-4608d0394008 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:16.275453 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-172a2d4c-1baa-4e78-85c4-4608d0394008 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:16.283252 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-172a2d4c-1baa-4e78-85c4-4608d0394008 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 200 len: 1368 microversion: 2.1 time: 0.159040 Aug 04 23:16:16.283823 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 234/446] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:16:16 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:16:17.304340 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f6c6aeac-d05e-4e6e-8ec7-6726c132dc65 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:17.305018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f6c6aeac-d05e-4e6e-8ec7-6726c132dc65 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:17.311334 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f6c6aeac-d05e-4e6e-8ec7-6726c132dc65 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:17.311818 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f6c6aeac-d05e-4e6e-8ec7-6726c132dc65 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:17.312253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f6c6aeac-d05e-4e6e-8ec7-6726c132dc65 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:17.312949 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f6c6aeac-d05e-4e6e-8ec7-6726c132dc65 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:17.313403 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f6c6aeac-d05e-4e6e-8ec7-6726c132dc65 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:17.313827 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f6c6aeac-d05e-4e6e-8ec7-6726c132dc65 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:17.452891 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f6c6aeac-d05e-4e6e-8ec7-6726c132dc65 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:17.460861 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f6c6aeac-d05e-4e6e-8ec7-6726c132dc65 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 200 len: 1368 microversion: 2.1 time: 0.160290 Aug 04 23:16:17.461749 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 213/447] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:16:17 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:16:18.484229 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-cc8e726d-c1e4-4742-981c-3a5d769a7047 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:18.484855 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-cc8e726d-c1e4-4742-981c-3a5d769a7047 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:18.491404 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc8e726d-c1e4-4742-981c-3a5d769a7047 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:18.491883 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc8e726d-c1e4-4742-981c-3a5d769a7047 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:18.492312 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc8e726d-c1e4-4742-981c-3a5d769a7047 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:18.493004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc8e726d-c1e4-4742-981c-3a5d769a7047 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:18.493452 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc8e726d-c1e4-4742-981c-3a5d769a7047 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:18.493868 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc8e726d-c1e4-4742-981c-3a5d769a7047 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:18.637005 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cc8e726d-c1e4-4742-981c-3a5d769a7047 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:18.645598 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-cc8e726d-c1e4-4742-981c-3a5d769a7047 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 200 len: 1368 microversion: 2.1 time: 0.166137 Aug 04 23:16:18.646240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 235/448] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:16:18 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:16:19.528749 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-2f5bdf17-06f3-40f6-917f-8b63c2e2c3d9 req-51c3dc0b-c8d2-4a79-aef8-da35adc60672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc205d5-c1d3-4f3d-a37f-af9769b7067f", "name": "network-vif-plugged", "status": "completed", "tag": "92c1d7ad-c2a7-4f80-a282-fafe6db674a6"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:16:19.539309 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-2f5bdf17-06f3-40f6-917f-8b63c2e2c3d9 req-51c3dc0b-c8d2-4a79-aef8-da35adc60672 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:19.539787 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-2f5bdf17-06f3-40f6-917f-8b63c2e2c3d9 req-51c3dc0b-c8d2-4a79-aef8-da35adc60672 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:19.540420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-2f5bdf17-06f3-40f6-917f-8b63c2e2c3d9 req-51c3dc0b-c8d2-4a79-aef8-da35adc60672 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:19.553801 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-2f5bdf17-06f3-40f6-917f-8b63c2e2c3d9 req-51c3dc0b-c8d2-4a79-aef8-da35adc60672 service nova] Creating event network-vif-plugged:92c1d7ad-c2a7-4f80-a282-fafe6db674a6 for instance fcc205d5-c1d3-4f3d-a37f-af9769b7067f on hv-cinder-85221 Aug 04 23:16:19.563598 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-2f5bdf17-06f3-40f6-917f-8b63c2e2c3d9 req-51c3dc0b-c8d2-4a79-aef8-da35adc60672 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039263 Aug 04 23:16:19.564387 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 214/449] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:16:19.667127 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e01062fb-8ca1-4ba5-9bfb-8f78b8c3f379 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:19.667887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e01062fb-8ca1-4ba5-9bfb-8f78b8c3f379 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:19.675514 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e01062fb-8ca1-4ba5-9bfb-8f78b8c3f379 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:19.675989 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e01062fb-8ca1-4ba5-9bfb-8f78b8c3f379 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:19.676611 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e01062fb-8ca1-4ba5-9bfb-8f78b8c3f379 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:19.677557 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e01062fb-8ca1-4ba5-9bfb-8f78b8c3f379 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:19.677791 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e01062fb-8ca1-4ba5-9bfb-8f78b8c3f379 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:19.678210 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e01062fb-8ca1-4ba5-9bfb-8f78b8c3f379 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:19.826720 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e01062fb-8ca1-4ba5-9bfb-8f78b8c3f379 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:19.842157 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e01062fb-8ca1-4ba5-9bfb-8f78b8c3f379 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 200 len: 1368 microversion: 2.1 time: 0.178745 Aug 04 23:16:19.842886 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 236/450] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:16:19 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:16:20.864387 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ca21cab9-2faf-438b-b5bf-07a41c571f5c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:20.866060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ca21cab9-2faf-438b-b5bf-07a41c571f5c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:20.873796 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca21cab9-2faf-438b-b5bf-07a41c571f5c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:20.875275 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca21cab9-2faf-438b-b5bf-07a41c571f5c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:20.876055 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca21cab9-2faf-438b-b5bf-07a41c571f5c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:20.876971 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca21cab9-2faf-438b-b5bf-07a41c571f5c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:20.877758 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca21cab9-2faf-438b-b5bf-07a41c571f5c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:20.878195 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca21cab9-2faf-438b-b5bf-07a41c571f5c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:21.375074 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ca21cab9-2faf-438b-b5bf-07a41c571f5c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:21.383230 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ca21cab9-2faf-438b-b5bf-07a41c571f5c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 200 len: 1368 microversion: 2.1 time: 0.523558 Aug 04 23:16:21.384175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 215/451] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:16:20 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 1368 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:16:22.405154 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-449daffc-1997-400b-b97a-debd0f010916 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:22.407116 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-449daffc-1997-400b-b97a-debd0f010916 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:22.413260 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-449daffc-1997-400b-b97a-debd0f010916 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:22.413744 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-449daffc-1997-400b-b97a-debd0f010916 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:22.414803 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-449daffc-1997-400b-b97a-debd0f010916 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:22.415501 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-449daffc-1997-400b-b97a-debd0f010916 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:22.415949 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-449daffc-1997-400b-b97a-debd0f010916 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:22.416366 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-449daffc-1997-400b-b97a-debd0f010916 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:22.651664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-449daffc-1997-400b-b97a-debd0f010916 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:22.660420 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-449daffc-1997-400b-b97a-debd0f010916 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 200 len: 1559 microversion: 2.1 time: 0.259766 Aug 04 23:16:22.677241 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 237/452] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:16:22 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 1559 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:16:22.682844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2dbc0b70-a96a-4a6f-8cb7-ffc070d5b487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:22.683428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2dbc0b70-a96a-4a6f-8cb7-ffc070d5b487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:22.690675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2dbc0b70-a96a-4a6f-8cb7-ffc070d5b487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:22.691505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2dbc0b70-a96a-4a6f-8cb7-ffc070d5b487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:22.692159 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2dbc0b70-a96a-4a6f-8cb7-ffc070d5b487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:22.692954 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2dbc0b70-a96a-4a6f-8cb7-ffc070d5b487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:22.693474 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2dbc0b70-a96a-4a6f-8cb7-ffc070d5b487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:22.694177 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2dbc0b70-a96a-4a6f-8cb7-ffc070d5b487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:22.794684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2dbc0b70-a96a-4a6f-8cb7-ffc070d5b487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115979 Aug 04 23:16:22.799128 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 216/453] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Aug 4 23:16:22 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:16:24.045122 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-e283ea77-262d-4f6c-bea6-adeb1c7a04eb req-cba8214c-8329-431a-8d37-2f1c1f083066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcc205d5-c1d3-4f3d-a37f-af9769b7067f", "tag": "92c1d7ad-c2a7-4f80-a282-fafe6db674a6"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:16:24.056002 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-e283ea77-262d-4f6c-bea6-adeb1c7a04eb req-cba8214c-8329-431a-8d37-2f1c1f083066 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:24.056493 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-e283ea77-262d-4f6c-bea6-adeb1c7a04eb req-cba8214c-8329-431a-8d37-2f1c1f083066 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:24.057041 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-e283ea77-262d-4f6c-bea6-adeb1c7a04eb req-cba8214c-8329-431a-8d37-2f1c1f083066 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:24.073142 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-e283ea77-262d-4f6c-bea6-adeb1c7a04eb req-cba8214c-8329-431a-8d37-2f1c1f083066 service nova] Creating event network-changed:92c1d7ad-c2a7-4f80-a282-fafe6db674a6 for instance fcc205d5-c1d3-4f3d-a37f-af9769b7067f on hv-cinder-85221 Aug 04 23:16:24.079539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-e283ea77-262d-4f6c-bea6-adeb1c7a04eb req-cba8214c-8329-431a-8d37-2f1c1f083066 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038826 Aug 04 23:16:24.084473 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 238/454] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:16:29.562177 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e87f47ff-087c-4df8-87b1-dfc0b26c5537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Action: 'create', calling method: .version_select at 0x7f6d25f51310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1320467911", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM91JF5EtHk+qOdkHtOEEOZf9xu6uscEl76bAdtoAQF4dkTyJsTV2F9l3micdgOKMxcNiSF6ASV8s4uE8WHZPMF4bqXxT1MdOyI9+bVl6FQSF7GngBYGobKf0SdkCv3MQ=="}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:16:29.579619 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-e87f47ff-087c-4df8-87b1-dfc0b26c5537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Getting quotas for project 7954e7a03fce4b64b498e68370483def. Resources: {'key_pairs'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:16:29.584143 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-e87f47ff-087c-4df8-87b1-dfc0b26c5537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Getting quotas for user 95c10802aacf46be91e86b33dff95abc and project 7954e7a03fce4b64b498e68370483def. Resources: {'key_pairs'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:16:29.611101 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e87f47ff-087c-4df8-87b1-dfc0b26c5537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.278022 Aug 04 23:16:29.612213 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 217/455] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Aug 4 23:16:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:16:37.478425 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:16:37.479172 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=54 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:16:37.484402 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6720eaa1-58b2-4ade-a111-24289d718a5c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:37.484973 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6720eaa1-58b2-4ade-a111-24289d718a5c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:37.492498 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6720eaa1-58b2-4ade-a111-24289d718a5c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:37.493035 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6720eaa1-58b2-4ade-a111-24289d718a5c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:37.493474 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6720eaa1-58b2-4ade-a111-24289d718a5c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:37.494188 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6720eaa1-58b2-4ade-a111-24289d718a5c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:37.494673 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6720eaa1-58b2-4ade-a111-24289d718a5c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:37.495097 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6720eaa1-58b2-4ade-a111-24289d718a5c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:37.518669 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6720eaa1-58b2-4ade-a111-24289d718a5c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2/ips" status: 200 len: 151 microversion: 2.20 time: 0.041285 Aug 04 23:16:37.519424 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 239/456] 10.222.0.33 () {60 vars in 1289 bytes} [Thu Aug 4 23:16:37 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 23:16:39.590658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=48 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:16:39.595426 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-70e9af70-efc9-48dd-b36d-f03e7c6a56da tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:16:39.595993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-70e9af70-efc9-48dd-b36d-f03e7c6a56da tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:39.597780 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=4 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:16:39.598466 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=2 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:16:39.605969 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-70e9af70-efc9-48dd-b36d-f03e7c6a56da tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:39.606523 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-70e9af70-efc9-48dd-b36d-f03e7c6a56da tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:39.606963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-70e9af70-efc9-48dd-b36d-f03e7c6a56da tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:39.607667 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-70e9af70-efc9-48dd-b36d-f03e7c6a56da tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:39.608124 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-70e9af70-efc9-48dd-b36d-f03e7c6a56da tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:39.608553 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-70e9af70-efc9-48dd-b36d-f03e7c6a56da tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:39.633137 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.objects.instance [None req-70e9af70-efc9-48dd-b36d-f03e7c6a56da tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lazy-loading 'flavor' on Instance uuid 2013d923-81bb-4002-976d-64d3722b15d2 {{(pid=129790) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:16:39.827908 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-70e9af70-efc9-48dd-b36d-f03e7c6a56da tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "POST /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2/action" status: 202 len: 0 microversion: 2.20 time: 0.238336 Aug 04 23:16:39.828632 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 218/457] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Aug 4 23:16:39 2022] POST /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 23:16:39.838684 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8dafec3b-99ca-4066-9378-ef5a48a1e49d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:39.839443 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8dafec3b-99ca-4066-9378-ef5a48a1e49d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:39.847236 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8dafec3b-99ca-4066-9378-ef5a48a1e49d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:39.848075 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8dafec3b-99ca-4066-9378-ef5a48a1e49d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:39.848961 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8dafec3b-99ca-4066-9378-ef5a48a1e49d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:39.850783 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8dafec3b-99ca-4066-9378-ef5a48a1e49d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:39.851386 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8dafec3b-99ca-4066-9378-ef5a48a1e49d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:39.851888 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8dafec3b-99ca-4066-9378-ef5a48a1e49d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:39.991279 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8dafec3b-99ca-4066-9378-ef5a48a1e49d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:39.999736 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8dafec3b-99ca-4066-9378-ef5a48a1e49d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:40.001231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8dafec3b-99ca-4066-9378-ef5a48a1e49d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:40.002400 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8dafec3b-99ca-4066-9378-ef5a48a1e49d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1723 microversion: 2.20 time: 0.169142 Aug 04 23:16:40.002953 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 240/458] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:16:39 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:16:41.027004 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-341a87e6-6541-46d7-9051-3ec7687f7c8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:41.027745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-341a87e6-6541-46d7-9051-3ec7687f7c8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:41.036243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-341a87e6-6541-46d7-9051-3ec7687f7c8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:41.036715 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-341a87e6-6541-46d7-9051-3ec7687f7c8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:41.037143 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-341a87e6-6541-46d7-9051-3ec7687f7c8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:41.037824 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-341a87e6-6541-46d7-9051-3ec7687f7c8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:41.038266 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-341a87e6-6541-46d7-9051-3ec7687f7c8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:41.038715 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-341a87e6-6541-46d7-9051-3ec7687f7c8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:41.186480 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-341a87e6-6541-46d7-9051-3ec7687f7c8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:41.195059 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-341a87e6-6541-46d7-9051-3ec7687f7c8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:41.196558 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-341a87e6-6541-46d7-9051-3ec7687f7c8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:41.197707 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-341a87e6-6541-46d7-9051-3ec7687f7c8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1723 microversion: 2.20 time: 0.175422 Aug 04 23:16:41.198253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 219/459] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:16:41 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:16:42.220900 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c9c89d6f-1d83-452a-8591-1c53bde45c44 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:42.221436 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c9c89d6f-1d83-452a-8591-1c53bde45c44 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:42.227492 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c9c89d6f-1d83-452a-8591-1c53bde45c44 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:42.227982 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c9c89d6f-1d83-452a-8591-1c53bde45c44 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:42.228415 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c9c89d6f-1d83-452a-8591-1c53bde45c44 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:42.229127 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c9c89d6f-1d83-452a-8591-1c53bde45c44 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:42.229577 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c9c89d6f-1d83-452a-8591-1c53bde45c44 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:42.230007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c9c89d6f-1d83-452a-8591-1c53bde45c44 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:42.373985 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c9c89d6f-1d83-452a-8591-1c53bde45c44 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:42.382271 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c9c89d6f-1d83-452a-8591-1c53bde45c44 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:42.383790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c9c89d6f-1d83-452a-8591-1c53bde45c44 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:42.384944 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c9c89d6f-1d83-452a-8591-1c53bde45c44 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1723 microversion: 2.20 time: 0.168100 Aug 04 23:16:42.385512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 241/460] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:16:42 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:16:43.409011 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f9d59d8b-690d-44f0-a214-d8d4c988b0f5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:43.409604 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f9d59d8b-690d-44f0-a214-d8d4c988b0f5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:43.416080 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f9d59d8b-690d-44f0-a214-d8d4c988b0f5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:43.416551 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f9d59d8b-690d-44f0-a214-d8d4c988b0f5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:43.416978 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f9d59d8b-690d-44f0-a214-d8d4c988b0f5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:43.417659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f9d59d8b-690d-44f0-a214-d8d4c988b0f5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:43.418108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f9d59d8b-690d-44f0-a214-d8d4c988b0f5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:43.418553 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f9d59d8b-690d-44f0-a214-d8d4c988b0f5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:43.562213 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f9d59d8b-690d-44f0-a214-d8d4c988b0f5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:43.570379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f9d59d8b-690d-44f0-a214-d8d4c988b0f5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:43.571901 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f9d59d8b-690d-44f0-a214-d8d4c988b0f5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:43.573088 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f9d59d8b-690d-44f0-a214-d8d4c988b0f5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1723 microversion: 2.20 time: 0.168000 Aug 04 23:16:43.573637 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 220/461] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:16:43 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:16:44.598056 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-27d7d051-7022-4a84-94c3-5a1bc15a8945 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:44.598676 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-27d7d051-7022-4a84-94c3-5a1bc15a8945 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:44.604531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-27d7d051-7022-4a84-94c3-5a1bc15a8945 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:44.605008 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-27d7d051-7022-4a84-94c3-5a1bc15a8945 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:44.605430 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-27d7d051-7022-4a84-94c3-5a1bc15a8945 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:44.606104 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-27d7d051-7022-4a84-94c3-5a1bc15a8945 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:44.606710 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-27d7d051-7022-4a84-94c3-5a1bc15a8945 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:44.607355 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-27d7d051-7022-4a84-94c3-5a1bc15a8945 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:44.743570 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-27d7d051-7022-4a84-94c3-5a1bc15a8945 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:44.752456 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-27d7d051-7022-4a84-94c3-5a1bc15a8945 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:44.753990 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-27d7d051-7022-4a84-94c3-5a1bc15a8945 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:44.755182 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-27d7d051-7022-4a84-94c3-5a1bc15a8945 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1723 microversion: 2.20 time: 0.161002 Aug 04 23:16:44.755729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 242/462] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:16:44 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:16:45.779421 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7a735914-12ba-4c47-bcbc-e8fc45f19bbd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:45.780038 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7a735914-12ba-4c47-bcbc-e8fc45f19bbd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:45.786453 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a735914-12ba-4c47-bcbc-e8fc45f19bbd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:45.786927 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a735914-12ba-4c47-bcbc-e8fc45f19bbd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:45.787357 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a735914-12ba-4c47-bcbc-e8fc45f19bbd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:45.788042 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a735914-12ba-4c47-bcbc-e8fc45f19bbd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:45.788489 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a735914-12ba-4c47-bcbc-e8fc45f19bbd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:45.788916 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a735914-12ba-4c47-bcbc-e8fc45f19bbd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:45.927747 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7a735914-12ba-4c47-bcbc-e8fc45f19bbd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:45.936231 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7a735914-12ba-4c47-bcbc-e8fc45f19bbd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:45.938276 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7a735914-12ba-4c47-bcbc-e8fc45f19bbd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:45.939878 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7a735914-12ba-4c47-bcbc-e8fc45f19bbd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1723 microversion: 2.20 time: 0.164852 Aug 04 23:16:45.940671 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 221/463] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:16:45 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:16:46.962726 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b05e761d-774d-4669-bca2-946614e2d4a1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:46.963587 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b05e761d-774d-4669-bca2-946614e2d4a1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:46.970169 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b05e761d-774d-4669-bca2-946614e2d4a1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:46.970686 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b05e761d-774d-4669-bca2-946614e2d4a1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:46.971147 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b05e761d-774d-4669-bca2-946614e2d4a1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:46.971838 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b05e761d-774d-4669-bca2-946614e2d4a1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:46.972288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b05e761d-774d-4669-bca2-946614e2d4a1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:46.972707 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b05e761d-774d-4669-bca2-946614e2d4a1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:47.107585 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b05e761d-774d-4669-bca2-946614e2d4a1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:47.115758 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b05e761d-774d-4669-bca2-946614e2d4a1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:47.117262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b05e761d-774d-4669-bca2-946614e2d4a1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:47.118424 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b05e761d-774d-4669-bca2-946614e2d4a1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1723 microversion: 2.20 time: 0.159544 Aug 04 23:16:47.118967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 243/464] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:16:46 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:16:48.142019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-38bf16f1-ace6-4841-abf4-cc891b8eaf17 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:48.142660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-38bf16f1-ace6-4841-abf4-cc891b8eaf17 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:48.148997 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-38bf16f1-ace6-4841-abf4-cc891b8eaf17 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:48.149475 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-38bf16f1-ace6-4841-abf4-cc891b8eaf17 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:48.149907 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-38bf16f1-ace6-4841-abf4-cc891b8eaf17 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:48.150699 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-38bf16f1-ace6-4841-abf4-cc891b8eaf17 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:48.151206 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-38bf16f1-ace6-4841-abf4-cc891b8eaf17 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:48.151631 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-38bf16f1-ace6-4841-abf4-cc891b8eaf17 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:48.284267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-38bf16f1-ace6-4841-abf4-cc891b8eaf17 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:48.292100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-38bf16f1-ace6-4841-abf4-cc891b8eaf17 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:48.293595 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-38bf16f1-ace6-4841-abf4-cc891b8eaf17 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:48.294906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-38bf16f1-ace6-4841-abf4-cc891b8eaf17 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1723 microversion: 2.20 time: 0.157249 Aug 04 23:16:48.295610 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 222/465] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:16:48 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:16:49.317430 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-20913b8d-13bf-44e4-becb-7c4af4f17b7d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:49.318030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-20913b8d-13bf-44e4-becb-7c4af4f17b7d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:49.324064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20913b8d-13bf-44e4-becb-7c4af4f17b7d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:49.324536 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20913b8d-13bf-44e4-becb-7c4af4f17b7d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:49.324962 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20913b8d-13bf-44e4-becb-7c4af4f17b7d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:49.325640 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20913b8d-13bf-44e4-becb-7c4af4f17b7d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:49.326678 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20913b8d-13bf-44e4-becb-7c4af4f17b7d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:49.327193 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20913b8d-13bf-44e4-becb-7c4af4f17b7d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:49.461300 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-20913b8d-13bf-44e4-becb-7c4af4f17b7d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:49.470308 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-20913b8d-13bf-44e4-becb-7c4af4f17b7d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:49.471953 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-20913b8d-13bf-44e4-becb-7c4af4f17b7d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:49.473089 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-20913b8d-13bf-44e4-becb-7c4af4f17b7d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1723 microversion: 2.20 time: 0.159554 Aug 04 23:16:49.473645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 244/466] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:16:49 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:16:50.495307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-26575a86-51c8-4e0b-bd8c-6385a23920af tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:50.495844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-26575a86-51c8-4e0b-bd8c-6385a23920af tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:50.503245 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-26575a86-51c8-4e0b-bd8c-6385a23920af tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:50.503795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-26575a86-51c8-4e0b-bd8c-6385a23920af tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:50.504226 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-26575a86-51c8-4e0b-bd8c-6385a23920af tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:50.504919 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-26575a86-51c8-4e0b-bd8c-6385a23920af tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:50.505369 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-26575a86-51c8-4e0b-bd8c-6385a23920af tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:50.505787 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-26575a86-51c8-4e0b-bd8c-6385a23920af tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:50.634620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-26575a86-51c8-4e0b-bd8c-6385a23920af tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:50.643088 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-26575a86-51c8-4e0b-bd8c-6385a23920af tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:50.644577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-26575a86-51c8-4e0b-bd8c-6385a23920af tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:50.645713 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-26575a86-51c8-4e0b-bd8c-6385a23920af tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1723 microversion: 2.20 time: 0.154583 Aug 04 23:16:50.646259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 223/467] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:16:50 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:16:51.668523 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-327ffa04-1aa4-4700-8e19-f505179f1b7a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:51.669123 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-327ffa04-1aa4-4700-8e19-f505179f1b7a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:51.675393 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-327ffa04-1aa4-4700-8e19-f505179f1b7a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:51.675866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-327ffa04-1aa4-4700-8e19-f505179f1b7a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:51.676290 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-327ffa04-1aa4-4700-8e19-f505179f1b7a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:51.676977 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-327ffa04-1aa4-4700-8e19-f505179f1b7a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:51.677419 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-327ffa04-1aa4-4700-8e19-f505179f1b7a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:51.677840 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-327ffa04-1aa4-4700-8e19-f505179f1b7a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:51.816630 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-327ffa04-1aa4-4700-8e19-f505179f1b7a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:51.824638 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-327ffa04-1aa4-4700-8e19-f505179f1b7a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:51.826134 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-327ffa04-1aa4-4700-8e19-f505179f1b7a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:51.827890 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-327ffa04-1aa4-4700-8e19-f505179f1b7a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1723 microversion: 2.20 time: 0.163292 Aug 04 23:16:51.828454 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 245/468] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:16:51 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:16:52.850334 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7ff4940a-d7f3-40d1-8e11-8649bb0c32eb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:52.850964 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7ff4940a-d7f3-40d1-8e11-8649bb0c32eb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:52.857413 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ff4940a-d7f3-40d1-8e11-8649bb0c32eb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:52.858477 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ff4940a-d7f3-40d1-8e11-8649bb0c32eb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:52.858936 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ff4940a-d7f3-40d1-8e11-8649bb0c32eb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:52.859627 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ff4940a-d7f3-40d1-8e11-8649bb0c32eb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:52.860082 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ff4940a-d7f3-40d1-8e11-8649bb0c32eb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:52.860503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ff4940a-d7f3-40d1-8e11-8649bb0c32eb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:52.995114 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7ff4940a-d7f3-40d1-8e11-8649bb0c32eb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:53.003148 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7ff4940a-d7f3-40d1-8e11-8649bb0c32eb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:53.004669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7ff4940a-d7f3-40d1-8e11-8649bb0c32eb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:53.005817 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7ff4940a-d7f3-40d1-8e11-8649bb0c32eb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1723 microversion: 2.20 time: 0.159434 Aug 04 23:16:53.006422 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 224/469] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:16:52 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:16:54.028518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2a3af320-8fa0-46b6-8485-e3253317dcca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:54.029123 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2a3af320-8fa0-46b6-8485-e3253317dcca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:54.035561 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a3af320-8fa0-46b6-8485-e3253317dcca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:54.036043 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a3af320-8fa0-46b6-8485-e3253317dcca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:54.037109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a3af320-8fa0-46b6-8485-e3253317dcca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:54.037812 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a3af320-8fa0-46b6-8485-e3253317dcca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:54.038265 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a3af320-8fa0-46b6-8485-e3253317dcca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:54.038724 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a3af320-8fa0-46b6-8485-e3253317dcca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:54.175643 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2a3af320-8fa0-46b6-8485-e3253317dcca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:54.183741 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2a3af320-8fa0-46b6-8485-e3253317dcca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:54.185251 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2a3af320-8fa0-46b6-8485-e3253317dcca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:54.187027 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2a3af320-8fa0-46b6-8485-e3253317dcca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1723 microversion: 2.20 time: 0.162322 Aug 04 23:16:54.187617 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 246/470] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:16:54 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:16:55.212032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5bd5e136-d2ae-43fa-b7bd-9767f058147e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:55.212650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5bd5e136-d2ae-43fa-b7bd-9767f058147e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:55.219569 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5bd5e136-d2ae-43fa-b7bd-9767f058147e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:55.220059 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5bd5e136-d2ae-43fa-b7bd-9767f058147e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:55.220492 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5bd5e136-d2ae-43fa-b7bd-9767f058147e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:55.221219 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5bd5e136-d2ae-43fa-b7bd-9767f058147e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:55.221661 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5bd5e136-d2ae-43fa-b7bd-9767f058147e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:55.222084 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5bd5e136-d2ae-43fa-b7bd-9767f058147e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:55.746867 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5bd5e136-d2ae-43fa-b7bd-9767f058147e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:55.756270 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5bd5e136-d2ae-43fa-b7bd-9767f058147e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:55.758225 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5bd5e136-d2ae-43fa-b7bd-9767f058147e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:55.759631 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5bd5e136-d2ae-43fa-b7bd-9767f058147e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1723 microversion: 2.20 time: 0.551775 Aug 04 23:16:55.760288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 225/471] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:16:55 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1723 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:16:56.785003 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3ab47f20-f7f6-4fae-8562-d661b4a9050c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:56.785586 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3ab47f20-f7f6-4fae-8562-d661b4a9050c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:56.792849 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ab47f20-f7f6-4fae-8562-d661b4a9050c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:56.793339 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ab47f20-f7f6-4fae-8562-d661b4a9050c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:56.793902 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ab47f20-f7f6-4fae-8562-d661b4a9050c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:56.794647 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ab47f20-f7f6-4fae-8562-d661b4a9050c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:56.795263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ab47f20-f7f6-4fae-8562-d661b4a9050c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:56.795810 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ab47f20-f7f6-4fae-8562-d661b4a9050c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:56.995137 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3ab47f20-f7f6-4fae-8562-d661b4a9050c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:57.005789 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3ab47f20-f7f6-4fae-8562-d661b4a9050c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:57.007346 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3ab47f20-f7f6-4fae-8562-d661b4a9050c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:57.008517 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3ab47f20-f7f6-4fae-8562-d661b4a9050c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1723 microversion: 2.20 time: 0.229111 Aug 04 23:16:57.009280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 247/472] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:16:56 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:16:58.037859 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-764c8352-75bc-42cc-a4d3-47f770bf68f9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:58.038495 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-764c8352-75bc-42cc-a4d3-47f770bf68f9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:58.052442 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-764c8352-75bc-42cc-a4d3-47f770bf68f9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:58.052932 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-764c8352-75bc-42cc-a4d3-47f770bf68f9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:58.053369 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-764c8352-75bc-42cc-a4d3-47f770bf68f9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:58.054085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-764c8352-75bc-42cc-a4d3-47f770bf68f9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:58.054562 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-764c8352-75bc-42cc-a4d3-47f770bf68f9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:58.055156 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-764c8352-75bc-42cc-a4d3-47f770bf68f9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:58.242525 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-764c8352-75bc-42cc-a4d3-47f770bf68f9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:58.253202 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-764c8352-75bc-42cc-a4d3-47f770bf68f9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:58.255164 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-764c8352-75bc-42cc-a4d3-47f770bf68f9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:58.256521 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-764c8352-75bc-42cc-a4d3-47f770bf68f9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1723 microversion: 2.20 time: 0.222533 Aug 04 23:16:58.257058 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 226/473] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:16:58 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:16:59.281768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ce60cb95-c43f-49d7-850e-5176eac928ec tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:16:59.283120 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ce60cb95-c43f-49d7-850e-5176eac928ec tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:16:59.289664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce60cb95-c43f-49d7-850e-5176eac928ec tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:59.290147 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce60cb95-c43f-49d7-850e-5176eac928ec tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:59.290621 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce60cb95-c43f-49d7-850e-5176eac928ec tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:59.291686 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce60cb95-c43f-49d7-850e-5176eac928ec tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:16:59.292140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce60cb95-c43f-49d7-850e-5176eac928ec tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:16:59.292556 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce60cb95-c43f-49d7-850e-5176eac928ec tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:16:59.474344 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ce60cb95-c43f-49d7-850e-5176eac928ec tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:59.484805 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ce60cb95-c43f-49d7-850e-5176eac928ec tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:59.487132 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ce60cb95-c43f-49d7-850e-5176eac928ec tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:16:59.488629 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ce60cb95-c43f-49d7-850e-5176eac928ec tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1723 microversion: 2.20 time: 0.211426 Aug 04 23:16:59.503929 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 248/474] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:16:59 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:17:00.127426 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-358cd305-68ef-428d-8a44-1e27523795a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-389040177", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1320467911", "security_groups": [{"name": "tempest-secgroup-smoke-1894323483"}], "block_device_mapping_v2": [{"uuid": "4b572e86-4915-4b2a-a9e1-6d6a10532792", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eab51316-848b-42a4-a608-f9226c6150e3"}]}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:17:00.338755 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.network.neutron [None req-358cd305-68ef-428d-8a44-1e27523795a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] validate_networks() for [('eab51316-848b-42a4-a608-f9226c6150e3', None, None, None, None, None)] {{(pid=129790) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 23:17:00.512636 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2f69d695-661b-4857-bbfe-d1b20194d1f1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:00.513249 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2f69d695-661b-4857-bbfe-d1b20194d1f1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:00.520274 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f69d695-661b-4857-bbfe-d1b20194d1f1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:00.520763 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f69d695-661b-4857-bbfe-d1b20194d1f1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:00.521196 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f69d695-661b-4857-bbfe-d1b20194d1f1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:00.521896 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f69d695-661b-4857-bbfe-d1b20194d1f1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:00.522353 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f69d695-661b-4857-bbfe-d1b20194d1f1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:00.522794 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f69d695-661b-4857-bbfe-d1b20194d1f1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:00.816575 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2f69d695-661b-4857-bbfe-d1b20194d1f1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:00.828143 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2f69d695-661b-4857-bbfe-d1b20194d1f1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:00.830134 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2f69d695-661b-4857-bbfe-d1b20194d1f1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:00.831309 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2f69d695-661b-4857-bbfe-d1b20194d1f1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1723 microversion: 2.20 time: 0.322763 Aug 04 23:17:00.843291 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 249/475] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:00 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1723 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:17:01.011280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-358cd305-68ef-428d-8a44-1e27523795a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Flavor limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 23:17:01.012389 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-358cd305-68ef-428d-8a44-1e27523795a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Image limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 23:17:01.012889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-358cd305-68ef-428d-8a44-1e27523795a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Flavor pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 23:17:01.013499 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-358cd305-68ef-428d-8a44-1e27523795a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Image pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 23:17:01.015115 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-358cd305-68ef-428d-8a44-1e27523795a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 23:17:01.025840 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-358cd305-68ef-428d-8a44-1e27523795a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:01.026910 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-358cd305-68ef-428d-8a44-1e27523795a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:01.027640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-358cd305-68ef-428d-8a44-1e27523795a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:01.030229 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-358cd305-68ef-428d-8a44-1e27523795a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:01.031128 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-358cd305-68ef-428d-8a44-1e27523795a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:01.031756 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-358cd305-68ef-428d-8a44-1e27523795a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:01.055512 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-358cd305-68ef-428d-8a44-1e27523795a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Getting quotas for project 7954e7a03fce4b64b498e68370483def. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:17:01.068669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-358cd305-68ef-428d-8a44-1e27523795a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Getting quotas for user 95c10802aacf46be91e86b33dff95abc and project 7954e7a03fce4b64b498e68370483def. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:17:01.147843 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-358cd305-68ef-428d-8a44-1e27523795a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Going to run 1 instances... {{(pid=129790) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 23:17:01.150735 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-358cd305-68ef-428d-8a44-1e27523795a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4b572e86-4915-4b2a-a9e1-6d6a10532792',volume_size=None,volume_type=None)] {{(pid=129790) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 23:17:01.335853 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-358cd305-68ef-428d-8a44-1e27523795a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.213269 Aug 04 23:17:01.337274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 227/476] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Aug 4 23:17:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 23:17:01.349632 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c801425c-f881-4b0c-9b61-a83e94a20df6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:01.350619 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c801425c-f881-4b0c-9b61-a83e94a20df6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:01.444130 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c801425c-f881-4b0c-9b61-a83e94a20df6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:01.454445 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c801425c-f881-4b0c-9b61-a83e94a20df6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1094 microversion: 2.1 time: 0.109190 Aug 04 23:17:01.455026 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 250/477] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:01 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1094 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:01.856424 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c6c9626a-487b-4095-9038-994e6c40c291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:01.857622 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c6c9626a-487b-4095-9038-994e6c40c291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:01.869206 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6c9626a-487b-4095-9038-994e6c40c291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:01.869895 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6c9626a-487b-4095-9038-994e6c40c291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:01.870524 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6c9626a-487b-4095-9038-994e6c40c291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:01.871511 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6c9626a-487b-4095-9038-994e6c40c291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:01.872111 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6c9626a-487b-4095-9038-994e6c40c291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:01.872704 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6c9626a-487b-4095-9038-994e6c40c291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:02.071437 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c6c9626a-487b-4095-9038-994e6c40c291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:02.083523 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c6c9626a-487b-4095-9038-994e6c40c291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:02.085442 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c6c9626a-487b-4095-9038-994e6c40c291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:02.087727 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c6c9626a-487b-4095-9038-994e6c40c291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1723 microversion: 2.20 time: 0.235991 Aug 04 23:17:02.089379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 228/478] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:01 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:02.476162 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5acb61b2-659b-45ec-b395-f47c3e14d9ce tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:02.476784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5acb61b2-659b-45ec-b395-f47c3e14d9ce tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:02.483820 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5acb61b2-659b-45ec-b395-f47c3e14d9ce tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:02.484308 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5acb61b2-659b-45ec-b395-f47c3e14d9ce tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:02.484771 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5acb61b2-659b-45ec-b395-f47c3e14d9ce tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:02.485454 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5acb61b2-659b-45ec-b395-f47c3e14d9ce tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:02.485910 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5acb61b2-659b-45ec-b395-f47c3e14d9ce tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:02.486337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5acb61b2-659b-45ec-b395-f47c3e14d9ce tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:02.573348 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5acb61b2-659b-45ec-b395-f47c3e14d9ce tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:02.582196 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5acb61b2-659b-45ec-b395-f47c3e14d9ce tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1192 microversion: 2.1 time: 0.109814 Aug 04 23:17:02.583224 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 251/479] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:02 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1192 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:03.114345 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3efc31b1-8c19-4a89-b84c-9d06f44ed028 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:03.115289 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3efc31b1-8c19-4a89-b84c-9d06f44ed028 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:03.147643 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3efc31b1-8c19-4a89-b84c-9d06f44ed028 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:03.150947 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3efc31b1-8c19-4a89-b84c-9d06f44ed028 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:03.151606 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3efc31b1-8c19-4a89-b84c-9d06f44ed028 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:03.152858 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3efc31b1-8c19-4a89-b84c-9d06f44ed028 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:03.153381 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3efc31b1-8c19-4a89-b84c-9d06f44ed028 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:03.153877 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3efc31b1-8c19-4a89-b84c-9d06f44ed028 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:03.410815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3efc31b1-8c19-4a89-b84c-9d06f44ed028 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:03.420589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3efc31b1-8c19-4a89-b84c-9d06f44ed028 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:03.424967 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3efc31b1-8c19-4a89-b84c-9d06f44ed028 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:03.427864 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3efc31b1-8c19-4a89-b84c-9d06f44ed028 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1723 microversion: 2.20 time: 0.318095 Aug 04 23:17:03.429211 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 229/480] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:03 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1723 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:03.605228 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f181dba5-677f-4172-9de9-4b86d1131537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:03.605841 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f181dba5-677f-4172-9de9-4b86d1131537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:03.620605 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f181dba5-677f-4172-9de9-4b86d1131537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:03.621118 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f181dba5-677f-4172-9de9-4b86d1131537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:03.621982 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f181dba5-677f-4172-9de9-4b86d1131537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:03.625328 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f181dba5-677f-4172-9de9-4b86d1131537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:03.626103 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f181dba5-677f-4172-9de9-4b86d1131537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:03.627143 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f181dba5-677f-4172-9de9-4b86d1131537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:03.774050 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f181dba5-677f-4172-9de9-4b86d1131537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:03.782301 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f181dba5-677f-4172-9de9-4b86d1131537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1210 microversion: 2.1 time: 0.181209 Aug 04 23:17:03.807768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 252/481] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:03 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1210 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:04.456092 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-929240dd-3c1b-49d0-b951-07dfea0a40ad tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:04.456870 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-929240dd-3c1b-49d0-b951-07dfea0a40ad tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:04.471439 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-929240dd-3c1b-49d0-b951-07dfea0a40ad tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:04.472242 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-929240dd-3c1b-49d0-b951-07dfea0a40ad tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:04.473199 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-929240dd-3c1b-49d0-b951-07dfea0a40ad tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:04.475046 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-929240dd-3c1b-49d0-b951-07dfea0a40ad tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:04.475715 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-929240dd-3c1b-49d0-b951-07dfea0a40ad tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:04.476346 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-929240dd-3c1b-49d0-b951-07dfea0a40ad tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:04.792532 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-929240dd-3c1b-49d0-b951-07dfea0a40ad tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:04.802426 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-929240dd-3c1b-49d0-b951-07dfea0a40ad tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:04.804275 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-929240dd-3c1b-49d0-b951-07dfea0a40ad tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:04.805717 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-929240dd-3c1b-49d0-b951-07dfea0a40ad tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1744 microversion: 2.20 time: 0.357563 Aug 04 23:17:04.806959 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 230/482] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:04 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1744 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:04.821897 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a2cbe430-b66f-4834-9c77-15bfb2b75bdb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:04.823271 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a2cbe430-b66f-4834-9c77-15bfb2b75bdb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:04.840562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a2cbe430-b66f-4834-9c77-15bfb2b75bdb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:04.841502 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a2cbe430-b66f-4834-9c77-15bfb2b75bdb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:04.843929 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a2cbe430-b66f-4834-9c77-15bfb2b75bdb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:04.845032 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a2cbe430-b66f-4834-9c77-15bfb2b75bdb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:04.845822 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a2cbe430-b66f-4834-9c77-15bfb2b75bdb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:04.846484 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a2cbe430-b66f-4834-9c77-15bfb2b75bdb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:05.032019 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a2cbe430-b66f-4834-9c77-15bfb2b75bdb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:05.044088 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a2cbe430-b66f-4834-9c77-15bfb2b75bdb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.225471 Aug 04 23:17:05.063382 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 253/483] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:04 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:05.392651 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-00489ccc-48df-4757-88f6-f9c2a5c1c33c req-c64e2f10-3936-42d7-bcb3-b52d8c9ec6aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5507ea1e-7623-46eb-9317-03688967021e", "tag": "77de594c-7c86-47c2-a1db-2cbb7ecc8978"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:17:05.418886 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-00489ccc-48df-4757-88f6-f9c2a5c1c33c req-c64e2f10-3936-42d7-bcb3-b52d8c9ec6aa service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:05.423002 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-00489ccc-48df-4757-88f6-f9c2a5c1c33c req-c64e2f10-3936-42d7-bcb3-b52d8c9ec6aa service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:05.424724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-00489ccc-48df-4757-88f6-f9c2a5c1c33c req-c64e2f10-3936-42d7-bcb3-b52d8c9ec6aa service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:05.440459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-00489ccc-48df-4757-88f6-f9c2a5c1c33c req-c64e2f10-3936-42d7-bcb3-b52d8c9ec6aa service nova] Creating event network-changed:77de594c-7c86-47c2-a1db-2cbb7ecc8978 for instance 5507ea1e-7623-46eb-9317-03688967021e on hv-cinder-85221 Aug 04 23:17:05.447475 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-00489ccc-48df-4757-88f6-f9c2a5c1c33c req-c64e2f10-3936-42d7-bcb3-b52d8c9ec6aa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065170 Aug 04 23:17:05.448573 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 231/484] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:17:05.832201 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-74b48ea8-a901-4037-aaf3-daddff418cf6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:05.832953 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-74b48ea8-a901-4037-aaf3-daddff418cf6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:05.840096 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-74b48ea8-a901-4037-aaf3-daddff418cf6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:05.840962 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-74b48ea8-a901-4037-aaf3-daddff418cf6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:05.842492 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-74b48ea8-a901-4037-aaf3-daddff418cf6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:05.843798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-74b48ea8-a901-4037-aaf3-daddff418cf6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:05.844612 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-74b48ea8-a901-4037-aaf3-daddff418cf6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:05.846070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-74b48ea8-a901-4037-aaf3-daddff418cf6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:06.072380 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-701643e8-4f5d-4d20-963c-df1814eba574 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:06.073703 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-701643e8-4f5d-4d20-963c-df1814eba574 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:06.080686 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-701643e8-4f5d-4d20-963c-df1814eba574 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:06.081429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-701643e8-4f5d-4d20-963c-df1814eba574 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:06.082043 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-701643e8-4f5d-4d20-963c-df1814eba574 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:06.082954 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-701643e8-4f5d-4d20-963c-df1814eba574 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:06.083572 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-701643e8-4f5d-4d20-963c-df1814eba574 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:06.083993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-701643e8-4f5d-4d20-963c-df1814eba574 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:06.103821 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-74b48ea8-a901-4037-aaf3-daddff418cf6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:06.126837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-74b48ea8-a901-4037-aaf3-daddff418cf6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:06.129222 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-74b48ea8-a901-4037-aaf3-daddff418cf6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:06.130967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-74b48ea8-a901-4037-aaf3-daddff418cf6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1744 microversion: 2.20 time: 0.302835 Aug 04 23:17:06.132433 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 254/485] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:05 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1744 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:17:06.335623 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-701643e8-4f5d-4d20-963c-df1814eba574 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:06.348217 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-701643e8-4f5d-4d20-963c-df1814eba574 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.282583 Aug 04 23:17:06.349123 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 232/486] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:06 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:07.155991 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b3d97400-0599-4c12-b6c6-19c784ea6264 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:07.157504 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b3d97400-0599-4c12-b6c6-19c784ea6264 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:07.167136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b3d97400-0599-4c12-b6c6-19c784ea6264 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:07.167636 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b3d97400-0599-4c12-b6c6-19c784ea6264 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:07.168080 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b3d97400-0599-4c12-b6c6-19c784ea6264 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:07.168784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b3d97400-0599-4c12-b6c6-19c784ea6264 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:07.169238 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b3d97400-0599-4c12-b6c6-19c784ea6264 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:07.169662 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b3d97400-0599-4c12-b6c6-19c784ea6264 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:07.333839 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b3d97400-0599-4c12-b6c6-19c784ea6264 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:07.343610 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b3d97400-0599-4c12-b6c6-19c784ea6264 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:07.346493 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b3d97400-0599-4c12-b6c6-19c784ea6264 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:07.347907 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b3d97400-0599-4c12-b6c6-19c784ea6264 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1744 microversion: 2.20 time: 0.196532 Aug 04 23:17:07.348988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 255/487] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:07 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1744 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:17:07.370216 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-450fb598-208f-400f-a5e5-2df8bc021111 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:07.370945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-450fb598-208f-400f-a5e5-2df8bc021111 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:07.383996 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-450fb598-208f-400f-a5e5-2df8bc021111 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:07.387226 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-450fb598-208f-400f-a5e5-2df8bc021111 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:07.387912 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-450fb598-208f-400f-a5e5-2df8bc021111 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:07.391132 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-450fb598-208f-400f-a5e5-2df8bc021111 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:07.392048 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-450fb598-208f-400f-a5e5-2df8bc021111 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:07.392584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-450fb598-208f-400f-a5e5-2df8bc021111 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:07.624670 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-450fb598-208f-400f-a5e5-2df8bc021111 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:07.629521 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:17:07.635854 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-450fb598-208f-400f-a5e5-2df8bc021111 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.270528 Aug 04 23:17:07.653182 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 233/488] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:07 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:08.020583 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-2edc1a96-d82e-4732-afe7-45a3f5c1af9c req-66b11fd4-b5e0-4f02-8c9b-bc3782a8d258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2013d923-81bb-4002-976d-64d3722b15d2", "name": "network-vif-plugged", "status": "completed", "tag": "bae5f1bd-b332-4fbe-8c3e-7f38e098b71d"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:17:08.025713 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=37 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:17:08.032570 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-2edc1a96-d82e-4732-afe7-45a3f5c1af9c req-66b11fd4-b5e0-4f02-8c9b-bc3782a8d258 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:08.033328 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-2edc1a96-d82e-4732-afe7-45a3f5c1af9c req-66b11fd4-b5e0-4f02-8c9b-bc3782a8d258 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:08.034121 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-2edc1a96-d82e-4732-afe7-45a3f5c1af9c req-66b11fd4-b5e0-4f02-8c9b-bc3782a8d258 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:08.047051 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=95 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:17:08.056218 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-2edc1a96-d82e-4732-afe7-45a3f5c1af9c req-66b11fd4-b5e0-4f02-8c9b-bc3782a8d258 service nova] Creating event network-vif-plugged:bae5f1bd-b332-4fbe-8c3e-7f38e098b71d for instance 2013d923-81bb-4002-976d-64d3722b15d2 on hv-cinder-85221 Aug 04 23:17:08.069166 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-2edc1a96-d82e-4732-afe7-45a3f5c1af9c req-66b11fd4-b5e0-4f02-8c9b-bc3782a8d258 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052284 Aug 04 23:17:08.069770 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 256/489] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:17:08.375249 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e6b1ece4-44f9-4be4-825a-3026beafd631 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:08.376487 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e6b1ece4-44f9-4be4-825a-3026beafd631 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:08.384534 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6b1ece4-44f9-4be4-825a-3026beafd631 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:08.385019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6b1ece4-44f9-4be4-825a-3026beafd631 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:08.385453 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6b1ece4-44f9-4be4-825a-3026beafd631 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:08.386157 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6b1ece4-44f9-4be4-825a-3026beafd631 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:08.386705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6b1ece4-44f9-4be4-825a-3026beafd631 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:08.387305 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6b1ece4-44f9-4be4-825a-3026beafd631 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:08.538543 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e6b1ece4-44f9-4be4-825a-3026beafd631 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:08.548428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e6b1ece4-44f9-4be4-825a-3026beafd631 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:08.550057 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e6b1ece4-44f9-4be4-825a-3026beafd631 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:08.551423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e6b1ece4-44f9-4be4-825a-3026beafd631 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1744 microversion: 2.20 time: 0.180832 Aug 04 23:17:08.552278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 234/490] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:08 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1744 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:08.662669 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0acab5d1-d758-4101-afaf-8e99890dbc6e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:08.663989 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0acab5d1-d758-4101-afaf-8e99890dbc6e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:08.671631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0acab5d1-d758-4101-afaf-8e99890dbc6e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:08.672451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0acab5d1-d758-4101-afaf-8e99890dbc6e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:08.673120 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0acab5d1-d758-4101-afaf-8e99890dbc6e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:08.673842 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0acab5d1-d758-4101-afaf-8e99890dbc6e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:08.674353 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0acab5d1-d758-4101-afaf-8e99890dbc6e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:08.674877 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0acab5d1-d758-4101-afaf-8e99890dbc6e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:08.825729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0acab5d1-d758-4101-afaf-8e99890dbc6e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:08.835233 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0acab5d1-d758-4101-afaf-8e99890dbc6e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.177072 Aug 04 23:17:08.854821 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 257/491] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:08 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:09.579500 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1bf19fe4-7b6e-4b74-943c-01c79f7db25c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:09.580836 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1bf19fe4-7b6e-4b74-943c-01c79f7db25c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:09.587704 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1bf19fe4-7b6e-4b74-943c-01c79f7db25c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:09.588675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1bf19fe4-7b6e-4b74-943c-01c79f7db25c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:09.589278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1bf19fe4-7b6e-4b74-943c-01c79f7db25c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:09.590164 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1bf19fe4-7b6e-4b74-943c-01c79f7db25c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:09.590981 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1bf19fe4-7b6e-4b74-943c-01c79f7db25c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:09.591570 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1bf19fe4-7b6e-4b74-943c-01c79f7db25c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:09.753750 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1bf19fe4-7b6e-4b74-943c-01c79f7db25c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:09.762704 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1bf19fe4-7b6e-4b74-943c-01c79f7db25c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:09.765149 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1bf19fe4-7b6e-4b74-943c-01c79f7db25c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:09.766592 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1bf19fe4-7b6e-4b74-943c-01c79f7db25c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1744 microversion: 2.20 time: 0.191296 Aug 04 23:17:09.772514 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 235/492] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:09 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1744 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:09.857152 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e1d23542-75af-4415-973d-59c36ca09065 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:09.858584 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e1d23542-75af-4415-973d-59c36ca09065 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:09.865027 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1d23542-75af-4415-973d-59c36ca09065 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:09.865576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1d23542-75af-4415-973d-59c36ca09065 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:09.866072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1d23542-75af-4415-973d-59c36ca09065 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:09.866856 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1d23542-75af-4415-973d-59c36ca09065 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:09.867522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1d23542-75af-4415-973d-59c36ca09065 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:09.868087 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1d23542-75af-4415-973d-59c36ca09065 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:10.037546 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e1d23542-75af-4415-973d-59c36ca09065 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:10.046393 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e1d23542-75af-4415-973d-59c36ca09065 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.192924 Aug 04 23:17:10.046980 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 258/493] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:09 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:10.791522 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2f069bdb-f116-4956-bce3-11efa3b24a97 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:10.792115 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2f069bdb-f116-4956-bce3-11efa3b24a97 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:10.794491 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:17:10.807405 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f069bdb-f116-4956-bce3-11efa3b24a97 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:10.808192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f069bdb-f116-4956-bce3-11efa3b24a97 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:10.812225 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f069bdb-f116-4956-bce3-11efa3b24a97 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:10.813250 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f069bdb-f116-4956-bce3-11efa3b24a97 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:10.813757 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f069bdb-f116-4956-bce3-11efa3b24a97 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:10.814162 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f069bdb-f116-4956-bce3-11efa3b24a97 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:11.041928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=2 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:17:11.057522 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2f069bdb-f116-4956-bce3-11efa3b24a97 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:11.068533 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-31489598-4fef-488a-9745-5414720f9e78 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:11.069864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-31489598-4fef-488a-9745-5414720f9e78 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:11.071124 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2f069bdb-f116-4956-bce3-11efa3b24a97 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:11.073720 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2f069bdb-f116-4956-bce3-11efa3b24a97 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:11.075143 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2f069bdb-f116-4956-bce3-11efa3b24a97 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1739 microversion: 2.20 time: 0.287430 Aug 04 23:17:11.076843 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 236/494] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:10 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1739 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:11.083172 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-31489598-4fef-488a-9745-5414720f9e78 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:11.083773 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-31489598-4fef-488a-9745-5414720f9e78 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:11.084314 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-31489598-4fef-488a-9745-5414720f9e78 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:11.085146 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-31489598-4fef-488a-9745-5414720f9e78 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:11.085712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-31489598-4fef-488a-9745-5414720f9e78 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:11.087730 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-31489598-4fef-488a-9745-5414720f9e78 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:11.307425 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-31489598-4fef-488a-9745-5414720f9e78 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:11.318883 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-31489598-4fef-488a-9745-5414720f9e78 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.254141 Aug 04 23:17:11.320045 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 259/495] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:11 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:12.107822 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-59b38277-3e9c-460b-b99f-3f3294921528 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:12.109967 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-59b38277-3e9c-460b-b99f-3f3294921528 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:12.118970 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=6 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:17:12.128963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59b38277-3e9c-460b-b99f-3f3294921528 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:12.129894 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59b38277-3e9c-460b-b99f-3f3294921528 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:12.130590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59b38277-3e9c-460b-b99f-3f3294921528 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:12.131615 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59b38277-3e9c-460b-b99f-3f3294921528 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:12.135811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59b38277-3e9c-460b-b99f-3f3294921528 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:12.136541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59b38277-3e9c-460b-b99f-3f3294921528 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:12.328666 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-59b38277-3e9c-460b-b99f-3f3294921528 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:12.344883 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-af331ffd-be40-4239-9905-0e00f3216038 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:12.347013 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-af331ffd-be40-4239-9905-0e00f3216038 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:12.360041 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=2 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:17:12.363453 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-59b38277-3e9c-460b-b99f-3f3294921528 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:12.366153 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af331ffd-be40-4239-9905-0e00f3216038 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:12.366922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af331ffd-be40-4239-9905-0e00f3216038 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:12.367590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af331ffd-be40-4239-9905-0e00f3216038 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:12.367963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-59b38277-3e9c-460b-b99f-3f3294921528 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:12.369041 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af331ffd-be40-4239-9905-0e00f3216038 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:12.371612 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af331ffd-be40-4239-9905-0e00f3216038 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:12.372428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af331ffd-be40-4239-9905-0e00f3216038 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:12.373206 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-59b38277-3e9c-460b-b99f-3f3294921528 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1739 microversion: 2.20 time: 0.269863 Aug 04 23:17:12.376412 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 237/496] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:12 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1739 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:12.584021 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-af331ffd-be40-4239-9905-0e00f3216038 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:12.594868 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-af331ffd-be40-4239-9905-0e00f3216038 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.258132 Aug 04 23:17:12.599310 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 260/497] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:12 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:17:13.402460 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-cc701ee0-b1a2-4aa0-bf2d-bde4b49fe9bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:13.403084 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-cc701ee0-b1a2-4aa0-bf2d-bde4b49fe9bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:13.413845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc701ee0-b1a2-4aa0-bf2d-bde4b49fe9bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:13.431280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc701ee0-b1a2-4aa0-bf2d-bde4b49fe9bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:13.432165 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc701ee0-b1a2-4aa0-bf2d-bde4b49fe9bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:13.433158 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc701ee0-b1a2-4aa0-bf2d-bde4b49fe9bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:13.434719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc701ee0-b1a2-4aa0-bf2d-bde4b49fe9bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:13.439055 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc701ee0-b1a2-4aa0-bf2d-bde4b49fe9bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:13.626154 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-cd19afc3-1163-4c7d-af35-a095a3c14f6a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:13.626794 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-cd19afc3-1163-4c7d-af35-a095a3c14f6a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:13.637957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd19afc3-1163-4c7d-af35-a095a3c14f6a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:13.638626 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd19afc3-1163-4c7d-af35-a095a3c14f6a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:13.639080 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd19afc3-1163-4c7d-af35-a095a3c14f6a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:13.639822 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd19afc3-1163-4c7d-af35-a095a3c14f6a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:13.640335 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd19afc3-1163-4c7d-af35-a095a3c14f6a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:13.640779 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd19afc3-1163-4c7d-af35-a095a3c14f6a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:13.806619 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-cc701ee0-b1a2-4aa0-bf2d-bde4b49fe9bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:13.824695 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-cc701ee0-b1a2-4aa0-bf2d-bde4b49fe9bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:13.826810 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-cc701ee0-b1a2-4aa0-bf2d-bde4b49fe9bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:13.828012 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-cc701ee0-b1a2-4aa0-bf2d-bde4b49fe9bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1739 microversion: 2.20 time: 0.429937 Aug 04 23:17:13.831746 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 238/498] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:13 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1739 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:13.976044 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cd19afc3-1163-4c7d-af35-a095a3c14f6a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:13.987852 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-cd19afc3-1163-4c7d-af35-a095a3c14f6a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.365884 Aug 04 23:17:13.989253 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 261/499] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:13 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:17:14.856615 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-60f23eb0-a6ac-4f62-9593-25c02d060ae4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:14.858047 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-60f23eb0-a6ac-4f62-9593-25c02d060ae4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:14.865809 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60f23eb0-a6ac-4f62-9593-25c02d060ae4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:14.866827 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60f23eb0-a6ac-4f62-9593-25c02d060ae4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:14.867599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60f23eb0-a6ac-4f62-9593-25c02d060ae4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:14.868601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60f23eb0-a6ac-4f62-9593-25c02d060ae4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:14.869321 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60f23eb0-a6ac-4f62-9593-25c02d060ae4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:14.869979 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60f23eb0-a6ac-4f62-9593-25c02d060ae4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:15.026041 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9c8c8fec-fab3-4f2e-936a-0cdaa76b375f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:15.028137 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9c8c8fec-fab3-4f2e-936a-0cdaa76b375f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:15.045139 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c8c8fec-fab3-4f2e-936a-0cdaa76b375f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:15.046420 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c8c8fec-fab3-4f2e-936a-0cdaa76b375f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:15.047139 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c8c8fec-fab3-4f2e-936a-0cdaa76b375f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:15.049657 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c8c8fec-fab3-4f2e-936a-0cdaa76b375f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:15.050891 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c8c8fec-fab3-4f2e-936a-0cdaa76b375f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:15.052404 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c8c8fec-fab3-4f2e-936a-0cdaa76b375f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:15.259333 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-60f23eb0-a6ac-4f62-9593-25c02d060ae4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:15.267950 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-60f23eb0-a6ac-4f62-9593-25c02d060ae4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:15.272864 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-60f23eb0-a6ac-4f62-9593-25c02d060ae4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:15.281267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-60f23eb0-a6ac-4f62-9593-25c02d060ae4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1739 microversion: 2.20 time: 0.428781 Aug 04 23:17:15.283065 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 239/500] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:14 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1739 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:15.364720 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9c8c8fec-fab3-4f2e-936a-0cdaa76b375f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:15.374609 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9c8c8fec-fab3-4f2e-936a-0cdaa76b375f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.353728 Aug 04 23:17:15.388457 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 262/501] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:15 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:16.305201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9a4d254a-43d6-4d67-8a49-84b7cc6f4799 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:16.306592 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9a4d254a-43d6-4d67-8a49-84b7cc6f4799 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:16.317490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a4d254a-43d6-4d67-8a49-84b7cc6f4799 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:16.318354 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a4d254a-43d6-4d67-8a49-84b7cc6f4799 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:16.319057 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a4d254a-43d6-4d67-8a49-84b7cc6f4799 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:16.320009 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a4d254a-43d6-4d67-8a49-84b7cc6f4799 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:16.320664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a4d254a-43d6-4d67-8a49-84b7cc6f4799 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:16.321292 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a4d254a-43d6-4d67-8a49-84b7cc6f4799 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:16.397089 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8d76392b-7173-41cb-ba29-37fff05a3fd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:16.398474 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8d76392b-7173-41cb-ba29-37fff05a3fd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:16.425339 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8d76392b-7173-41cb-ba29-37fff05a3fd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:16.426074 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8d76392b-7173-41cb-ba29-37fff05a3fd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:16.426551 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8d76392b-7173-41cb-ba29-37fff05a3fd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:16.427551 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8d76392b-7173-41cb-ba29-37fff05a3fd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:16.428114 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8d76392b-7173-41cb-ba29-37fff05a3fd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:16.428549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8d76392b-7173-41cb-ba29-37fff05a3fd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:16.655241 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9a4d254a-43d6-4d67-8a49-84b7cc6f4799 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:16.679114 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9a4d254a-43d6-4d67-8a49-84b7cc6f4799 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:16.681459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9a4d254a-43d6-4d67-8a49-84b7cc6f4799 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:16.682997 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9a4d254a-43d6-4d67-8a49-84b7cc6f4799 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1739 microversion: 2.20 time: 0.381675 Aug 04 23:17:16.699876 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8d76392b-7173-41cb-ba29-37fff05a3fd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:16.708959 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8d76392b-7173-41cb-ba29-37fff05a3fd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.315974 Aug 04 23:17:16.722396 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 263/502] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:16 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:16.722654 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 240/503] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:16 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1739 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:17.712291 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3780af1c-ed05-4cf9-897d-fe4bdedd2bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:17.712903 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3780af1c-ed05-4cf9-897d-fe4bdedd2bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:17.719934 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3780af1c-ed05-4cf9-897d-fe4bdedd2bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:17.721019 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3780af1c-ed05-4cf9-897d-fe4bdedd2bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:17.722031 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3780af1c-ed05-4cf9-897d-fe4bdedd2bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:17.723639 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3780af1c-ed05-4cf9-897d-fe4bdedd2bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:17.725293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3780af1c-ed05-4cf9-897d-fe4bdedd2bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:17.725946 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3780af1c-ed05-4cf9-897d-fe4bdedd2bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:17.741776 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0be4b2b6-6ecc-48c3-b087-c9131eb04903 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:17.742495 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0be4b2b6-6ecc-48c3-b087-c9131eb04903 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:17.757790 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0be4b2b6-6ecc-48c3-b087-c9131eb04903 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:17.760274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0be4b2b6-6ecc-48c3-b087-c9131eb04903 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:17.760780 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0be4b2b6-6ecc-48c3-b087-c9131eb04903 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:17.762232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0be4b2b6-6ecc-48c3-b087-c9131eb04903 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:17.762232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0be4b2b6-6ecc-48c3-b087-c9131eb04903 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:17.765352 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0be4b2b6-6ecc-48c3-b087-c9131eb04903 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:18.074670 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3780af1c-ed05-4cf9-897d-fe4bdedd2bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:18.090124 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3780af1c-ed05-4cf9-897d-fe4bdedd2bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:18.093288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3780af1c-ed05-4cf9-897d-fe4bdedd2bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:18.094476 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3780af1c-ed05-4cf9-897d-fe4bdedd2bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1739 microversion: 2.20 time: 0.385928 Aug 04 23:17:18.095317 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 264/504] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:17 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1739 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:18.100972 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0be4b2b6-6ecc-48c3-b087-c9131eb04903 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:18.102502 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-58801aee-711b-4af8-820c-ba440ea81882 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Action: 'create', calling method: .version_select at 0x7f6d25f915e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-777286432", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtGaRHGN3hLh96xf5FyyvfDUWPYJFdnmLEtTtUTeqa9xI0/eynsFhNalQjesMwCxTWnVqwl3L2/q+T6loYdy1bjTfr+qRtz1rMiRQetmPnA/Yykjm7LXWz+M8KYiEryMQ=="}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:17:18.116812 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0be4b2b6-6ecc-48c3-b087-c9131eb04903 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.380106 Aug 04 23:17:18.117831 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 241/505] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:17 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:18.134435 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-58801aee-711b-4af8-820c-ba440ea81882 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Getting quotas for project 40fcbf40bf6c44a8a740c357bc8b36d1. Resources: {'key_pairs'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:17:18.135646 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-58801aee-711b-4af8-820c-ba440ea81882 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Getting quotas for user fc87f238e5c94ddea864c1e9c928fc6d and project 40fcbf40bf6c44a8a740c357bc8b36d1. Resources: {'key_pairs'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:17:18.164663 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-58801aee-711b-4af8-820c-ba440ea81882 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.067718 Aug 04 23:17:18.165484 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 265/506] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Aug 4 23:17:18 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:17:18.227113 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-725995de-1b5d-47fc-8f6d-ffbf9485f5fe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1618529935", "imageRef": "d6344891-196b-4bd2-9199-4839a9d3b980", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-777286432", "networks": [{"uuid": "c192884b-5ed7-4782-9077-9d946df5219b"}]}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:17:18.285739 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.network.neutron [None req-725995de-1b5d-47fc-8f6d-ffbf9485f5fe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] validate_networks() for [('c192884b-5ed7-4782-9077-9d946df5219b', None, None, None, None, None)] {{(pid=129790) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 23:17:18.731770 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-725995de-1b5d-47fc-8f6d-ffbf9485f5fe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Flavor limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 23:17:18.732400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-725995de-1b5d-47fc-8f6d-ffbf9485f5fe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Image limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 23:17:18.733266 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-725995de-1b5d-47fc-8f6d-ffbf9485f5fe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Flavor pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 23:17:18.734477 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-725995de-1b5d-47fc-8f6d-ffbf9485f5fe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Image pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 23:17:18.735104 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-725995de-1b5d-47fc-8f6d-ffbf9485f5fe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 23:17:18.744783 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-725995de-1b5d-47fc-8f6d-ffbf9485f5fe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:18.745555 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-725995de-1b5d-47fc-8f6d-ffbf9485f5fe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:18.745847 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-725995de-1b5d-47fc-8f6d-ffbf9485f5fe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:18.746862 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-725995de-1b5d-47fc-8f6d-ffbf9485f5fe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:18.747399 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-725995de-1b5d-47fc-8f6d-ffbf9485f5fe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:18.748573 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-725995de-1b5d-47fc-8f6d-ffbf9485f5fe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:18.768551 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-725995de-1b5d-47fc-8f6d-ffbf9485f5fe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Getting quotas for project 40fcbf40bf6c44a8a740c357bc8b36d1. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:17:18.773056 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-725995de-1b5d-47fc-8f6d-ffbf9485f5fe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Getting quotas for user fc87f238e5c94ddea864c1e9c928fc6d and project 40fcbf40bf6c44a8a740c357bc8b36d1. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:17:18.785455 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-725995de-1b5d-47fc-8f6d-ffbf9485f5fe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Going to run 1 instances... {{(pid=129790) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 23:17:18.788643 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-725995de-1b5d-47fc-8f6d-ffbf9485f5fe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6344891-196b-4bd2-9199-4839a9d3b980',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129790) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 23:17:18.864933 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-725995de-1b5d-47fc-8f6d-ffbf9485f5fe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641511 Aug 04 23:17:18.865735 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 242/507] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Aug 4 23:17:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 23:17:18.881424 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-da86cfb9-802a-494e-8ec8-293f6109692a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:18.882199 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-da86cfb9-802a-494e-8ec8-293f6109692a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:18.957281 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-da86cfb9-802a-494e-8ec8-293f6109692a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:18.965429 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-da86cfb9-802a-494e-8ec8-293f6109692a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1258 microversion: 2.1 time: 0.092093 Aug 04 23:17:18.981946 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 266/508] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:18 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1258 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:19.120125 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b9d217b7-301e-43d8-bb58-2f0ea612996a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:19.120746 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b9d217b7-301e-43d8-bb58-2f0ea612996a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:19.130970 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b9d217b7-301e-43d8-bb58-2f0ea612996a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:19.131829 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b9d217b7-301e-43d8-bb58-2f0ea612996a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:19.132457 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b9d217b7-301e-43d8-bb58-2f0ea612996a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:19.133459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b9d217b7-301e-43d8-bb58-2f0ea612996a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:19.134207 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b9d217b7-301e-43d8-bb58-2f0ea612996a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:19.134899 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b9d217b7-301e-43d8-bb58-2f0ea612996a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:19.145393 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9d6f614f-2d05-47af-95c4-e1edc59d0089 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:19.146311 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9d6f614f-2d05-47af-95c4-e1edc59d0089 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:19.156167 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d6f614f-2d05-47af-95c4-e1edc59d0089 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:19.156963 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d6f614f-2d05-47af-95c4-e1edc59d0089 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:19.160693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d6f614f-2d05-47af-95c4-e1edc59d0089 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:19.162916 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d6f614f-2d05-47af-95c4-e1edc59d0089 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:19.167570 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d6f614f-2d05-47af-95c4-e1edc59d0089 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:19.170562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d6f614f-2d05-47af-95c4-e1edc59d0089 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:19.367400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b9d217b7-301e-43d8-bb58-2f0ea612996a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:19.377278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b9d217b7-301e-43d8-bb58-2f0ea612996a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:19.379086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b9d217b7-301e-43d8-bb58-2f0ea612996a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:19.381490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b9d217b7-301e-43d8-bb58-2f0ea612996a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1739 microversion: 2.20 time: 0.265339 Aug 04 23:17:19.399841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 243/509] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:19 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1739 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:17:19.497317 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9d6f614f-2d05-47af-95c4-e1edc59d0089 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:19.509517 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9d6f614f-2d05-47af-95c4-e1edc59d0089 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.367868 Aug 04 23:17:19.510406 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 267/510] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:19 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:17:19.997030 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e6ffac9f-914a-4698-aca7-ca7d43ec3ff1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:19.998128 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e6ffac9f-914a-4698-aca7-ca7d43ec3ff1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:20.010763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6ffac9f-914a-4698-aca7-ca7d43ec3ff1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:20.011587 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6ffac9f-914a-4698-aca7-ca7d43ec3ff1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:20.012120 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6ffac9f-914a-4698-aca7-ca7d43ec3ff1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:20.014402 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6ffac9f-914a-4698-aca7-ca7d43ec3ff1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:20.015176 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6ffac9f-914a-4698-aca7-ca7d43ec3ff1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:20.015607 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6ffac9f-914a-4698-aca7-ca7d43ec3ff1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:20.091700 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e6ffac9f-914a-4698-aca7-ca7d43ec3ff1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:20.100378 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e6ffac9f-914a-4698-aca7-ca7d43ec3ff1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1310 microversion: 2.1 time: 0.110929 Aug 04 23:17:20.100957 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 244/511] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:19 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1310 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:20.416018 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-35775eee-88ce-42d3-b5df-bea6c2225b9a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:20.416790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-35775eee-88ce-42d3-b5df-bea6c2225b9a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:20.431060 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35775eee-88ce-42d3-b5df-bea6c2225b9a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:20.432476 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35775eee-88ce-42d3-b5df-bea6c2225b9a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:20.433286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35775eee-88ce-42d3-b5df-bea6c2225b9a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:20.434585 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35775eee-88ce-42d3-b5df-bea6c2225b9a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:20.437668 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35775eee-88ce-42d3-b5df-bea6c2225b9a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:20.438430 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35775eee-88ce-42d3-b5df-bea6c2225b9a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:20.531308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ead1478f-569d-469c-9111-fab8363bd15d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:20.531937 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ead1478f-569d-469c-9111-fab8363bd15d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:20.543322 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ead1478f-569d-469c-9111-fab8363bd15d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:20.543569 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ead1478f-569d-469c-9111-fab8363bd15d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:20.544013 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ead1478f-569d-469c-9111-fab8363bd15d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:20.544797 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ead1478f-569d-469c-9111-fab8363bd15d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:20.545258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ead1478f-569d-469c-9111-fab8363bd15d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:20.545736 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ead1478f-569d-469c-9111-fab8363bd15d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:20.713510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-35775eee-88ce-42d3-b5df-bea6c2225b9a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:20.729495 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-35775eee-88ce-42d3-b5df-bea6c2225b9a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:20.731682 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-35775eee-88ce-42d3-b5df-bea6c2225b9a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:20.737626 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-35775eee-88ce-42d3-b5df-bea6c2225b9a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1739 microversion: 2.20 time: 0.325623 Aug 04 23:17:20.738483 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 268/512] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:20 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1739 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:20.828816 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ead1478f-569d-469c-9111-fab8363bd15d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:20.837145 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ead1478f-569d-469c-9111-fab8363bd15d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.310492 Aug 04 23:17:20.848154 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 245/513] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:20 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:17:21.127682 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-af0173c6-ff16-4937-b194-2aa1cda1cdbe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:21.128565 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-af0173c6-ff16-4937-b194-2aa1cda1cdbe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:21.139049 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af0173c6-ff16-4937-b194-2aa1cda1cdbe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:21.141572 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af0173c6-ff16-4937-b194-2aa1cda1cdbe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:21.142271 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af0173c6-ff16-4937-b194-2aa1cda1cdbe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:21.144115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af0173c6-ff16-4937-b194-2aa1cda1cdbe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:21.146425 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af0173c6-ff16-4937-b194-2aa1cda1cdbe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:21.147267 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af0173c6-ff16-4937-b194-2aa1cda1cdbe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:21.439023 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-af0173c6-ff16-4937-b194-2aa1cda1cdbe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:21.466807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-af0173c6-ff16-4937-b194-2aa1cda1cdbe tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1316 microversion: 2.1 time: 0.343392 Aug 04 23:17:21.467514 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 269/514] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:21 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1316 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:21.766398 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9233001d-7e08-47a4-9447-a681fb1db470 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:21.767051 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9233001d-7e08-47a4-9447-a681fb1db470 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:21.796708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9233001d-7e08-47a4-9447-a681fb1db470 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:21.797493 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9233001d-7e08-47a4-9447-a681fb1db470 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:21.798221 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9233001d-7e08-47a4-9447-a681fb1db470 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:21.799288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9233001d-7e08-47a4-9447-a681fb1db470 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:21.800408 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9233001d-7e08-47a4-9447-a681fb1db470 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:21.801110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9233001d-7e08-47a4-9447-a681fb1db470 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:21.862744 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e15ff779-9b0a-4f37-bb1c-855e6217b5e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:21.864467 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e15ff779-9b0a-4f37-bb1c-855e6217b5e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:21.880425 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e15ff779-9b0a-4f37-bb1c-855e6217b5e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:21.887724 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e15ff779-9b0a-4f37-bb1c-855e6217b5e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:21.890008 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e15ff779-9b0a-4f37-bb1c-855e6217b5e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:21.891046 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e15ff779-9b0a-4f37-bb1c-855e6217b5e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:21.895737 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e15ff779-9b0a-4f37-bb1c-855e6217b5e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:21.896538 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e15ff779-9b0a-4f37-bb1c-855e6217b5e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:22.245908 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9233001d-7e08-47a4-9447-a681fb1db470 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:22.259668 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9233001d-7e08-47a4-9447-a681fb1db470 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:22.261211 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9233001d-7e08-47a4-9447-a681fb1db470 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:22.262499 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9233001d-7e08-47a4-9447-a681fb1db470 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1739 microversion: 2.20 time: 0.501670 Aug 04 23:17:22.263074 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 246/515] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:21 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1739 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:22.344921 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e15ff779-9b0a-4f37-bb1c-855e6217b5e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:22.354831 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e15ff779-9b0a-4f37-bb1c-855e6217b5e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.498825 Aug 04 23:17:22.356415 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 270/516] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:21 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:22.494155 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ab0d7d76-d52d-4038-bf2c-c7f7b1352065 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:22.494858 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ab0d7d76-d52d-4038-bf2c-c7f7b1352065 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:22.502180 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab0d7d76-d52d-4038-bf2c-c7f7b1352065 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:22.503503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab0d7d76-d52d-4038-bf2c-c7f7b1352065 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:22.504216 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab0d7d76-d52d-4038-bf2c-c7f7b1352065 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:22.505230 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab0d7d76-d52d-4038-bf2c-c7f7b1352065 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:22.506089 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab0d7d76-d52d-4038-bf2c-c7f7b1352065 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:22.507146 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab0d7d76-d52d-4038-bf2c-c7f7b1352065 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:22.832562 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ab0d7d76-d52d-4038-bf2c-c7f7b1352065 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:22.852266 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ab0d7d76-d52d-4038-bf2c-c7f7b1352065 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.361704 Aug 04 23:17:22.867017 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 247/517] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:22 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1358 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:23.286667 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-feb8b54c-ce80-4c10-902a-b7dfcba11317 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:23.287420 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-feb8b54c-ce80-4c10-902a-b7dfcba11317 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:23.293800 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-feb8b54c-ce80-4c10-902a-b7dfcba11317 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:23.294043 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-feb8b54c-ce80-4c10-902a-b7dfcba11317 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:23.294282 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-feb8b54c-ce80-4c10-902a-b7dfcba11317 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:23.295795 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-feb8b54c-ce80-4c10-902a-b7dfcba11317 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:23.296445 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-feb8b54c-ce80-4c10-902a-b7dfcba11317 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:23.296866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-feb8b54c-ce80-4c10-902a-b7dfcba11317 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:23.377461 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f3730aba-1eb0-4c04-b8d4-33d903fd408e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:23.378409 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f3730aba-1eb0-4c04-b8d4-33d903fd408e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:23.384681 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f3730aba-1eb0-4c04-b8d4-33d903fd408e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:23.385576 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f3730aba-1eb0-4c04-b8d4-33d903fd408e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:23.386345 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f3730aba-1eb0-4c04-b8d4-33d903fd408e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:23.387552 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f3730aba-1eb0-4c04-b8d4-33d903fd408e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:23.388178 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f3730aba-1eb0-4c04-b8d4-33d903fd408e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:23.389451 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f3730aba-1eb0-4c04-b8d4-33d903fd408e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:23.453462 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-feb8b54c-ce80-4c10-902a-b7dfcba11317 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:23.463009 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-feb8b54c-ce80-4c10-902a-b7dfcba11317 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:23.464785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-feb8b54c-ce80-4c10-902a-b7dfcba11317 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:23.465976 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-feb8b54c-ce80-4c10-902a-b7dfcba11317 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1739 microversion: 2.20 time: 0.183532 Aug 04 23:17:23.467094 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 271/518] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:23 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:23.560939 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f3730aba-1eb0-4c04-b8d4-33d903fd408e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:23.569589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f3730aba-1eb0-4c04-b8d4-33d903fd408e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.197047 Aug 04 23:17:23.570165 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 248/519] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:23 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:17:23.889208 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c1b8b154-84f5-43c7-a23f-edad409b0929 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:23.890571 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c1b8b154-84f5-43c7-a23f-edad409b0929 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:23.900392 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c1b8b154-84f5-43c7-a23f-edad409b0929 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:23.901221 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c1b8b154-84f5-43c7-a23f-edad409b0929 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:23.901959 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c1b8b154-84f5-43c7-a23f-edad409b0929 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:23.903188 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c1b8b154-84f5-43c7-a23f-edad409b0929 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:23.903998 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c1b8b154-84f5-43c7-a23f-edad409b0929 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:23.905109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c1b8b154-84f5-43c7-a23f-edad409b0929 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:24.048116 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c1b8b154-84f5-43c7-a23f-edad409b0929 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:24.055828 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c1b8b154-84f5-43c7-a23f-edad409b0929 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.172677 Aug 04 23:17:24.056478 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 272/520] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:23 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:24.490192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-99ea5edb-75b0-4b87-b0c9-b6757ebc5fc2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:24.491732 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-99ea5edb-75b0-4b87-b0c9-b6757ebc5fc2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:24.499433 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-99ea5edb-75b0-4b87-b0c9-b6757ebc5fc2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:24.500320 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-99ea5edb-75b0-4b87-b0c9-b6757ebc5fc2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:24.500986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-99ea5edb-75b0-4b87-b0c9-b6757ebc5fc2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:24.501783 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-99ea5edb-75b0-4b87-b0c9-b6757ebc5fc2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:24.502856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-99ea5edb-75b0-4b87-b0c9-b6757ebc5fc2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:24.503445 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-99ea5edb-75b0-4b87-b0c9-b6757ebc5fc2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:24.515465 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-6d0b2195-c349-4872-a4f5-c180e0bc58e8 req-09869969-5279-47dd-af78-581ed51e9f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5507ea1e-7623-46eb-9317-03688967021e", "name": "network-vif-plugged", "status": "completed", "tag": "77de594c-7c86-47c2-a1db-2cbb7ecc8978"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:17:24.525826 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-6d0b2195-c349-4872-a4f5-c180e0bc58e8 req-09869969-5279-47dd-af78-581ed51e9f78 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:24.526775 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-6d0b2195-c349-4872-a4f5-c180e0bc58e8 req-09869969-5279-47dd-af78-581ed51e9f78 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:24.527413 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-6d0b2195-c349-4872-a4f5-c180e0bc58e8 req-09869969-5279-47dd-af78-581ed51e9f78 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:24.543281 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-6d0b2195-c349-4872-a4f5-c180e0bc58e8 req-09869969-5279-47dd-af78-581ed51e9f78 service nova] Creating event network-vif-plugged:77de594c-7c86-47c2-a1db-2cbb7ecc8978 for instance 5507ea1e-7623-46eb-9317-03688967021e on hv-cinder-85221 Aug 04 23:17:24.550197 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-6d0b2195-c349-4872-a4f5-c180e0bc58e8 req-09869969-5279-47dd-af78-581ed51e9f78 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039675 Aug 04 23:17:24.553375 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 273/521] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:17:24.595213 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7489edc3-0454-42c6-93cd-4aed87efbd99 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:24.595914 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7489edc3-0454-42c6-93cd-4aed87efbd99 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:24.608255 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7489edc3-0454-42c6-93cd-4aed87efbd99 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:24.608842 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7489edc3-0454-42c6-93cd-4aed87efbd99 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:24.609306 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7489edc3-0454-42c6-93cd-4aed87efbd99 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:24.609982 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7489edc3-0454-42c6-93cd-4aed87efbd99 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:24.610645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7489edc3-0454-42c6-93cd-4aed87efbd99 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:24.611072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7489edc3-0454-42c6-93cd-4aed87efbd99 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:24.672950 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-99ea5edb-75b0-4b87-b0c9-b6757ebc5fc2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:24.682384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-99ea5edb-75b0-4b87-b0c9-b6757ebc5fc2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:24.685804 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-99ea5edb-75b0-4b87-b0c9-b6757ebc5fc2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:24.685804 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-99ea5edb-75b0-4b87-b0c9-b6757ebc5fc2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1739 microversion: 2.20 time: 0.199144 Aug 04 23:17:24.691496 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 249/522] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:24 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:24.807355 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7489edc3-0454-42c6-93cd-4aed87efbd99 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:24.816561 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7489edc3-0454-42c6-93cd-4aed87efbd99 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.229117 Aug 04 23:17:24.817062 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 274/523] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:24 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:25.078979 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-21eef610-d66c-4ad6-9910-66992b18efd6 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:25.079523 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-21eef610-d66c-4ad6-9910-66992b18efd6 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:25.086167 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-21eef610-d66c-4ad6-9910-66992b18efd6 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:25.086691 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-21eef610-d66c-4ad6-9910-66992b18efd6 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:25.087142 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-21eef610-d66c-4ad6-9910-66992b18efd6 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:25.087847 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-21eef610-d66c-4ad6-9910-66992b18efd6 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:25.088571 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-21eef610-d66c-4ad6-9910-66992b18efd6 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:25.089058 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-21eef610-d66c-4ad6-9910-66992b18efd6 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:25.231593 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-21eef610-d66c-4ad6-9910-66992b18efd6 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:25.242334 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-21eef610-d66c-4ad6-9910-66992b18efd6 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.168861 Aug 04 23:17:25.243266 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 250/524] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:25 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:25.715876 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-630b2ecd-12c3-4185-a15c-7c007ad82016 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:25.717179 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-630b2ecd-12c3-4185-a15c-7c007ad82016 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:25.723890 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-630b2ecd-12c3-4185-a15c-7c007ad82016 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:25.724391 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-630b2ecd-12c3-4185-a15c-7c007ad82016 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:25.724799 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-630b2ecd-12c3-4185-a15c-7c007ad82016 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:25.725504 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-630b2ecd-12c3-4185-a15c-7c007ad82016 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:25.725945 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-630b2ecd-12c3-4185-a15c-7c007ad82016 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:25.726409 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-630b2ecd-12c3-4185-a15c-7c007ad82016 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:25.845444 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e0a6b97a-53a7-4c63-be6e-b660dbfedf19 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:25.846480 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e0a6b97a-53a7-4c63-be6e-b660dbfedf19 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:25.859561 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e0a6b97a-53a7-4c63-be6e-b660dbfedf19 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:25.861190 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e0a6b97a-53a7-4c63-be6e-b660dbfedf19 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:25.861928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e0a6b97a-53a7-4c63-be6e-b660dbfedf19 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:25.863453 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e0a6b97a-53a7-4c63-be6e-b660dbfedf19 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:25.864239 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e0a6b97a-53a7-4c63-be6e-b660dbfedf19 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:25.865700 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e0a6b97a-53a7-4c63-be6e-b660dbfedf19 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:25.875800 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:17:25.910083 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-630b2ecd-12c3-4185-a15c-7c007ad82016 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:25.935148 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-630b2ecd-12c3-4185-a15c-7c007ad82016 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:25.937754 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-630b2ecd-12c3-4185-a15c-7c007ad82016 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:25.939124 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-630b2ecd-12c3-4185-a15c-7c007ad82016 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1739 microversion: 2.20 time: 0.228215 Aug 04 23:17:25.939941 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 275/525] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:25 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:17:26.030978 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e0a6b97a-53a7-4c63-be6e-b660dbfedf19 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:26.038535 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e0a6b97a-53a7-4c63-be6e-b660dbfedf19 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.202364 Aug 04 23:17:26.039099 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 251/526] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:25 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:26.266314 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-62ba8bbf-a135-465f-8e32-0f0cce3aa050 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:26.266881 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-62ba8bbf-a135-465f-8e32-0f0cce3aa050 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:26.272980 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62ba8bbf-a135-465f-8e32-0f0cce3aa050 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:26.273459 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62ba8bbf-a135-465f-8e32-0f0cce3aa050 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:26.273888 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62ba8bbf-a135-465f-8e32-0f0cce3aa050 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:26.274777 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62ba8bbf-a135-465f-8e32-0f0cce3aa050 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:26.275227 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62ba8bbf-a135-465f-8e32-0f0cce3aa050 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:26.275645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62ba8bbf-a135-465f-8e32-0f0cce3aa050 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:26.278456 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:17:26.416258 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-62ba8bbf-a135-465f-8e32-0f0cce3aa050 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:26.424638 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-62ba8bbf-a135-465f-8e32-0f0cce3aa050 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.163354 Aug 04 23:17:26.425211 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 276/527] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:26 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:26.961697 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-be17be66-a323-4d29-9dfd-488a43e62679 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:26.962443 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-be17be66-a323-4d29-9dfd-488a43e62679 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:26.969038 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-be17be66-a323-4d29-9dfd-488a43e62679 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:26.969526 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-be17be66-a323-4d29-9dfd-488a43e62679 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:26.969962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-be17be66-a323-4d29-9dfd-488a43e62679 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:26.970694 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-be17be66-a323-4d29-9dfd-488a43e62679 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:26.971152 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-be17be66-a323-4d29-9dfd-488a43e62679 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:26.971607 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-be17be66-a323-4d29-9dfd-488a43e62679 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:27.059968 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-14f6390e-a8e0-470e-934d-3d2edbae2e80 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:27.062016 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-14f6390e-a8e0-470e-934d-3d2edbae2e80 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:27.068878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-14f6390e-a8e0-470e-934d-3d2edbae2e80 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:27.069727 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-14f6390e-a8e0-470e-934d-3d2edbae2e80 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:27.070403 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-14f6390e-a8e0-470e-934d-3d2edbae2e80 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:27.071605 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-14f6390e-a8e0-470e-934d-3d2edbae2e80 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:27.072278 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-14f6390e-a8e0-470e-934d-3d2edbae2e80 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:27.073244 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-14f6390e-a8e0-470e-934d-3d2edbae2e80 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:27.113186 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-be17be66-a323-4d29-9dfd-488a43e62679 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:27.121988 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-be17be66-a323-4d29-9dfd-488a43e62679 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:27.124897 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-be17be66-a323-4d29-9dfd-488a43e62679 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:27.126132 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-be17be66-a323-4d29-9dfd-488a43e62679 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1739 microversion: 2.20 time: 0.168496 Aug 04 23:17:27.126921 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 252/528] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:26 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:27.216264 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-14f6390e-a8e0-470e-934d-3d2edbae2e80 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:27.224620 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-14f6390e-a8e0-470e-934d-3d2edbae2e80 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.168641 Aug 04 23:17:27.225188 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 277/529] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:27 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:17:27.449847 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-69eede79-037e-4f8f-900d-87ada9b23afa tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:27.450491 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-69eede79-037e-4f8f-900d-87ada9b23afa tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:27.458806 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-69eede79-037e-4f8f-900d-87ada9b23afa tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:27.459340 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-69eede79-037e-4f8f-900d-87ada9b23afa tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:27.459774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-69eede79-037e-4f8f-900d-87ada9b23afa tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:27.460462 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-69eede79-037e-4f8f-900d-87ada9b23afa tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:27.460908 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-69eede79-037e-4f8f-900d-87ada9b23afa tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:27.461325 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-69eede79-037e-4f8f-900d-87ada9b23afa tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:27.604720 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-69eede79-037e-4f8f-900d-87ada9b23afa tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:27.612394 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-69eede79-037e-4f8f-900d-87ada9b23afa tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.166429 Aug 04 23:17:27.612953 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 253/530] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:27 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:28.149175 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c238020e-9532-4dcf-a346-cc04ecf915e2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:28.149798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c238020e-9532-4dcf-a346-cc04ecf915e2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:28.157154 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c238020e-9532-4dcf-a346-cc04ecf915e2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:28.157634 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c238020e-9532-4dcf-a346-cc04ecf915e2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:28.158068 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c238020e-9532-4dcf-a346-cc04ecf915e2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:28.158940 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c238020e-9532-4dcf-a346-cc04ecf915e2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:28.159552 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c238020e-9532-4dcf-a346-cc04ecf915e2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:28.159981 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c238020e-9532-4dcf-a346-cc04ecf915e2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:28.248725 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ee68b459-9c9c-42d7-993f-0fcff213d00a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:28.250061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ee68b459-9c9c-42d7-993f-0fcff213d00a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:28.257387 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee68b459-9c9c-42d7-993f-0fcff213d00a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:28.257978 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee68b459-9c9c-42d7-993f-0fcff213d00a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:28.258452 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee68b459-9c9c-42d7-993f-0fcff213d00a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:28.259173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee68b459-9c9c-42d7-993f-0fcff213d00a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:28.259753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee68b459-9c9c-42d7-993f-0fcff213d00a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:28.260187 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee68b459-9c9c-42d7-993f-0fcff213d00a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:28.306687 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c238020e-9532-4dcf-a346-cc04ecf915e2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:28.316682 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c238020e-9532-4dcf-a346-cc04ecf915e2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:28.318231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c238020e-9532-4dcf-a346-cc04ecf915e2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:28.319720 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c238020e-9532-4dcf-a346-cc04ecf915e2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1739 microversion: 2.20 time: 0.174584 Aug 04 23:17:28.325863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 278/531] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:28 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:28.428165 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ee68b459-9c9c-42d7-993f-0fcff213d00a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:28.436212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ee68b459-9c9c-42d7-993f-0fcff213d00a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.192363 Aug 04 23:17:28.442656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 254/532] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:28 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:28.633112 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-45cf07f1-1af5-4902-a23c-c40f7734d07b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:28.633728 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-45cf07f1-1af5-4902-a23c-c40f7734d07b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:28.641061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-45cf07f1-1af5-4902-a23c-c40f7734d07b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:28.641557 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-45cf07f1-1af5-4902-a23c-c40f7734d07b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:28.641993 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-45cf07f1-1af5-4902-a23c-c40f7734d07b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:28.642755 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-45cf07f1-1af5-4902-a23c-c40f7734d07b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:28.643209 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-45cf07f1-1af5-4902-a23c-c40f7734d07b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:28.643632 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-45cf07f1-1af5-4902-a23c-c40f7734d07b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:28.789307 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-45cf07f1-1af5-4902-a23c-c40f7734d07b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:28.797644 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-45cf07f1-1af5-4902-a23c-c40f7734d07b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.168341 Aug 04 23:17:28.798244 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 279/533] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:28 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:17:29.343822 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4b54f857-86b1-4e1e-a03d-4f8b7a5506c9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:29.344563 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4b54f857-86b1-4e1e-a03d-4f8b7a5506c9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:29.346815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=2 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:17:29.347504 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=6 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:17:29.354192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b54f857-86b1-4e1e-a03d-4f8b7a5506c9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:29.354719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b54f857-86b1-4e1e-a03d-4f8b7a5506c9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:29.355158 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b54f857-86b1-4e1e-a03d-4f8b7a5506c9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:29.355866 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b54f857-86b1-4e1e-a03d-4f8b7a5506c9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:29.356320 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b54f857-86b1-4e1e-a03d-4f8b7a5506c9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:29.356747 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b54f857-86b1-4e1e-a03d-4f8b7a5506c9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:29.457372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-dc98942e-79b1-433d-914a-1734c74f773b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:29.458156 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-dc98942e-79b1-433d-914a-1734c74f773b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:29.461376 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=6 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:17:29.466013 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dc98942e-79b1-433d-914a-1734c74f773b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:29.467539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dc98942e-79b1-433d-914a-1734c74f773b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:29.467978 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dc98942e-79b1-433d-914a-1734c74f773b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:29.468699 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dc98942e-79b1-433d-914a-1734c74f773b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:29.469156 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dc98942e-79b1-433d-914a-1734c74f773b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:29.469585 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dc98942e-79b1-433d-914a-1734c74f773b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:29.524362 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4b54f857-86b1-4e1e-a03d-4f8b7a5506c9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:29.534126 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4b54f857-86b1-4e1e-a03d-4f8b7a5506c9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:29.535843 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4b54f857-86b1-4e1e-a03d-4f8b7a5506c9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:29.537493 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4b54f857-86b1-4e1e-a03d-4f8b7a5506c9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1739 microversion: 2.20 time: 0.198142 Aug 04 23:17:29.542422 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 255/534] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:29 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:29.833728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2deede98-1665-43f9-8208-fe7783ca14bf tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:29.835127 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2deede98-1665-43f9-8208-fe7783ca14bf tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:29.846074 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2deede98-1665-43f9-8208-fe7783ca14bf tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:29.846957 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2deede98-1665-43f9-8208-fe7783ca14bf tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:29.847598 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2deede98-1665-43f9-8208-fe7783ca14bf tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:29.848802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2deede98-1665-43f9-8208-fe7783ca14bf tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:29.849863 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2deede98-1665-43f9-8208-fe7783ca14bf tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:29.850681 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2deede98-1665-43f9-8208-fe7783ca14bf tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:29.900340 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-dc98942e-79b1-433d-914a-1734c74f773b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:29.910078 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-dc98942e-79b1-433d-914a-1734c74f773b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.456523 Aug 04 23:17:29.911206 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 280/535] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:29 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:30.029556 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2deede98-1665-43f9-8208-fe7783ca14bf tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:30.037779 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2deede98-1665-43f9-8208-fe7783ca14bf tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.221568 Aug 04 23:17:30.038403 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 256/536] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:29 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:30.561892 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fdb335fd-1781-4d0c-96a3-668b6f3913d2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:30.562848 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-fdb335fd-1781-4d0c-96a3-668b6f3913d2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:30.568967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fdb335fd-1781-4d0c-96a3-668b6f3913d2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:30.569455 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fdb335fd-1781-4d0c-96a3-668b6f3913d2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:30.569884 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fdb335fd-1781-4d0c-96a3-668b6f3913d2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:30.570625 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fdb335fd-1781-4d0c-96a3-668b6f3913d2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:30.571073 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fdb335fd-1781-4d0c-96a3-668b6f3913d2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:30.571493 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fdb335fd-1781-4d0c-96a3-668b6f3913d2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:30.720899 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fdb335fd-1781-4d0c-96a3-668b6f3913d2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:30.729222 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fdb335fd-1781-4d0c-96a3-668b6f3913d2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:30.731416 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fdb335fd-1781-4d0c-96a3-668b6f3913d2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:30.733384 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-fdb335fd-1781-4d0c-96a3-668b6f3913d2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1739 microversion: 2.20 time: 0.176150 Aug 04 23:17:30.734230 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 281/537] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:30 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:17:30.938329 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ad8535d0-73de-4fe9-b3c3-c4ff5d5aaaf3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:30.939119 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ad8535d0-73de-4fe9-b3c3-c4ff5d5aaaf3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:30.945881 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad8535d0-73de-4fe9-b3c3-c4ff5d5aaaf3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:30.946549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad8535d0-73de-4fe9-b3c3-c4ff5d5aaaf3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:30.946898 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad8535d0-73de-4fe9-b3c3-c4ff5d5aaaf3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:30.947672 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad8535d0-73de-4fe9-b3c3-c4ff5d5aaaf3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:30.948135 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad8535d0-73de-4fe9-b3c3-c4ff5d5aaaf3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:30.948562 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad8535d0-73de-4fe9-b3c3-c4ff5d5aaaf3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:31.060187 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ba01e562-2ef5-4d9b-8419-858589e628fc tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:31.061271 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ba01e562-2ef5-4d9b-8419-858589e628fc tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:31.067932 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba01e562-2ef5-4d9b-8419-858589e628fc tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:31.068535 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba01e562-2ef5-4d9b-8419-858589e628fc tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:31.068965 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba01e562-2ef5-4d9b-8419-858589e628fc tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:31.069667 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba01e562-2ef5-4d9b-8419-858589e628fc tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:31.070121 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba01e562-2ef5-4d9b-8419-858589e628fc tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:31.070566 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba01e562-2ef5-4d9b-8419-858589e628fc tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:31.112304 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ad8535d0-73de-4fe9-b3c3-c4ff5d5aaaf3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:31.121812 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ad8535d0-73de-4fe9-b3c3-c4ff5d5aaaf3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.188052 Aug 04 23:17:31.134406 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 257/538] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:30 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:31.218228 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ba01e562-2ef5-4d9b-8419-858589e628fc tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:31.225682 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ba01e562-2ef5-4d9b-8419-858589e628fc tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.169595 Aug 04 23:17:31.226347 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 282/539] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:31 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:17:31.756721 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-81869c69-94b3-4aff-b366-afba4d30cf96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:31.757328 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-81869c69-94b3-4aff-b366-afba4d30cf96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:31.764332 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81869c69-94b3-4aff-b366-afba4d30cf96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:31.765047 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81869c69-94b3-4aff-b366-afba4d30cf96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:31.765483 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81869c69-94b3-4aff-b366-afba4d30cf96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:31.766187 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81869c69-94b3-4aff-b366-afba4d30cf96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:31.766670 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81869c69-94b3-4aff-b366-afba4d30cf96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:31.767168 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81869c69-94b3-4aff-b366-afba4d30cf96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:31.936576 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-81869c69-94b3-4aff-b366-afba4d30cf96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:31.948707 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-81869c69-94b3-4aff-b366-afba4d30cf96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:31.950615 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-81869c69-94b3-4aff-b366-afba4d30cf96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:31.952618 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-81869c69-94b3-4aff-b366-afba4d30cf96 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1739 microversion: 2.20 time: 0.199895 Aug 04 23:17:31.953480 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 258/540] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:31 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:32.145611 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-02f757ae-b08d-4f0c-8eea-6ebf78507f14 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:32.146225 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-02f757ae-b08d-4f0c-8eea-6ebf78507f14 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:32.152538 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02f757ae-b08d-4f0c-8eea-6ebf78507f14 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:32.153027 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02f757ae-b08d-4f0c-8eea-6ebf78507f14 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:32.153456 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02f757ae-b08d-4f0c-8eea-6ebf78507f14 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:32.154199 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02f757ae-b08d-4f0c-8eea-6ebf78507f14 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:32.154763 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02f757ae-b08d-4f0c-8eea-6ebf78507f14 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:32.155192 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02f757ae-b08d-4f0c-8eea-6ebf78507f14 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:32.248922 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2735c4e3-4a42-4077-8dc1-8d50dfbe9d12 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:32.249789 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2735c4e3-4a42-4077-8dc1-8d50dfbe9d12 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:32.256437 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2735c4e3-4a42-4077-8dc1-8d50dfbe9d12 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:32.256937 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2735c4e3-4a42-4077-8dc1-8d50dfbe9d12 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:32.257370 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2735c4e3-4a42-4077-8dc1-8d50dfbe9d12 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:32.258078 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2735c4e3-4a42-4077-8dc1-8d50dfbe9d12 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:32.258557 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2735c4e3-4a42-4077-8dc1-8d50dfbe9d12 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:32.258983 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2735c4e3-4a42-4077-8dc1-8d50dfbe9d12 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:32.314925 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-02f757ae-b08d-4f0c-8eea-6ebf78507f14 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:32.322862 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-02f757ae-b08d-4f0c-8eea-6ebf78507f14 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.180916 Aug 04 23:17:32.324032 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 283/541] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:32 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:17:32.412142 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2735c4e3-4a42-4077-8dc1-8d50dfbe9d12 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:32.420224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2735c4e3-4a42-4077-8dc1-8d50dfbe9d12 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.175297 Aug 04 23:17:32.421330 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 259/542] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:32 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:32.981066 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5a30aed3-0133-4e1f-a89b-a68536e15ad0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:32.981677 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5a30aed3-0133-4e1f-a89b-a68536e15ad0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:32.991788 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a30aed3-0133-4e1f-a89b-a68536e15ad0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:32.992265 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a30aed3-0133-4e1f-a89b-a68536e15ad0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:32.992686 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a30aed3-0133-4e1f-a89b-a68536e15ad0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:32.993532 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a30aed3-0133-4e1f-a89b-a68536e15ad0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:32.994450 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a30aed3-0133-4e1f-a89b-a68536e15ad0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:32.994960 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a30aed3-0133-4e1f-a89b-a68536e15ad0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:33.134775 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5a30aed3-0133-4e1f-a89b-a68536e15ad0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:33.144511 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5a30aed3-0133-4e1f-a89b-a68536e15ad0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:33.146007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5a30aed3-0133-4e1f-a89b-a68536e15ad0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:33.147207 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5a30aed3-0133-4e1f-a89b-a68536e15ad0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1739 microversion: 2.20 time: 0.170068 Aug 04 23:17:33.147760 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 284/543] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:32 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:33.348394 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a722d531-39d4-48c7-895a-29da5ece6ed3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:33.349086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a722d531-39d4-48c7-895a-29da5ece6ed3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:33.355638 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a722d531-39d4-48c7-895a-29da5ece6ed3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:33.356123 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a722d531-39d4-48c7-895a-29da5ece6ed3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:33.356561 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a722d531-39d4-48c7-895a-29da5ece6ed3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:33.357832 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a722d531-39d4-48c7-895a-29da5ece6ed3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:33.358384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a722d531-39d4-48c7-895a-29da5ece6ed3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:33.358920 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a722d531-39d4-48c7-895a-29da5ece6ed3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:33.442890 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c58777a4-ab90-47d0-aeb8-0451bae31a6b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:33.443522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c58777a4-ab90-47d0-aeb8-0451bae31a6b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:33.449786 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c58777a4-ab90-47d0-aeb8-0451bae31a6b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:33.453993 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c58777a4-ab90-47d0-aeb8-0451bae31a6b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:33.453993 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c58777a4-ab90-47d0-aeb8-0451bae31a6b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:33.453993 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c58777a4-ab90-47d0-aeb8-0451bae31a6b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:33.453993 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c58777a4-ab90-47d0-aeb8-0451bae31a6b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:33.454442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c58777a4-ab90-47d0-aeb8-0451bae31a6b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:33.534629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a722d531-39d4-48c7-895a-29da5ece6ed3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:33.542043 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a722d531-39d4-48c7-895a-29da5ece6ed3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.197632 Aug 04 23:17:33.542656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 260/544] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:33 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:33.605172 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c58777a4-ab90-47d0-aeb8-0451bae31a6b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:33.613235 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c58777a4-ab90-47d0-aeb8-0451bae31a6b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.174558 Aug 04 23:17:33.613786 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 285/545] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:33 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:17:34.172335 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ca1d4a72-4655-4531-877a-6438b302384a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:34.172934 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ca1d4a72-4655-4531-877a-6438b302384a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:34.178967 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca1d4a72-4655-4531-877a-6438b302384a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:34.179448 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca1d4a72-4655-4531-877a-6438b302384a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:34.179880 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca1d4a72-4655-4531-877a-6438b302384a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:34.180566 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca1d4a72-4655-4531-877a-6438b302384a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:34.181015 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca1d4a72-4655-4531-877a-6438b302384a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:34.181437 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca1d4a72-4655-4531-877a-6438b302384a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:34.318643 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ca1d4a72-4655-4531-877a-6438b302384a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:34.327723 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ca1d4a72-4655-4531-877a-6438b302384a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:34.329243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ca1d4a72-4655-4531-877a-6438b302384a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:34.330409 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ca1d4a72-4655-4531-877a-6438b302384a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1739 microversion: 2.20 time: 0.162544 Aug 04 23:17:34.330965 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 261/546] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:34 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:34.567058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-cc8c1678-6fd5-41d5-b343-f18dc6352b42 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:34.567640 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-cc8c1678-6fd5-41d5-b343-f18dc6352b42 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:34.573670 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc8c1678-6fd5-41d5-b343-f18dc6352b42 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:34.574155 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc8c1678-6fd5-41d5-b343-f18dc6352b42 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:34.574619 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc8c1678-6fd5-41d5-b343-f18dc6352b42 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:34.575318 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc8c1678-6fd5-41d5-b343-f18dc6352b42 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:34.575800 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc8c1678-6fd5-41d5-b343-f18dc6352b42 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:34.576463 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc8c1678-6fd5-41d5-b343-f18dc6352b42 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:34.634476 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-492d0789-9471-42b8-9376-5bc69dbea7c3 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:34.635072 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-492d0789-9471-42b8-9376-5bc69dbea7c3 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:34.641910 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-492d0789-9471-42b8-9376-5bc69dbea7c3 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:34.642401 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-492d0789-9471-42b8-9376-5bc69dbea7c3 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:34.642830 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-492d0789-9471-42b8-9376-5bc69dbea7c3 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:34.643531 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-492d0789-9471-42b8-9376-5bc69dbea7c3 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:34.643976 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-492d0789-9471-42b8-9376-5bc69dbea7c3 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:34.644390 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-492d0789-9471-42b8-9376-5bc69dbea7c3 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:34.761027 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cc8c1678-6fd5-41d5-b343-f18dc6352b42 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:34.769783 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-cc8c1678-6fd5-41d5-b343-f18dc6352b42 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.207458 Aug 04 23:17:34.770605 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 286/547] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:34 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:34.810458 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-492d0789-9471-42b8-9376-5bc69dbea7c3 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:34.818404 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-492d0789-9471-42b8-9376-5bc69dbea7c3 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.187697 Aug 04 23:17:34.818965 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 262/548] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:34 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:17:35.353347 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-727043f7-e90f-4d59-be42-6f8cdac0117d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:35.353949 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-727043f7-e90f-4d59-be42-6f8cdac0117d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:35.360394 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-727043f7-e90f-4d59-be42-6f8cdac0117d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:35.360874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-727043f7-e90f-4d59-be42-6f8cdac0117d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:35.361298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-727043f7-e90f-4d59-be42-6f8cdac0117d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:35.361990 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-727043f7-e90f-4d59-be42-6f8cdac0117d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:35.362485 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-727043f7-e90f-4d59-be42-6f8cdac0117d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:35.362904 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-727043f7-e90f-4d59-be42-6f8cdac0117d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:35.501470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-727043f7-e90f-4d59-be42-6f8cdac0117d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:35.509878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-727043f7-e90f-4d59-be42-6f8cdac0117d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:35.511415 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-727043f7-e90f-4d59-be42-6f8cdac0117d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:35.512556 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-727043f7-e90f-4d59-be42-6f8cdac0117d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1739 microversion: 2.20 time: 0.163136 Aug 04 23:17:35.513112 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 287/549] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:35 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:35.790260 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f271d6cc-a42e-42c9-9a92-1bccdaf7796e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:35.790930 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f271d6cc-a42e-42c9-9a92-1bccdaf7796e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:35.798076 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f271d6cc-a42e-42c9-9a92-1bccdaf7796e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:35.798591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f271d6cc-a42e-42c9-9a92-1bccdaf7796e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:35.799030 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f271d6cc-a42e-42c9-9a92-1bccdaf7796e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:35.799739 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f271d6cc-a42e-42c9-9a92-1bccdaf7796e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:35.800191 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f271d6cc-a42e-42c9-9a92-1bccdaf7796e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:35.800616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f271d6cc-a42e-42c9-9a92-1bccdaf7796e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:35.840427 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c312a208-33e7-44e6-8ed7-9da00a82c524 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:35.841027 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c312a208-33e7-44e6-8ed7-9da00a82c524 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:35.848363 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c312a208-33e7-44e6-8ed7-9da00a82c524 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:35.848843 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c312a208-33e7-44e6-8ed7-9da00a82c524 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:35.849266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c312a208-33e7-44e6-8ed7-9da00a82c524 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:35.849963 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c312a208-33e7-44e6-8ed7-9da00a82c524 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:35.850421 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c312a208-33e7-44e6-8ed7-9da00a82c524 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:35.850839 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c312a208-33e7-44e6-8ed7-9da00a82c524 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:36.009600 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f271d6cc-a42e-42c9-9a92-1bccdaf7796e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:36.019220 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f271d6cc-a42e-42c9-9a92-1bccdaf7796e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.232756 Aug 04 23:17:36.020184 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 263/550] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:35 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:36.038211 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c312a208-33e7-44e6-8ed7-9da00a82c524 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:36.052400 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c312a208-33e7-44e6-8ed7-9da00a82c524 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.215738 Aug 04 23:17:36.053359 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 288/551] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:35 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:36.536330 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-77df4366-cf47-473d-800e-cf8d1310ae9f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:36.536930 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-77df4366-cf47-473d-800e-cf8d1310ae9f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:36.542881 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77df4366-cf47-473d-800e-cf8d1310ae9f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:36.543342 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77df4366-cf47-473d-800e-cf8d1310ae9f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:36.543771 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77df4366-cf47-473d-800e-cf8d1310ae9f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:36.544988 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77df4366-cf47-473d-800e-cf8d1310ae9f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:36.545441 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77df4366-cf47-473d-800e-cf8d1310ae9f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:36.545862 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77df4366-cf47-473d-800e-cf8d1310ae9f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:36.693164 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-77df4366-cf47-473d-800e-cf8d1310ae9f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:36.702294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-77df4366-cf47-473d-800e-cf8d1310ae9f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:36.703846 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-77df4366-cf47-473d-800e-cf8d1310ae9f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:36.705008 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-77df4366-cf47-473d-800e-cf8d1310ae9f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1739 microversion: 2.20 time: 0.172646 Aug 04 23:17:36.705556 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 264/552] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:36 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:37.040979 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8e263768-8302-4405-924b-802a738eefd9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:37.041651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8e263768-8302-4405-924b-802a738eefd9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:37.047835 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e263768-8302-4405-924b-802a738eefd9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:37.048320 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e263768-8302-4405-924b-802a738eefd9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:37.048770 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e263768-8302-4405-924b-802a738eefd9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:37.049473 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e263768-8302-4405-924b-802a738eefd9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:37.049925 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e263768-8302-4405-924b-802a738eefd9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:37.050345 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e263768-8302-4405-924b-802a738eefd9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:37.072919 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1eb96db8-ba08-4676-a929-e9784cc4abb0 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:37.073542 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1eb96db8-ba08-4676-a929-e9784cc4abb0 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:37.081059 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1eb96db8-ba08-4676-a929-e9784cc4abb0 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:37.081545 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1eb96db8-ba08-4676-a929-e9784cc4abb0 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:37.081986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1eb96db8-ba08-4676-a929-e9784cc4abb0 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:37.082742 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1eb96db8-ba08-4676-a929-e9784cc4abb0 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:37.083196 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1eb96db8-ba08-4676-a929-e9784cc4abb0 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:37.083627 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1eb96db8-ba08-4676-a929-e9784cc4abb0 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:37.240780 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8e263768-8302-4405-924b-802a738eefd9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:37.250030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8e263768-8302-4405-924b-802a738eefd9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.212786 Aug 04 23:17:37.258671 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 289/553] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:37 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:37.269539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1eb96db8-ba08-4676-a929-e9784cc4abb0 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:37.277045 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1eb96db8-ba08-4676-a929-e9784cc4abb0 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.207911 Aug 04 23:17:37.277610 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 265/554] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:37 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:17:37.729178 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-db56ba90-b863-44b3-9a88-258c267a0e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:37.729866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-db56ba90-b863-44b3-9a88-258c267a0e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:37.736701 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-db56ba90-b863-44b3-9a88-258c267a0e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:37.737291 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-db56ba90-b863-44b3-9a88-258c267a0e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:37.737791 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-db56ba90-b863-44b3-9a88-258c267a0e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:37.738609 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-db56ba90-b863-44b3-9a88-258c267a0e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:37.739134 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-db56ba90-b863-44b3-9a88-258c267a0e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:37.739556 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-db56ba90-b863-44b3-9a88-258c267a0e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:37.880652 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-db56ba90-b863-44b3-9a88-258c267a0e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:37.889946 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-db56ba90-b863-44b3-9a88-258c267a0e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:37.891507 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-db56ba90-b863-44b3-9a88-258c267a0e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:37.892721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-db56ba90-b863-44b3-9a88-258c267a0e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1739 microversion: 2.20 time: 0.167632 Aug 04 23:17:37.893272 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 290/555] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:37 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:38.054545 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-323257f1-3736-439e-8a49-2a1899ccd034 req-0719e292-1c97-4616-b3c3-872f048a3687 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "159d56ac-e70e-41db-ae34-62cc0d59d9fe", "tag": "f7c9e9a4-d405-4289-bdbf-6033cb27920c"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:17:38.065386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-323257f1-3736-439e-8a49-2a1899ccd034 req-0719e292-1c97-4616-b3c3-872f048a3687 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:38.065865 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-323257f1-3736-439e-8a49-2a1899ccd034 req-0719e292-1c97-4616-b3c3-872f048a3687 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:38.066296 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-323257f1-3736-439e-8a49-2a1899ccd034 req-0719e292-1c97-4616-b3c3-872f048a3687 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:38.078573 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-323257f1-3736-439e-8a49-2a1899ccd034 req-0719e292-1c97-4616-b3c3-872f048a3687 service nova] Creating event network-changed:f7c9e9a4-d405-4289-bdbf-6033cb27920c for instance 159d56ac-e70e-41db-ae34-62cc0d59d9fe on hv-cinder-85221 Aug 04 23:17:38.083590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-323257f1-3736-439e-8a49-2a1899ccd034 req-0719e292-1c97-4616-b3c3-872f048a3687 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032992 Aug 04 23:17:38.084184 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 266/556] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:17:38.270560 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-966c74b1-252e-4ae9-ae90-d892451c544f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:38.271144 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-966c74b1-252e-4ae9-ae90-d892451c544f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:38.272964 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:17:38.278229 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-966c74b1-252e-4ae9-ae90-d892451c544f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:38.278666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-966c74b1-252e-4ae9-ae90-d892451c544f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:38.279180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-966c74b1-252e-4ae9-ae90-d892451c544f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:38.279874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-966c74b1-252e-4ae9-ae90-d892451c544f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:38.280317 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-966c74b1-252e-4ae9-ae90-d892451c544f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:38.280729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-966c74b1-252e-4ae9-ae90-d892451c544f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:38.297877 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-535bae56-5840-42d9-b555-dac87b633e0c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:38.298605 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-535bae56-5840-42d9-b555-dac87b633e0c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:38.304955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-535bae56-5840-42d9-b555-dac87b633e0c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:38.305443 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-535bae56-5840-42d9-b555-dac87b633e0c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:38.305880 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-535bae56-5840-42d9-b555-dac87b633e0c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:38.306675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-535bae56-5840-42d9-b555-dac87b633e0c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:38.307243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-535bae56-5840-42d9-b555-dac87b633e0c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:38.307673 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-535bae56-5840-42d9-b555-dac87b633e0c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:38.496516 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-966c74b1-252e-4ae9-ae90-d892451c544f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:38.499600 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-535bae56-5840-42d9-b555-dac87b633e0c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:38.504171 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-966c74b1-252e-4ae9-ae90-d892451c544f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.237393 Aug 04 23:17:38.504886 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 291/557] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:38 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:38.507287 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-535bae56-5840-42d9-b555-dac87b633e0c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.213530 Aug 04 23:17:38.507964 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 267/558] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:38 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:17:38.917150 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7361c847-a95d-4532-9e62-5757921c0b3b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:38.917776 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7361c847-a95d-4532-9e62-5757921c0b3b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:38.924440 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7361c847-a95d-4532-9e62-5757921c0b3b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:38.924912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7361c847-a95d-4532-9e62-5757921c0b3b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:38.925334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7361c847-a95d-4532-9e62-5757921c0b3b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:38.926018 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7361c847-a95d-4532-9e62-5757921c0b3b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:38.926483 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7361c847-a95d-4532-9e62-5757921c0b3b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:38.926899 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7361c847-a95d-4532-9e62-5757921c0b3b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:39.060852 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7361c847-a95d-4532-9e62-5757921c0b3b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:39.063235 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:17:39.070002 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7361c847-a95d-4532-9e62-5757921c0b3b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:39.071513 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7361c847-a95d-4532-9e62-5757921c0b3b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:39.072664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7361c847-a95d-4532-9e62-5757921c0b3b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1721 microversion: 2.20 time: 0.159462 Aug 04 23:17:39.073214 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 292/559] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:38 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:17:39.525593 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ff3cc48c-62c0-4779-b5e6-f13ddbe3d3ac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:39.526455 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ff3cc48c-62c0-4779-b5e6-f13ddbe3d3ac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:39.529633 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2bcc1c60-f019-4665-9d4b-c62a7cfce392 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:39.530885 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2bcc1c60-f019-4665-9d4b-c62a7cfce392 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:39.534277 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff3cc48c-62c0-4779-b5e6-f13ddbe3d3ac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:39.534805 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff3cc48c-62c0-4779-b5e6-f13ddbe3d3ac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:39.535243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff3cc48c-62c0-4779-b5e6-f13ddbe3d3ac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:39.536133 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff3cc48c-62c0-4779-b5e6-f13ddbe3d3ac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:39.536781 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff3cc48c-62c0-4779-b5e6-f13ddbe3d3ac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:39.537210 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff3cc48c-62c0-4779-b5e6-f13ddbe3d3ac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:39.537615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bcc1c60-f019-4665-9d4b-c62a7cfce392 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:39.538778 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bcc1c60-f019-4665-9d4b-c62a7cfce392 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:39.538778 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bcc1c60-f019-4665-9d4b-c62a7cfce392 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:39.539431 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bcc1c60-f019-4665-9d4b-c62a7cfce392 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:39.539957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bcc1c60-f019-4665-9d4b-c62a7cfce392 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:39.540434 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bcc1c60-f019-4665-9d4b-c62a7cfce392 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:39.570574 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:17:39.742123 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2bcc1c60-f019-4665-9d4b-c62a7cfce392 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:39.751072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2bcc1c60-f019-4665-9d4b-c62a7cfce392 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.225918 Aug 04 23:17:39.751665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 293/560] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:39 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:17:39.762864 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ff3cc48c-62c0-4779-b5e6-f13ddbe3d3ac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:39.771858 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ff3cc48c-62c0-4779-b5e6-f13ddbe3d3ac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1266 microversion: 2.1 time: 0.250543 Aug 04 23:17:39.772430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 268/561] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:39 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:40.097623 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6016bd39-e964-4f01-89c1-f1469bfcb488 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:40.098309 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6016bd39-e964-4f01-89c1-f1469bfcb488 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:40.104905 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6016bd39-e964-4f01-89c1-f1469bfcb488 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:40.105661 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6016bd39-e964-4f01-89c1-f1469bfcb488 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:40.106057 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6016bd39-e964-4f01-89c1-f1469bfcb488 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:40.106828 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6016bd39-e964-4f01-89c1-f1469bfcb488 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:40.108060 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6016bd39-e964-4f01-89c1-f1469bfcb488 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:40.108555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6016bd39-e964-4f01-89c1-f1469bfcb488 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:40.257707 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6016bd39-e964-4f01-89c1-f1469bfcb488 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:40.267789 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6016bd39-e964-4f01-89c1-f1469bfcb488 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:40.269512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6016bd39-e964-4f01-89c1-f1469bfcb488 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:40.270895 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6016bd39-e964-4f01-89c1-f1469bfcb488 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1721 microversion: 2.20 time: 0.177366 Aug 04 23:17:40.271486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 294/562] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:40 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:40.773149 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-428fd68a-e8d2-4a2e-942a-a49ae9a6fec9 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:40.773756 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-428fd68a-e8d2-4a2e-942a-a49ae9a6fec9 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:40.781686 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-428fd68a-e8d2-4a2e-942a-a49ae9a6fec9 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:40.782187 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-428fd68a-e8d2-4a2e-942a-a49ae9a6fec9 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:40.782736 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-428fd68a-e8d2-4a2e-942a-a49ae9a6fec9 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:40.783650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-428fd68a-e8d2-4a2e-942a-a49ae9a6fec9 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:40.784037 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-428fd68a-e8d2-4a2e-942a-a49ae9a6fec9 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:40.784517 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-428fd68a-e8d2-4a2e-942a-a49ae9a6fec9 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:40.796044 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1f4c4899-f30b-4fc6-bb6b-ab2bd60e6eaf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:40.796725 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1f4c4899-f30b-4fc6-bb6b-ab2bd60e6eaf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:40.802781 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f4c4899-f30b-4fc6-bb6b-ab2bd60e6eaf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:40.803353 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f4c4899-f30b-4fc6-bb6b-ab2bd60e6eaf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:40.803852 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f4c4899-f30b-4fc6-bb6b-ab2bd60e6eaf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:40.805240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f4c4899-f30b-4fc6-bb6b-ab2bd60e6eaf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:40.805880 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f4c4899-f30b-4fc6-bb6b-ab2bd60e6eaf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:40.806310 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f4c4899-f30b-4fc6-bb6b-ab2bd60e6eaf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:41.020279 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-428fd68a-e8d2-4a2e-942a-a49ae9a6fec9 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:41.028989 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-428fd68a-e8d2-4a2e-942a-a49ae9a6fec9 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.259687 Aug 04 23:17:41.031869 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1f4c4899-f30b-4fc6-bb6b-ab2bd60e6eaf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:41.038239 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 269/563] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:40 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:41.046686 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1f4c4899-f30b-4fc6-bb6b-ab2bd60e6eaf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1452 microversion: 2.1 time: 0.254666 Aug 04 23:17:41.047715 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 295/564] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:40 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1452 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:41.068182 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-887e4e47-25d3-463a-b878-1d22fa2f7eab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:41.068836 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-887e4e47-25d3-463a-b878-1d22fa2f7eab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:41.070771 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:17:41.080784 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-887e4e47-25d3-463a-b878-1d22fa2f7eab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:41.081645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-887e4e47-25d3-463a-b878-1d22fa2f7eab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:41.083578 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-887e4e47-25d3-463a-b878-1d22fa2f7eab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:41.084373 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-887e4e47-25d3-463a-b878-1d22fa2f7eab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:41.085169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-887e4e47-25d3-463a-b878-1d22fa2f7eab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:41.085705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-887e4e47-25d3-463a-b878-1d22fa2f7eab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:41.231986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-887e4e47-25d3-463a-b878-1d22fa2f7eab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:41.240969 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-887e4e47-25d3-463a-b878-1d22fa2f7eab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1452 microversion: 2.1 time: 0.177157 Aug 04 23:17:41.241539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 270/565] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:41 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1452 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:41.294316 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7daa81b5-bee2-4ade-8909-41f2f0bef9e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:41.295757 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7daa81b5-bee2-4ade-8909-41f2f0bef9e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:41.302240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7daa81b5-bee2-4ade-8909-41f2f0bef9e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:41.302772 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7daa81b5-bee2-4ade-8909-41f2f0bef9e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:41.303201 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7daa81b5-bee2-4ade-8909-41f2f0bef9e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:41.303908 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7daa81b5-bee2-4ade-8909-41f2f0bef9e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:41.304351 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7daa81b5-bee2-4ade-8909-41f2f0bef9e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:41.304765 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7daa81b5-bee2-4ade-8909-41f2f0bef9e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:41.495303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7daa81b5-bee2-4ade-8909-41f2f0bef9e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:41.503945 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7daa81b5-bee2-4ade-8909-41f2f0bef9e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:41.505599 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7daa81b5-bee2-4ade-8909-41f2f0bef9e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:41.506756 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7daa81b5-bee2-4ade-8909-41f2f0bef9e4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1721 microversion: 2.20 time: 0.216679 Aug 04 23:17:41.507306 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 296/566] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:41 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:42.053245 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-814193b3-87b5-41df-ad40-90f21d970dd6 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:42.053981 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-814193b3-87b5-41df-ad40-90f21d970dd6 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:42.062475 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-814193b3-87b5-41df-ad40-90f21d970dd6 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:42.062965 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-814193b3-87b5-41df-ad40-90f21d970dd6 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:42.063470 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-814193b3-87b5-41df-ad40-90f21d970dd6 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:42.064194 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-814193b3-87b5-41df-ad40-90f21d970dd6 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:42.064658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-814193b3-87b5-41df-ad40-90f21d970dd6 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:42.065341 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-814193b3-87b5-41df-ad40-90f21d970dd6 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:42.309993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-814193b3-87b5-41df-ad40-90f21d970dd6 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:42.318141 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-814193b3-87b5-41df-ad40-90f21d970dd6 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.269708 Aug 04 23:17:42.318752 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 271/567] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:42 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1358 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:42.487922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-877702af-d011-4afc-9ecd-b436b55d3d0d req-81100842-d171-464c-8227-5945401d7a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2013d923-81bb-4002-976d-64d3722b15d2", "name": "network-vif-unplugged", "status": "completed", "tag": "bae5f1bd-b332-4fbe-8c3e-7f38e098b71d"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:17:42.501022 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-877702af-d011-4afc-9ecd-b436b55d3d0d req-81100842-d171-464c-8227-5945401d7a13 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:42.501846 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-877702af-d011-4afc-9ecd-b436b55d3d0d req-81100842-d171-464c-8227-5945401d7a13 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:42.502615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-877702af-d011-4afc-9ecd-b436b55d3d0d req-81100842-d171-464c-8227-5945401d7a13 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:42.517473 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-877702af-d011-4afc-9ecd-b436b55d3d0d req-81100842-d171-464c-8227-5945401d7a13 service nova] Creating event network-vif-unplugged:bae5f1bd-b332-4fbe-8c3e-7f38e098b71d for instance 2013d923-81bb-4002-976d-64d3722b15d2 on hv-cinder-85221 Aug 04 23:17:42.523499 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-877702af-d011-4afc-9ecd-b436b55d3d0d req-81100842-d171-464c-8227-5945401d7a13 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039912 Aug 04 23:17:42.524510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 297/568] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:17:42.530104 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a5ebc496-9856-4aa8-a3f1-ecc95f246878 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:42.531150 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a5ebc496-9856-4aa8-a3f1-ecc95f246878 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:42.539377 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5ebc496-9856-4aa8-a3f1-ecc95f246878 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:42.539867 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5ebc496-9856-4aa8-a3f1-ecc95f246878 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:42.540489 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5ebc496-9856-4aa8-a3f1-ecc95f246878 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:42.541437 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5ebc496-9856-4aa8-a3f1-ecc95f246878 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:42.541935 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5ebc496-9856-4aa8-a3f1-ecc95f246878 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:42.542547 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5ebc496-9856-4aa8-a3f1-ecc95f246878 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:42.761734 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a5ebc496-9856-4aa8-a3f1-ecc95f246878 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:42.770161 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a5ebc496-9856-4aa8-a3f1-ecc95f246878 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:42.771775 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a5ebc496-9856-4aa8-a3f1-ecc95f246878 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:42.772948 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a5ebc496-9856-4aa8-a3f1-ecc95f246878 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1721 microversion: 2.20 time: 0.247053 Aug 04 23:17:42.773509 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 272/569] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:42 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:43.340828 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5afb25a4-e99c-4bca-a151-2193094db6a1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:43.342285 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5afb25a4-e99c-4bca-a151-2193094db6a1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:43.349312 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5afb25a4-e99c-4bca-a151-2193094db6a1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:43.349813 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5afb25a4-e99c-4bca-a151-2193094db6a1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:43.350265 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5afb25a4-e99c-4bca-a151-2193094db6a1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:43.351115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5afb25a4-e99c-4bca-a151-2193094db6a1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:43.351504 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5afb25a4-e99c-4bca-a151-2193094db6a1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:43.351930 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5afb25a4-e99c-4bca-a151-2193094db6a1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:43.553255 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5afb25a4-e99c-4bca-a151-2193094db6a1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:43.561365 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5afb25a4-e99c-4bca-a151-2193094db6a1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.225108 Aug 04 23:17:43.561945 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 298/570] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:43 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:43.659517 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-c319926f-15b2-4525-9459-9696f4b3985d req-6776b434-5dc1-48bc-a0f4-e2bf6c569ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5507ea1e-7623-46eb-9317-03688967021e", "tag": "77de594c-7c86-47c2-a1db-2cbb7ecc8978"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:17:43.669262 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-c319926f-15b2-4525-9459-9696f4b3985d req-6776b434-5dc1-48bc-a0f4-e2bf6c569ef6 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:43.670503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-c319926f-15b2-4525-9459-9696f4b3985d req-6776b434-5dc1-48bc-a0f4-e2bf6c569ef6 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:43.671773 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-c319926f-15b2-4525-9459-9696f4b3985d req-6776b434-5dc1-48bc-a0f4-e2bf6c569ef6 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:43.683536 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-c319926f-15b2-4525-9459-9696f4b3985d req-6776b434-5dc1-48bc-a0f4-e2bf6c569ef6 service nova] Creating event network-changed:77de594c-7c86-47c2-a1db-2cbb7ecc8978 for instance 5507ea1e-7623-46eb-9317-03688967021e on hv-cinder-85221 Aug 04 23:17:43.689256 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-c319926f-15b2-4525-9459-9696f4b3985d req-6776b434-5dc1-48bc-a0f4-e2bf6c569ef6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034045 Aug 04 23:17:43.689847 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 273/571] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:17:43.798243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b510da6f-3269-4e29-be47-98754db4c768 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:43.799155 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b510da6f-3269-4e29-be47-98754db4c768 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:43.809591 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b510da6f-3269-4e29-be47-98754db4c768 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:43.811687 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b510da6f-3269-4e29-be47-98754db4c768 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:43.812621 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b510da6f-3269-4e29-be47-98754db4c768 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:43.814034 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b510da6f-3269-4e29-be47-98754db4c768 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:43.815092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b510da6f-3269-4e29-be47-98754db4c768 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:43.815971 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b510da6f-3269-4e29-be47-98754db4c768 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:43.967879 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b510da6f-3269-4e29-be47-98754db4c768 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:43.977304 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b510da6f-3269-4e29-be47-98754db4c768 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:43.978988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b510da6f-3269-4e29-be47-98754db4c768 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:43.980166 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b510da6f-3269-4e29-be47-98754db4c768 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1721 microversion: 2.20 time: 0.186928 Aug 04 23:17:43.981065 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 299/572] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:43 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:17:44.596519 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5c1428ba-3335-4061-b9fd-c0324f72c3b8 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:44.598672 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5c1428ba-3335-4061-b9fd-c0324f72c3b8 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:44.608606 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c1428ba-3335-4061-b9fd-c0324f72c3b8 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:44.609220 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c1428ba-3335-4061-b9fd-c0324f72c3b8 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:44.609872 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c1428ba-3335-4061-b9fd-c0324f72c3b8 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:44.610631 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c1428ba-3335-4061-b9fd-c0324f72c3b8 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:44.611205 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c1428ba-3335-4061-b9fd-c0324f72c3b8 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:44.611691 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c1428ba-3335-4061-b9fd-c0324f72c3b8 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:44.927186 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5c1428ba-3335-4061-b9fd-c0324f72c3b8 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:44.936220 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5c1428ba-3335-4061-b9fd-c0324f72c3b8 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.348990 Aug 04 23:17:44.948828 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 274/573] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:44 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1358 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:17:45.006448 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-18b29c9c-892f-411a-bbb1-2d4f6637fe8d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:45.008025 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-18b29c9c-892f-411a-bbb1-2d4f6637fe8d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:45.015864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18b29c9c-892f-411a-bbb1-2d4f6637fe8d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:45.016356 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18b29c9c-892f-411a-bbb1-2d4f6637fe8d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:45.017042 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18b29c9c-892f-411a-bbb1-2d4f6637fe8d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:45.017738 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18b29c9c-892f-411a-bbb1-2d4f6637fe8d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:45.018188 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18b29c9c-892f-411a-bbb1-2d4f6637fe8d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:45.018654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18b29c9c-892f-411a-bbb1-2d4f6637fe8d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:45.200871 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-18b29c9c-892f-411a-bbb1-2d4f6637fe8d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:45.221100 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-18b29c9c-892f-411a-bbb1-2d4f6637fe8d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:45.226657 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-18b29c9c-892f-411a-bbb1-2d4f6637fe8d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:45.228000 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-18b29c9c-892f-411a-bbb1-2d4f6637fe8d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1721 microversion: 2.20 time: 0.227384 Aug 04 23:17:45.228606 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 300/574] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:44 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:17:45.957304 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-cc8a2860-eb30-4eb6-a74d-7727a0c9bb77 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:45.957903 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-cc8a2860-eb30-4eb6-a74d-7727a0c9bb77 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:45.964568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc8a2860-eb30-4eb6-a74d-7727a0c9bb77 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:45.965040 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc8a2860-eb30-4eb6-a74d-7727a0c9bb77 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:45.965470 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc8a2860-eb30-4eb6-a74d-7727a0c9bb77 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:45.966153 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc8a2860-eb30-4eb6-a74d-7727a0c9bb77 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:45.966660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc8a2860-eb30-4eb6-a74d-7727a0c9bb77 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:45.967082 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc8a2860-eb30-4eb6-a74d-7727a0c9bb77 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:46.105000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-cc8a2860-eb30-4eb6-a74d-7727a0c9bb77 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:46.113244 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-cc8a2860-eb30-4eb6-a74d-7727a0c9bb77 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.159777 Aug 04 23:17:46.113817 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 275/575] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:45 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:46.253913 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5f6bfd35-47c2-41e6-afcc-f729042bc08f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:46.254538 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5f6bfd35-47c2-41e6-afcc-f729042bc08f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:46.260675 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5f6bfd35-47c2-41e6-afcc-f729042bc08f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:46.261149 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5f6bfd35-47c2-41e6-afcc-f729042bc08f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:46.261576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5f6bfd35-47c2-41e6-afcc-f729042bc08f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:46.262262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5f6bfd35-47c2-41e6-afcc-f729042bc08f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:46.262730 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5f6bfd35-47c2-41e6-afcc-f729042bc08f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:46.263174 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5f6bfd35-47c2-41e6-afcc-f729042bc08f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:46.447515 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5f6bfd35-47c2-41e6-afcc-f729042bc08f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:46.457049 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5f6bfd35-47c2-41e6-afcc-f729042bc08f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:46.459368 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5f6bfd35-47c2-41e6-afcc-f729042bc08f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:46.460893 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5f6bfd35-47c2-41e6-afcc-f729042bc08f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1664 microversion: 2.20 time: 0.211950 Aug 04 23:17:46.461812 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 301/576] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:46 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1664 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:46.483903 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9d433a8e-b744-43ff-bf25-78788b7c6271 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec4feb6e-a14a-4412-a300-4da2f2848ed9"}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:17:46.486382 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9d433a8e-b744-43ff-bf25-78788b7c6271 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:46.492607 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d433a8e-b744-43ff-bf25-78788b7c6271 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:46.493099 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d433a8e-b744-43ff-bf25-78788b7c6271 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:46.493531 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d433a8e-b744-43ff-bf25-78788b7c6271 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:46.494236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d433a8e-b744-43ff-bf25-78788b7c6271 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:46.494715 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d433a8e-b744-43ff-bf25-78788b7c6271 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:46.495142 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d433a8e-b744-43ff-bf25-78788b7c6271 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:46.716833 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-cf05a38d-4d84-4de2-bbc7-032e98eeeb35 req-4d7cbb80-dd7e-4e81-b4fd-ad98b97ffd52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159d56ac-e70e-41db-ae34-62cc0d59d9fe", "name": "network-vif-plugged", "status": "completed", "tag": "f7c9e9a4-d405-4289-bdbf-6033cb27920c"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:17:46.728955 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-cf05a38d-4d84-4de2-bbc7-032e98eeeb35 req-4d7cbb80-dd7e-4e81-b4fd-ad98b97ffd52 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:46.729741 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-cf05a38d-4d84-4de2-bbc7-032e98eeeb35 req-4d7cbb80-dd7e-4e81-b4fd-ad98b97ffd52 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:46.730246 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-cf05a38d-4d84-4de2-bbc7-032e98eeeb35 req-4d7cbb80-dd7e-4e81-b4fd-ad98b97ffd52 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:46.744352 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-cf05a38d-4d84-4de2-bbc7-032e98eeeb35 req-4d7cbb80-dd7e-4e81-b4fd-ad98b97ffd52 service nova] Creating event network-vif-plugged:f7c9e9a4-d405-4289-bdbf-6033cb27920c for instance 159d56ac-e70e-41db-ae34-62cc0d59d9fe on hv-cinder-85221 Aug 04 23:17:46.750100 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-cf05a38d-4d84-4de2-bbc7-032e98eeeb35 req-4d7cbb80-dd7e-4e81-b4fd-ad98b97ffd52 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037764 Aug 04 23:17:46.751396 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 302/577] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:17:46.868965 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9d433a8e-b744-43ff-bf25-78788b7c6271 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "POST /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.387386 Aug 04 23:17:46.869731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 276/578] 10.222.0.33 () {62 vars in 1364 bytes} [Thu Aug 4 23:17:46 2022] POST /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2/os-volume_attachments => generated 188 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 23:17:47.007272 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e0b86845-6a83-4ea8-b736-6a944766db24 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:17:47.007947 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e0b86845-6a83-4ea8-b736-6a944766db24 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:47.014684 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0b86845-6a83-4ea8-b736-6a944766db24 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:47.015028 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0b86845-6a83-4ea8-b736-6a944766db24 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:47.015450 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0b86845-6a83-4ea8-b736-6a944766db24 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:47.016137 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0b86845-6a83-4ea8-b736-6a944766db24 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:47.016763 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0b86845-6a83-4ea8-b736-6a944766db24 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:47.017170 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0b86845-6a83-4ea8-b736-6a944766db24 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:47.063560 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e0b86845-6a83-4ea8-b736-6a944766db24 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129791) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 23:17:47.132157 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e0b86845-6a83-4ea8-b736-6a944766db24 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "POST /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2/action" status: 202 len: 0 microversion: 2.20 time: 0.128857 Aug 04 23:17:47.135546 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-cbc3b02a-10f8-419e-a5b1-a8f137ba3be2 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:47.136028 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 303/579] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Aug 4 23:17:47 2022] POST /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 23:17:47.136890 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-cbc3b02a-10f8-419e-a5b1-a8f137ba3be2 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:47.141812 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e6eed0da-3edb-4d8d-8c4a-25b979326eb2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:47.142448 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e6eed0da-3edb-4d8d-8c4a-25b979326eb2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:47.146626 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cbc3b02a-10f8-419e-a5b1-a8f137ba3be2 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:47.147181 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cbc3b02a-10f8-419e-a5b1-a8f137ba3be2 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:47.147680 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cbc3b02a-10f8-419e-a5b1-a8f137ba3be2 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:47.148573 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cbc3b02a-10f8-419e-a5b1-a8f137ba3be2 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:47.149099 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6eed0da-3edb-4d8d-8c4a-25b979326eb2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:47.149219 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cbc3b02a-10f8-419e-a5b1-a8f137ba3be2 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:47.149576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6eed0da-3edb-4d8d-8c4a-25b979326eb2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:47.149695 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cbc3b02a-10f8-419e-a5b1-a8f137ba3be2 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:47.149999 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6eed0da-3edb-4d8d-8c4a-25b979326eb2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:47.150712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6eed0da-3edb-4d8d-8c4a-25b979326eb2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:47.151154 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6eed0da-3edb-4d8d-8c4a-25b979326eb2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:47.151566 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6eed0da-3edb-4d8d-8c4a-25b979326eb2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:47.378235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-cbc3b02a-10f8-419e-a5b1-a8f137ba3be2 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:47.379478 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e6eed0da-3edb-4d8d-8c4a-25b979326eb2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:47.389394 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-cbc3b02a-10f8-419e-a5b1-a8f137ba3be2 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.257442 Aug 04 23:17:47.389606 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e6eed0da-3edb-4d8d-8c4a-25b979326eb2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:47.391140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e6eed0da-3edb-4d8d-8c4a-25b979326eb2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:47.392403 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e6eed0da-3edb-4d8d-8c4a-25b979326eb2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1750 microversion: 2.20 time: 0.255804 Aug 04 23:17:47.392955 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 304/580] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:47 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1750 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:47.404941 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 277/581] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:47 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:17:48.411824 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9828a801-5e2e-4917-8717-c0406e176a8b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:48.412884 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9828a801-5e2e-4917-8717-c0406e176a8b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:48.418032 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f2b09af7-e24f-4652-88c5-a340b61be1dc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:48.420059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f2b09af7-e24f-4652-88c5-a340b61be1dc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:48.422545 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9828a801-5e2e-4917-8717-c0406e176a8b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:48.422833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9828a801-5e2e-4917-8717-c0406e176a8b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:48.423242 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9828a801-5e2e-4917-8717-c0406e176a8b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:48.425683 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9828a801-5e2e-4917-8717-c0406e176a8b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:48.426168 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9828a801-5e2e-4917-8717-c0406e176a8b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:48.426561 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f2b09af7-e24f-4652-88c5-a340b61be1dc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:48.426717 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9828a801-5e2e-4917-8717-c0406e176a8b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:48.427051 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f2b09af7-e24f-4652-88c5-a340b61be1dc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:48.427486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f2b09af7-e24f-4652-88c5-a340b61be1dc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:48.428221 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f2b09af7-e24f-4652-88c5-a340b61be1dc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:48.428686 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f2b09af7-e24f-4652-88c5-a340b61be1dc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:48.429100 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f2b09af7-e24f-4652-88c5-a340b61be1dc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:48.649509 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f2b09af7-e24f-4652-88c5-a340b61be1dc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:48.653360 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9828a801-5e2e-4917-8717-c0406e176a8b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:48.658526 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f2b09af7-e24f-4652-88c5-a340b61be1dc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:48.660052 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f2b09af7-e24f-4652-88c5-a340b61be1dc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:48.661132 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9828a801-5e2e-4917-8717-c0406e176a8b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1358 microversion: 2.1 time: 0.253480 Aug 04 23:17:48.661249 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f2b09af7-e24f-4652-88c5-a340b61be1dc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1752 microversion: 2.20 time: 0.248829 Aug 04 23:17:48.661739 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 305/582] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:48 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1752 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:17:48.662003 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 278/583] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:48 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:49.682268 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ccff05ea-2dda-4abb-bf1c-aa8b2405d561 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:49.682917 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ccff05ea-2dda-4abb-bf1c-aa8b2405d561 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:49.686004 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-79d47ce8-0abe-4a13-8b94-e05514095b27 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:49.687372 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-79d47ce8-0abe-4a13-8b94-e05514095b27 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:49.690563 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ccff05ea-2dda-4abb-bf1c-aa8b2405d561 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:49.691037 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ccff05ea-2dda-4abb-bf1c-aa8b2405d561 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:49.691459 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ccff05ea-2dda-4abb-bf1c-aa8b2405d561 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:49.692150 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ccff05ea-2dda-4abb-bf1c-aa8b2405d561 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:49.692583 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ccff05ea-2dda-4abb-bf1c-aa8b2405d561 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:49.693188 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ccff05ea-2dda-4abb-bf1c-aa8b2405d561 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:49.694400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-79d47ce8-0abe-4a13-8b94-e05514095b27 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:49.694865 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-79d47ce8-0abe-4a13-8b94-e05514095b27 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:49.695298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-79d47ce8-0abe-4a13-8b94-e05514095b27 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:49.696006 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-79d47ce8-0abe-4a13-8b94-e05514095b27 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:49.696451 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-79d47ce8-0abe-4a13-8b94-e05514095b27 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:49.697205 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-79d47ce8-0abe-4a13-8b94-e05514095b27 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:49.908732 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ccff05ea-2dda-4abb-bf1c-aa8b2405d561 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:49.910119 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-79d47ce8-0abe-4a13-8b94-e05514095b27 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:49.917187 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ccff05ea-2dda-4abb-bf1c-aa8b2405d561 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1548 microversion: 2.1 time: 0.238908 Aug 04 23:17:49.917769 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 306/584] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:49 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1548 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:49.919196 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-79d47ce8-0abe-4a13-8b94-e05514095b27 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:49.920774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-79d47ce8-0abe-4a13-8b94-e05514095b27 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:49.922019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-79d47ce8-0abe-4a13-8b94-e05514095b27 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1808 microversion: 2.20 time: 0.240772 Aug 04 23:17:49.922714 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 279/585] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:49 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:17:49.937594 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2c3caa0c-1190-4d53-b246-41baf7308937 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:49.938107 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2c3caa0c-1190-4d53-b246-41baf7308937 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:49.943987 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c3caa0c-1190-4d53-b246-41baf7308937 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:49.944529 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c3caa0c-1190-4d53-b246-41baf7308937 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:49.944956 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c3caa0c-1190-4d53-b246-41baf7308937 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:49.945644 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c3caa0c-1190-4d53-b246-41baf7308937 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:49.946088 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c3caa0c-1190-4d53-b246-41baf7308937 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:49.946571 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c3caa0c-1190-4d53-b246-41baf7308937 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:50.085541 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2c3caa0c-1190-4d53-b246-41baf7308937 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:50.094721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2c3caa0c-1190-4d53-b246-41baf7308937 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1548 microversion: 2.1 time: 0.161030 Aug 04 23:17:50.095279 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 307/586] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:49 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:50.115223 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a501add2-7e19-4feb-877f-7950d230d9cf tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:50.119913 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a501add2-7e19-4feb-877f-7950d230d9cf tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:50.120669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a501add2-7e19-4feb-877f-7950d230d9cf tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Searching by: {'deleted': False, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1'} {{(pid=129790) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 23:17:50.128508 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a501add2-7e19-4feb-877f-7950d230d9cf tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:50.128986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a501add2-7e19-4feb-877f-7950d230d9cf tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:50.129408 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a501add2-7e19-4feb-877f-7950d230d9cf tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:50.130120 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a501add2-7e19-4feb-877f-7950d230d9cf tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:50.130595 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a501add2-7e19-4feb-877f-7950d230d9cf tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:50.131011 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a501add2-7e19-4feb-877f-7950d230d9cf tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:50.225248 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.multi_cell_list [None req-a501add2-7e19-4feb-877f-7950d230d9cf tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129790) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 23:17:50.319865 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a501add2-7e19-4feb-877f-7950d230d9cf tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.208246 Aug 04 23:17:50.320459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 280/587] 10.222.0.33 () {58 vars in 1125 bytes} [Thu Aug 4 23:17:50 2022] GET /compute/v2.1/servers => generated 343 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:17:50.331828 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-96be5a63-7acf-4cab-8078-abd60679d3a2 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:50.332439 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-96be5a63-7acf-4cab-8078-abd60679d3a2 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:50.338814 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96be5a63-7acf-4cab-8078-abd60679d3a2 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:50.339336 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96be5a63-7acf-4cab-8078-abd60679d3a2 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:50.339722 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96be5a63-7acf-4cab-8078-abd60679d3a2 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:50.340416 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96be5a63-7acf-4cab-8078-abd60679d3a2 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:50.341047 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96be5a63-7acf-4cab-8078-abd60679d3a2 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:50.342060 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96be5a63-7acf-4cab-8078-abd60679d3a2 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:50.484312 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-96be5a63-7acf-4cab-8078-abd60679d3a2 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:50.492215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-96be5a63-7acf-4cab-8078-abd60679d3a2 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1548 microversion: 2.1 time: 0.164153 Aug 04 23:17:50.492896 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 308/588] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:17:50 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:17:50.660203 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-fbcecbc2-5371-4bd7-9d62-3dd6f128f8bb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c836dab1-62d9-4b8e-b0e6-3ede1b45f2ff"}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:17:50.663229 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-fbcecbc2-5371-4bd7-9d62-3dd6f128f8bb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:50.671236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbcecbc2-5371-4bd7-9d62-3dd6f128f8bb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:50.672630 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbcecbc2-5371-4bd7-9d62-3dd6f128f8bb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:50.673066 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbcecbc2-5371-4bd7-9d62-3dd6f128f8bb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:50.673935 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbcecbc2-5371-4bd7-9d62-3dd6f128f8bb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:50.674601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbcecbc2-5371-4bd7-9d62-3dd6f128f8bb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:50.675272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbcecbc2-5371-4bd7-9d62-3dd6f128f8bb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:50.945231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-87e978af-0a2e-41d9-bd0b-01e43ea3e91b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:17:50.945926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-87e978af-0a2e-41d9-bd0b-01e43ea3e91b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:50.956031 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-87e978af-0a2e-41d9-bd0b-01e43ea3e91b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:50.956822 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-87e978af-0a2e-41d9-bd0b-01e43ea3e91b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:50.957263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-87e978af-0a2e-41d9-bd0b-01e43ea3e91b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:50.958065 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-87e978af-0a2e-41d9-bd0b-01e43ea3e91b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:50.958615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-87e978af-0a2e-41d9-bd0b-01e43ea3e91b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:50.959431 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-87e978af-0a2e-41d9-bd0b-01e43ea3e91b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:51.146293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-87e978af-0a2e-41d9-bd0b-01e43ea3e91b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:51.162720 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:17:51.162720 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-87e978af-0a2e-41d9-bd0b-01e43ea3e91b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:51.168312 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-87e978af-0a2e-41d9-bd0b-01e43ea3e91b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:17:51.174303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-87e978af-0a2e-41d9-bd0b-01e43ea3e91b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1808 microversion: 2.20 time: 0.233002 Aug 04 23:17:51.177640 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 309/589] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:17:50 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:17:52.154192 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-05aa3f42-a4ad-43aa-9385-a68b47f4f17f tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcd9ebe8-281e-4e7c-9fa9-6c127d07738a"}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:17:52.158662 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-05aa3f42-a4ad-43aa-9385-a68b47f4f17f tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:17:52.168362 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05aa3f42-a4ad-43aa-9385-a68b47f4f17f tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:52.168865 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05aa3f42-a4ad-43aa-9385-a68b47f4f17f tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:52.169433 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05aa3f42-a4ad-43aa-9385-a68b47f4f17f tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:17:52.170782 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05aa3f42-a4ad-43aa-9385-a68b47f4f17f tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:17:52.170782 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05aa3f42-a4ad-43aa-9385-a68b47f4f17f tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:17:52.171123 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05aa3f42-a4ad-43aa-9385-a68b47f4f17f tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:00.164163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=2 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:18:00.669408 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=23 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:18:00.804591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:18:02.165756 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:18:02.253012 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=7 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:18:04.561421 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-05aa3f42-a4ad-43aa-9385-a68b47f4f17f tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "POST /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.411133 Aug 04 23:18:04.562666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 310/590] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Aug 4 23:17:52 2022] POST /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe/os-volume_attachments => generated 194 bytes in 12413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:18:04.709532 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-097beb4d-6da7-4ea1-a9f4-c2abd153961f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:04.710334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-097beb4d-6da7-4ea1-a9f4-c2abd153961f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:04.717985 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-097beb4d-6da7-4ea1-a9f4-c2abd153961f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:04.718423 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-097beb4d-6da7-4ea1-a9f4-c2abd153961f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:04.719144 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-097beb4d-6da7-4ea1-a9f4-c2abd153961f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:04.719932 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-097beb4d-6da7-4ea1-a9f4-c2abd153961f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:04.720394 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-097beb4d-6da7-4ea1-a9f4-c2abd153961f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:04.721014 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-097beb4d-6da7-4ea1-a9f4-c2abd153961f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:04.744649 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-fbcecbc2-5371-4bd7-9d62-3dd6f128f8bb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "POST /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.088813 Aug 04 23:18:04.745584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 281/591] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Aug 4 23:17:50 2022] POST /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48/os-volume_attachments => generated 194 bytes in 14091 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:18:04.890605 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-097beb4d-6da7-4ea1-a9f4-c2abd153961f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:04.899368 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-097beb4d-6da7-4ea1-a9f4-c2abd153961f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:04.900857 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-097beb4d-6da7-4ea1-a9f4-c2abd153961f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:04.902001 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-097beb4d-6da7-4ea1-a9f4-c2abd153961f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1808 microversion: 2.20 time: 0.338217 Aug 04 23:18:04.902582 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 311/592] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:18:04 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1808 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:18:05.928540 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ac4c3107-a4dc-4237-b9ef-9d26824e4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:05.929261 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ac4c3107-a4dc-4237-b9ef-9d26824e4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:05.935808 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac4c3107-a4dc-4237-b9ef-9d26824e4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:05.936839 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac4c3107-a4dc-4237-b9ef-9d26824e4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:05.937293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac4c3107-a4dc-4237-b9ef-9d26824e4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:05.938010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac4c3107-a4dc-4237-b9ef-9d26824e4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:05.938493 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac4c3107-a4dc-4237-b9ef-9d26824e4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:05.938918 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac4c3107-a4dc-4237-b9ef-9d26824e4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:06.086266 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ac4c3107-a4dc-4237-b9ef-9d26824e4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:06.096165 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ac4c3107-a4dc-4237-b9ef-9d26824e4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:06.097679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ac4c3107-a4dc-4237-b9ef-9d26824e4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:06.098888 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ac4c3107-a4dc-4237-b9ef-9d26824e4bf2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1808 microversion: 2.20 time: 0.175238 Aug 04 23:18:06.099664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 282/593] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:18:05 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:18:07.122130 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d893c816-63bd-456d-80d1-dfd35ddb557d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:07.122931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d893c816-63bd-456d-80d1-dfd35ddb557d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:07.130166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d893c816-63bd-456d-80d1-dfd35ddb557d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:07.130686 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d893c816-63bd-456d-80d1-dfd35ddb557d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:07.131120 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d893c816-63bd-456d-80d1-dfd35ddb557d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:07.131825 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d893c816-63bd-456d-80d1-dfd35ddb557d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:07.132271 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d893c816-63bd-456d-80d1-dfd35ddb557d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:07.132694 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d893c816-63bd-456d-80d1-dfd35ddb557d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:07.193567 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8293eaec-e417-4e83-88eb-01e172231308 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:07.194281 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8293eaec-e417-4e83-88eb-01e172231308 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:07.200223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8293eaec-e417-4e83-88eb-01e172231308 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:07.200705 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8293eaec-e417-4e83-88eb-01e172231308 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:07.201139 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8293eaec-e417-4e83-88eb-01e172231308 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:07.202477 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8293eaec-e417-4e83-88eb-01e172231308 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:07.202931 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8293eaec-e417-4e83-88eb-01e172231308 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:07.203350 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8293eaec-e417-4e83-88eb-01e172231308 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:07.228709 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8293eaec-e417-4e83-88eb-01e172231308 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f/ips" status: 200 len: 151 microversion: 2.1 time: 0.149282 Aug 04 23:18:07.229276 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 312/594] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Aug 4 23:18:07 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f/ips => generated 151 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:18:07.241297 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-406cbf63-49fc-4ddd-97e2-d83fe0e73da4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d8a4f39-7a1a-4b16-8dff-23113c2c52ae"}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:18:07.243979 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-406cbf63-49fc-4ddd-97e2-d83fe0e73da4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:07.250786 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-406cbf63-49fc-4ddd-97e2-d83fe0e73da4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:07.251280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-406cbf63-49fc-4ddd-97e2-d83fe0e73da4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:07.251713 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-406cbf63-49fc-4ddd-97e2-d83fe0e73da4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:07.252423 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-406cbf63-49fc-4ddd-97e2-d83fe0e73da4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:07.252873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-406cbf63-49fc-4ddd-97e2-d83fe0e73da4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:07.253294 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-406cbf63-49fc-4ddd-97e2-d83fe0e73da4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:07.276193 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d893c816-63bd-456d-80d1-dfd35ddb557d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:07.285058 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d893c816-63bd-456d-80d1-dfd35ddb557d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:07.286555 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d893c816-63bd-456d-80d1-dfd35ddb557d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:07.287706 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d893c816-63bd-456d-80d1-dfd35ddb557d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1808 microversion: 2.20 time: 0.169475 Aug 04 23:18:07.288270 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 283/595] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:18:07 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:18:07.331749 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-406cbf63-49fc-4ddd-97e2-d83fe0e73da4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] HTTP exception thrown: Invalid volume: volume 6d8a4f39-7a1a-4b16-8dff-23113c2c52ae is already attached to instances: 852287f5-010e-4d74-a6ef-a4bf2f47c477 Aug 04 23:18:07.333711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-406cbf63-49fc-4ddd-97e2-d83fe0e73da4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Request method failure captured: Aug 04 23:18:07.333711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: POST /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f/os-volume_attachments HTTP/1.1 Aug 04 23:18:07.333711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:18:07.333711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:18:07.333711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:18:07.333711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 74 Aug 04 23:18:07.333711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:18:07.333711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:18:07.333711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:18:07.333711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:18:07.333711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FJxolWXoCq7pteacc3wSoOFRBafzn5l-VFi74XBW7wvTawbOokhRmWW1PKP-C_VKEwuqozn26yg856JLZkvKXgHW09fl1p22BiGh5nneUxE7kKr1M8fWXZ4OILMJgqixZXLBIGcxsElt638y0EWPGUaTW1AOdHEnKwXTKYRir1dpV4 Aug 04 23:18:07.333711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:18:07.333711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:18:07.333711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:18:07.333711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:18:07.333711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:18:07.333711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:18:07.333711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:18:07.333711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:18:07.333711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:18:07.333711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:18:07.335337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0422afbb853d4ef2924edf221499971c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0422afbb853d4ef2924edf221499971c"}]}] Aug 04 23:18:07.335337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:18:07.335337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:18:07.335337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:18:07.335337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:18:07.335337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:18:07.335337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:18:07.335337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: b2ceb35afcc046218bdce1ab4983d9f9 Aug 04 23:18:07.335337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:18:07.335337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Aug 04 23:18:07.335337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {"volumeAttachment": {"volumeId": "6d8a4f39-7a1a-4b16-8dff-23113c2c52ae"}} Aug 04 23:18:07.335337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: > Aug 04 23:18:07.336270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Invalid volume: volume 6d8a4f39-7a1a-4b16-8dff-23113c2c52ae is already attached to instances: 852287f5-010e-4d74-a6ef-a4bf2f47c477 Aug 04 23:18:07.336270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'server_id': 'fcc205d5-c1d3-4f3d-a37f-af9769b7067f', 'body': {'volumeAttachment': {'volumeId': '6d8a4f39-7a1a-4b16-8dff-23113c2c52ae'}}} Aug 04 23:18:07.336270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:18:07.336270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:18:07.336270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 23:18:07.336270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 23:18:07.336270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 23:18:07.336270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 23:18:07.336270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 23:18:07.336270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 23:18:07.336270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 23:18:07.336270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 23:18:07.336270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 23:18:07.336270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 23:18:07.336270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6d8a4f39-7a1a-4b16-8dff-23113c2c52ae is already attached to instances: 852287f5-010e-4d74-a6ef-a4bf2f47c477 Aug 04 23:18:07.336270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:18:07.336270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:18:07.336270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:18:07.336270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:18:07.337442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:18:07.337442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:18:07.337442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:18:07.337442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:18:07.337442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:18:07.337442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:18:07.337442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 23:18:07.337442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 23:18:07.337442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 23:18:07.337442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 23:18:07.337442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 23:18:07.337442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 23:18:07.337442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 23:18:07.337442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 23:18:07.337442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6d8a4f39-7a1a-4b16-8dff-23113c2c52ae is already attached to instances: 852287f5-010e-4d74-a6ef-a4bf2f47c477 Aug 04 23:18:07.337442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:18:07.337442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:18:07.337442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:18:07.337442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:18:07.337442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:18:07.338927 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:18:07.338927 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:18:07.338927 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:18:07.338927 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6d8a4f39-7a1a-4b16-8dff-23113c2c52ae is already attached to instances: 852287f5-010e-4d74-a6ef-a4bf2f47c477 Aug 04 23:18:07.338927 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:18:07.338927 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-406cbf63-49fc-4ddd-97e2-d83fe0e73da4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Returning 400 to user: Invalid volume: volume 6d8a4f39-7a1a-4b16-8dff-23113c2c52ae is already attached to instances: 852287f5-010e-4d74-a6ef-a4bf2f47c477 {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:18:07.338927 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-406cbf63-49fc-4ddd-97e2-d83fe0e73da4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "POST /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097949 Aug 04 23:18:07.338927 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 313/596] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Aug 4 23:18:07 2022] POST /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 23:18:07.344890 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3b765e94-50bc-4061-923f-527bb5661846 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:07.345385 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3b765e94-50bc-4061-923f-527bb5661846 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:07.351298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b765e94-50bc-4061-923f-527bb5661846 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:07.351775 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b765e94-50bc-4061-923f-527bb5661846 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:07.352206 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b765e94-50bc-4061-923f-527bb5661846 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:07.352893 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b765e94-50bc-4061-923f-527bb5661846 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:07.353343 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b765e94-50bc-4061-923f-527bb5661846 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:07.353761 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b765e94-50bc-4061-923f-527bb5661846 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:07.380144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3b765e94-50bc-4061-923f-527bb5661846 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Going to try to terminate instance {{(pid=129790) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 23:18:07.456927 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3b765e94-50bc-4061-923f-527bb5661846 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 204 len: 0 microversion: 2.1 time: 0.116023 Aug 04 23:18:07.457500 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 284/597] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:18:07 2022] DELETE /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 23:18:07.466386 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ae42796e-3f80-41ad-995b-44b5e36e4e50 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:07.467002 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ae42796e-3f80-41ad-995b-44b5e36e4e50 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:07.473691 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae42796e-3f80-41ad-995b-44b5e36e4e50 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:07.474168 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae42796e-3f80-41ad-995b-44b5e36e4e50 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:07.474623 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae42796e-3f80-41ad-995b-44b5e36e4e50 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:07.475350 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae42796e-3f80-41ad-995b-44b5e36e4e50 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:07.475795 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae42796e-3f80-41ad-995b-44b5e36e4e50 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:07.476207 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae42796e-3f80-41ad-995b-44b5e36e4e50 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:07.616039 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ae42796e-3f80-41ad-995b-44b5e36e4e50 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:07.625649 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ae42796e-3f80-41ad-995b-44b5e36e4e50 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 200 len: 1684 microversion: 2.1 time: 0.163490 Aug 04 23:18:07.626550 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 314/598] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:07 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:18:08.312810 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-adb5fc98-66f2-4b0a-aa80-1daab04f5314 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:08.313707 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-adb5fc98-66f2-4b0a-aa80-1daab04f5314 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:08.320106 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-adb5fc98-66f2-4b0a-aa80-1daab04f5314 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:08.320593 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-adb5fc98-66f2-4b0a-aa80-1daab04f5314 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:08.321025 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-adb5fc98-66f2-4b0a-aa80-1daab04f5314 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:08.321738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-adb5fc98-66f2-4b0a-aa80-1daab04f5314 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:08.322191 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-adb5fc98-66f2-4b0a-aa80-1daab04f5314 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:08.322644 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-adb5fc98-66f2-4b0a-aa80-1daab04f5314 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:08.461738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-adb5fc98-66f2-4b0a-aa80-1daab04f5314 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:08.471884 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-adb5fc98-66f2-4b0a-aa80-1daab04f5314 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:08.473381 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-adb5fc98-66f2-4b0a-aa80-1daab04f5314 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:08.474590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-adb5fc98-66f2-4b0a-aa80-1daab04f5314 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1808 microversion: 2.20 time: 0.166575 Aug 04 23:18:08.475146 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 285/599] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:18:08 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:18:08.647204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b33aebcd-203d-4824-8460-26ad33e79802 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:08.647723 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b33aebcd-203d-4824-8460-26ad33e79802 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:08.654133 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b33aebcd-203d-4824-8460-26ad33e79802 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:08.654644 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b33aebcd-203d-4824-8460-26ad33e79802 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:08.655671 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b33aebcd-203d-4824-8460-26ad33e79802 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:08.656372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b33aebcd-203d-4824-8460-26ad33e79802 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:08.656829 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b33aebcd-203d-4824-8460-26ad33e79802 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:08.657247 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b33aebcd-203d-4824-8460-26ad33e79802 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:08.790156 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b33aebcd-203d-4824-8460-26ad33e79802 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:08.798711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b33aebcd-203d-4824-8460-26ad33e79802 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 200 len: 1684 microversion: 2.1 time: 0.155445 Aug 04 23:18:08.799279 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 315/600] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:08 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:09.497118 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2cc0d93b-43aa-4f4b-82b5-e657b303fd63 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:09.497721 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2cc0d93b-43aa-4f4b-82b5-e657b303fd63 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:09.504294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2cc0d93b-43aa-4f4b-82b5-e657b303fd63 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:09.504778 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2cc0d93b-43aa-4f4b-82b5-e657b303fd63 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:09.505204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2cc0d93b-43aa-4f4b-82b5-e657b303fd63 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:09.505899 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2cc0d93b-43aa-4f4b-82b5-e657b303fd63 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:09.506776 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2cc0d93b-43aa-4f4b-82b5-e657b303fd63 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:09.506776 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2cc0d93b-43aa-4f4b-82b5-e657b303fd63 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:09.661985 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2cc0d93b-43aa-4f4b-82b5-e657b303fd63 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:09.671355 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2cc0d93b-43aa-4f4b-82b5-e657b303fd63 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:09.673312 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2cc0d93b-43aa-4f4b-82b5-e657b303fd63 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:09.674524 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2cc0d93b-43aa-4f4b-82b5-e657b303fd63 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1808 microversion: 2.20 time: 0.181247 Aug 04 23:18:09.675150 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 286/601] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:18:09 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:18:09.822207 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c66e6004-8f53-4632-811f-9725a77f5261 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:09.822870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c66e6004-8f53-4632-811f-9725a77f5261 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:09.830194 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c66e6004-8f53-4632-811f-9725a77f5261 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:09.830724 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c66e6004-8f53-4632-811f-9725a77f5261 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:09.831276 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c66e6004-8f53-4632-811f-9725a77f5261 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:09.831980 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c66e6004-8f53-4632-811f-9725a77f5261 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:09.832371 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c66e6004-8f53-4632-811f-9725a77f5261 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:09.832863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c66e6004-8f53-4632-811f-9725a77f5261 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:09.984060 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c66e6004-8f53-4632-811f-9725a77f5261 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:09.996396 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c66e6004-8f53-4632-811f-9725a77f5261 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 200 len: 1684 microversion: 2.1 time: 0.178913 Aug 04 23:18:09.997115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 316/602] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:09 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 1684 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:10.573779 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-68741e00-debd-4b56-9b66-ade22c301b48 req-afbb7281-caee-4175-a935-46012721c434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc205d5-c1d3-4f3d-a37f-af9769b7067f", "name": "network-vif-deleted", "tag": "92c1d7ad-c2a7-4f80-a282-fafe6db674a6"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:18:10.590983 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-68741e00-debd-4b56-9b66-ade22c301b48 req-afbb7281-caee-4175-a935-46012721c434 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:10.591463 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-68741e00-debd-4b56-9b66-ade22c301b48 req-afbb7281-caee-4175-a935-46012721c434 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:10.591888 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-68741e00-debd-4b56-9b66-ade22c301b48 req-afbb7281-caee-4175-a935-46012721c434 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:10.606510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-68741e00-debd-4b56-9b66-ade22c301b48 req-afbb7281-caee-4175-a935-46012721c434 service nova] Creating event network-vif-deleted:92c1d7ad-c2a7-4f80-a282-fafe6db674a6 for instance fcc205d5-c1d3-4f3d-a37f-af9769b7067f on hv-cinder-85221 Aug 04 23:18:10.612683 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-68741e00-debd-4b56-9b66-ade22c301b48 req-afbb7281-caee-4175-a935-46012721c434 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048921 Aug 04 23:18:10.613601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 287/603] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:18:10.698756 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0848251d-5c2c-4592-ab98-e4918421916e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:10.699726 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0848251d-5c2c-4592-ab98-e4918421916e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:10.707277 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0848251d-5c2c-4592-ab98-e4918421916e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:10.707906 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0848251d-5c2c-4592-ab98-e4918421916e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:10.708415 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0848251d-5c2c-4592-ab98-e4918421916e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:10.709286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0848251d-5c2c-4592-ab98-e4918421916e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:10.710093 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0848251d-5c2c-4592-ab98-e4918421916e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:10.710531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0848251d-5c2c-4592-ab98-e4918421916e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:10.887343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0848251d-5c2c-4592-ab98-e4918421916e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:10.896684 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0848251d-5c2c-4592-ab98-e4918421916e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:10.898170 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0848251d-5c2c-4592-ab98-e4918421916e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:10.899352 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0848251d-5c2c-4592-ab98-e4918421916e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1808 microversion: 2.20 time: 0.204933 Aug 04 23:18:10.901622 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 317/604] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:18:10 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:18:11.021024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3afac82e-25e9-40d7-ba73-c197623fcff4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:11.021765 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3afac82e-25e9-40d7-ba73-c197623fcff4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:11.031506 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3afac82e-25e9-40d7-ba73-c197623fcff4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:11.032081 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3afac82e-25e9-40d7-ba73-c197623fcff4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:11.032521 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3afac82e-25e9-40d7-ba73-c197623fcff4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:11.033238 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3afac82e-25e9-40d7-ba73-c197623fcff4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:11.033610 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3afac82e-25e9-40d7-ba73-c197623fcff4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:11.034262 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3afac82e-25e9-40d7-ba73-c197623fcff4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:11.071085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3afac82e-25e9-40d7-ba73-c197623fcff4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:11.071476 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3afac82e-25e9-40d7-ba73-c197623fcff4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:11.071906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3afac82e-25e9-40d7-ba73-c197623fcff4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:11.072359 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.objects.instance [None req-3afac82e-25e9-40d7-ba73-c197623fcff4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lazy-loading 'fault' on Instance uuid fcc205d5-c1d3-4f3d-a37f-af9769b7067f {{(pid=129790) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:18:11.119600 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3afac82e-25e9-40d7-ba73-c197623fcff4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:11.128022 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3afac82e-25e9-40d7-ba73-c197623fcff4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 200 len: 1332 microversion: 2.1 time: 0.111244 Aug 04 23:18:11.128855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 288/605] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:11 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:18:11.923757 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3e20a68f-be66-4e1c-8433-d787dd28e68c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:11.924372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3e20a68f-be66-4e1c-8433-d787dd28e68c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:11.931325 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e20a68f-be66-4e1c-8433-d787dd28e68c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:11.931785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e20a68f-be66-4e1c-8433-d787dd28e68c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:11.932207 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e20a68f-be66-4e1c-8433-d787dd28e68c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:11.932894 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e20a68f-be66-4e1c-8433-d787dd28e68c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:11.933338 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e20a68f-be66-4e1c-8433-d787dd28e68c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:11.933749 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e20a68f-be66-4e1c-8433-d787dd28e68c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:12.084684 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3e20a68f-be66-4e1c-8433-d787dd28e68c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:12.095327 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3e20a68f-be66-4e1c-8433-d787dd28e68c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:12.096721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3e20a68f-be66-4e1c-8433-d787dd28e68c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:12.097878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3e20a68f-be66-4e1c-8433-d787dd28e68c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1808 microversion: 2.20 time: 0.179522 Aug 04 23:18:12.098455 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 318/606] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:18:11 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:18:12.149818 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-261a60f7-cdbb-4b9c-992d-fda40b9e9428 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:12.150471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-261a60f7-cdbb-4b9c-992d-fda40b9e9428 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:12.158163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-261a60f7-cdbb-4b9c-992d-fda40b9e9428 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:12.158693 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-261a60f7-cdbb-4b9c-992d-fda40b9e9428 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:12.159133 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-261a60f7-cdbb-4b9c-992d-fda40b9e9428 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:12.159842 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-261a60f7-cdbb-4b9c-992d-fda40b9e9428 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:12.160290 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-261a60f7-cdbb-4b9c-992d-fda40b9e9428 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:12.160733 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-261a60f7-cdbb-4b9c-992d-fda40b9e9428 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:12.197536 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-261a60f7-cdbb-4b9c-992d-fda40b9e9428 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:12.198036 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-261a60f7-cdbb-4b9c-992d-fda40b9e9428 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:12.198488 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-261a60f7-cdbb-4b9c-992d-fda40b9e9428 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:12.199136 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.objects.instance [None req-261a60f7-cdbb-4b9c-992d-fda40b9e9428 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lazy-loading 'fault' on Instance uuid fcc205d5-c1d3-4f3d-a37f-af9769b7067f {{(pid=129790) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:18:12.252444 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-261a60f7-cdbb-4b9c-992d-fda40b9e9428 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:12.262787 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-261a60f7-cdbb-4b9c-992d-fda40b9e9428 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 200 len: 1332 microversion: 2.1 time: 0.116585 Aug 04 23:18:12.263448 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 289/607] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:12 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 1332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:13.137285 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c41e0496-9d64-4e2e-9a71-42ec2cee516d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:13.138072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c41e0496-9d64-4e2e-9a71-42ec2cee516d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:13.145912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c41e0496-9d64-4e2e-9a71-42ec2cee516d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:13.146417 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c41e0496-9d64-4e2e-9a71-42ec2cee516d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:13.146856 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c41e0496-9d64-4e2e-9a71-42ec2cee516d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:13.147563 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c41e0496-9d64-4e2e-9a71-42ec2cee516d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:13.148013 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c41e0496-9d64-4e2e-9a71-42ec2cee516d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:13.148436 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c41e0496-9d64-4e2e-9a71-42ec2cee516d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:13.286637 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-287041da-fdb2-4070-b150-e56f83564ff6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:13.287599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-287041da-fdb2-4070-b150-e56f83564ff6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:13.296638 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-287041da-fdb2-4070-b150-e56f83564ff6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:13.297490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-287041da-fdb2-4070-b150-e56f83564ff6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:13.298245 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-287041da-fdb2-4070-b150-e56f83564ff6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:13.299566 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-287041da-fdb2-4070-b150-e56f83564ff6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:13.300373 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-287041da-fdb2-4070-b150-e56f83564ff6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:13.301096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-287041da-fdb2-4070-b150-e56f83564ff6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:13.319375 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-287041da-fdb2-4070-b150-e56f83564ff6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] HTTP exception thrown: Instance fcc205d5-c1d3-4f3d-a37f-af9769b7067f could not be found. Aug 04 23:18:13.322384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-287041da-fdb2-4070-b150-e56f83564ff6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Request method failure captured: Aug 04 23:18:13.322384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f HTTP/1.1 Aug 04 23:18:13.322384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:18:13.322384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:18:13.322384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:18:13.322384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:18:13.322384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:18:13.322384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:18:13.322384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:18:13.322384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:18:13.322384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FJxolWXoCq7pteacc3wSoOFRBafzn5l-VFi74XBW7wvTawbOokhRmWW1PKP-C_VKEwuqozn26yg856JLZkvKXgHW09fl1p22BiGh5nneUxE7kKr1M8fWXZ4OILMJgqixZXLBIGcxsElt638y0EWPGUaTW1AOdHEnKwXTKYRir1dpV4 Aug 04 23:18:13.322384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:18:13.322384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:18:13.322384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:18:13.322384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:18:13.322384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:18:13.322384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:18:13.322384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:18:13.322384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:18:13.322384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:18:13.322384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:18:13.326018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0422afbb853d4ef2924edf221499971c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0422afbb853d4ef2924edf221499971c"}]}] Aug 04 23:18:13.326018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:18:13.326018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:18:13.326018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:18:13.326018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:18:13.326018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:18:13.326018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:18:13.326018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: b2ceb35afcc046218bdce1ab4983d9f9 Aug 04 23:18:13.326018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:18:13.326018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:18:13.326018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Instance fcc205d5-c1d3-4f3d-a37f-af9769b7067f could not be found. Aug 04 23:18:13.326018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': 'fcc205d5-c1d3-4f3d-a37f-af9769b7067f'} Aug 04 23:18:13.329026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:18:13.329026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:18:13.329026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:18:13.329026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:18:13.329026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:18:13.329026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:18:13.329026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:18:13.329026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:18:13.329026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:18:13.329026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:18:13.329026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcc205d5-c1d3-4f3d-a37f-af9769b7067f could not be found. Aug 04 23:18:13.329026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:18:13.329026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:18:13.329026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:18:13.329026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:18:13.329026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:18:13.329026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:18:13.329026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:18:13.329026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:18:13.329026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:18:13.331724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:18:13.331724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:18:13.331724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:18:13.331724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:18:13.331724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:18:13.331724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:18:13.331724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:18:13.331724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcc205d5-c1d3-4f3d-a37f-af9769b7067f could not be found. Aug 04 23:18:13.331724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:18:13.331724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:18:13.331724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:18:13.331724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:18:13.331724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:18:13.331724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:18:13.331724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:18:13.331724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:18:13.331724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcc205d5-c1d3-4f3d-a37f-af9769b7067f could not be found. Aug 04 23:18:13.331724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:18:13.334446 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-287041da-fdb2-4070-b150-e56f83564ff6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Returning 404 to user: Instance fcc205d5-c1d3-4f3d-a37f-af9769b7067f could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:18:13.334446 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-287041da-fdb2-4070-b150-e56f83564ff6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 404 len: 111 microversion: 2.1 time: 0.042593 Aug 04 23:18:13.334446 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 290/608] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:13 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:18:13.335042 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c41e0496-9d64-4e2e-9a71-42ec2cee516d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:13.337379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-04981dfd-5736-4390-ad7c-bc8b8aa530dd tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '.version_select at 0x7f6d25da0670>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:13.346513 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c41e0496-9d64-4e2e-9a71-42ec2cee516d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:13.348291 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c41e0496-9d64-4e2e-9a71-42ec2cee516d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:13.349822 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c41e0496-9d64-4e2e-9a71-42ec2cee516d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1808 microversion: 2.20 time: 0.217759 Aug 04 23:18:13.351491 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 319/609] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:18:13 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:18:13.373172 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-04981dfd-5736-4390-ad7c-bc8b8aa530dd tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913887147" status: 202 len: 0 microversion: 2.1 time: 0.038474 Aug 04 23:18:13.385458 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 291/610] 10.222.0.33 () {58 vars in 1221 bytes} [Thu Aug 4 23:18:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913887147 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:18:14.131923 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-479c7494-e0f3-4a52-b0cb-d1e2fa7035bf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:14.131923 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-479c7494-e0f3-4a52-b0cb-d1e2fa7035bf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:14.136272 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-479c7494-e0f3-4a52-b0cb-d1e2fa7035bf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:14.136745 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-479c7494-e0f3-4a52-b0cb-d1e2fa7035bf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:14.137172 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-479c7494-e0f3-4a52-b0cb-d1e2fa7035bf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:14.137859 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-479c7494-e0f3-4a52-b0cb-d1e2fa7035bf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:14.138474 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-479c7494-e0f3-4a52-b0cb-d1e2fa7035bf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:14.138752 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-479c7494-e0f3-4a52-b0cb-d1e2fa7035bf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:14.274215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.objects.instance [None req-479c7494-e0f3-4a52-b0cb-d1e2fa7035bf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lazy-loading 'services' on Instance uuid 852287f5-010e-4d74-a6ef-a4bf2f47c477 {{(pid=129791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:18:14.388788 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9f882418-b7a4-4c4d-a1d4-76bc59b65bbb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:14.388788 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9f882418-b7a4-4c4d-a1d4-76bc59b65bbb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:14.388788 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9f882418-b7a4-4c4d-a1d4-76bc59b65bbb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:14.388788 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9f882418-b7a4-4c4d-a1d4-76bc59b65bbb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:14.389690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9f882418-b7a4-4c4d-a1d4-76bc59b65bbb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:14.389690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9f882418-b7a4-4c4d-a1d4-76bc59b65bbb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:14.389690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9f882418-b7a4-4c4d-a1d4-76bc59b65bbb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:14.389690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9f882418-b7a4-4c4d-a1d4-76bc59b65bbb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:14.470086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-479c7494-e0f3-4a52-b0cb-d1e2fa7035bf tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "DELETE /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/os-volume_attachments/6d8a4f39-7a1a-4b16-8dff-23113c2c52ae" status: 202 len: 0 microversion: 2.1 time: 0.344134 Aug 04 23:18:14.474520 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 320/611] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Aug 4 23:18:14 2022] DELETE /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/os-volume_attachments/6d8a4f39-7a1a-4b16-8dff-23113c2c52ae => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 23:18:14.479509 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f552ee42-7f0e-4a7a-b0c3-d51180559800 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:14.480208 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f552ee42-7f0e-4a7a-b0c3-d51180559800 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:14.488342 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f552ee42-7f0e-4a7a-b0c3-d51180559800 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:14.488893 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f552ee42-7f0e-4a7a-b0c3-d51180559800 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:14.489327 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f552ee42-7f0e-4a7a-b0c3-d51180559800 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:14.490040 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f552ee42-7f0e-4a7a-b0c3-d51180559800 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:14.490844 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f552ee42-7f0e-4a7a-b0c3-d51180559800 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:14.490953 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f552ee42-7f0e-4a7a-b0c3-d51180559800 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:14.585277 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9f882418-b7a4-4c4d-a1d4-76bc59b65bbb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:14.595423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9f882418-b7a4-4c4d-a1d4-76bc59b65bbb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:14.596913 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9f882418-b7a4-4c4d-a1d4-76bc59b65bbb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:14.598448 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9f882418-b7a4-4c4d-a1d4-76bc59b65bbb tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1808 microversion: 2.20 time: 0.225947 Aug 04 23:18:14.598859 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 292/612] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:18:14 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:18:14.621374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-03f71627-1a3d-4c6a-b8e4-5d21dc1c6846 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:14.624129 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-03f71627-1a3d-4c6a-b8e4-5d21dc1c6846 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:14.630803 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03f71627-1a3d-4c6a-b8e4-5d21dc1c6846 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:14.631301 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03f71627-1a3d-4c6a-b8e4-5d21dc1c6846 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:14.631737 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03f71627-1a3d-4c6a-b8e4-5d21dc1c6846 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:14.632653 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03f71627-1a3d-4c6a-b8e4-5d21dc1c6846 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:14.633268 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03f71627-1a3d-4c6a-b8e4-5d21dc1c6846 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:14.633858 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03f71627-1a3d-4c6a-b8e4-5d21dc1c6846 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:14.655311 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f552ee42-7f0e-4a7a-b0c3-d51180559800 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:14.664141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f552ee42-7f0e-4a7a-b0c3-d51180559800 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1594 microversion: 2.1 time: 0.190791 Aug 04 23:18:14.677492 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-03f71627-1a3d-4c6a-b8e4-5d21dc1c6846 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057025 Aug 04 23:18:14.677492 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 293/613] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:18:14 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:18:14.677971 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 321/614] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:14 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1594 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:15.624448 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-86080a0d-20cb-49f3-83b4-eae1ce1238a7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:15.626291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-86080a0d-20cb-49f3-83b4-eae1ce1238a7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:15.633060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86080a0d-20cb-49f3-83b4-eae1ce1238a7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:15.633731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86080a0d-20cb-49f3-83b4-eae1ce1238a7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:15.634297 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86080a0d-20cb-49f3-83b4-eae1ce1238a7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:15.635464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86080a0d-20cb-49f3-83b4-eae1ce1238a7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:15.635855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86080a0d-20cb-49f3-83b4-eae1ce1238a7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:15.635971 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86080a0d-20cb-49f3-83b4-eae1ce1238a7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:15.689927 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2d6ff609-df48-4eac-9d8e-903a80e70b2c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:15.692301 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2d6ff609-df48-4eac-9d8e-903a80e70b2c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:15.700061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d6ff609-df48-4eac-9d8e-903a80e70b2c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:15.700546 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d6ff609-df48-4eac-9d8e-903a80e70b2c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:15.700993 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d6ff609-df48-4eac-9d8e-903a80e70b2c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:15.701692 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d6ff609-df48-4eac-9d8e-903a80e70b2c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:15.702145 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d6ff609-df48-4eac-9d8e-903a80e70b2c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:15.702605 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d6ff609-df48-4eac-9d8e-903a80e70b2c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:15.735428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2d6ff609-df48-4eac-9d8e-903a80e70b2c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049596 Aug 04 23:18:15.736113 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 322/615] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:18:15 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:18:15.857253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-86080a0d-20cb-49f3-83b4-eae1ce1238a7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:15.866823 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-86080a0d-20cb-49f3-83b4-eae1ce1238a7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:15.868365 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-86080a0d-20cb-49f3-83b4-eae1ce1238a7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:15.869606 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-86080a0d-20cb-49f3-83b4-eae1ce1238a7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1808 microversion: 2.20 time: 0.249896 Aug 04 23:18:15.870177 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 294/616] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:18:15 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:18:16.574105 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-0d05557e-4ae2-44cb-847a-aa7db6891927 req-2f8e235b-d9fd-49af-a6bf-b148fd6f3edd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "159d56ac-e70e-41db-ae34-62cc0d59d9fe", "tag": "f7c9e9a4-d405-4289-bdbf-6033cb27920c"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:18:16.586471 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-0d05557e-4ae2-44cb-847a-aa7db6891927 req-2f8e235b-d9fd-49af-a6bf-b148fd6f3edd service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:16.587373 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-0d05557e-4ae2-44cb-847a-aa7db6891927 req-2f8e235b-d9fd-49af-a6bf-b148fd6f3edd service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:16.588018 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-0d05557e-4ae2-44cb-847a-aa7db6891927 req-2f8e235b-d9fd-49af-a6bf-b148fd6f3edd service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:16.610767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-0d05557e-4ae2-44cb-847a-aa7db6891927 req-2f8e235b-d9fd-49af-a6bf-b148fd6f3edd service nova] Creating event network-changed:f7c9e9a4-d405-4289-bdbf-6033cb27920c for instance 159d56ac-e70e-41db-ae34-62cc0d59d9fe on hv-cinder-85221 Aug 04 23:18:16.619422 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-0d05557e-4ae2-44cb-847a-aa7db6891927 req-2f8e235b-d9fd-49af-a6bf-b148fd6f3edd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048764 Aug 04 23:18:16.621097 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 323/617] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:18:16.751230 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-532d0532-25fb-47e5-839c-fd12790a0791 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:16.755300 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-532d0532-25fb-47e5-839c-fd12790a0791 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:16.765773 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-532d0532-25fb-47e5-839c-fd12790a0791 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:16.767107 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-532d0532-25fb-47e5-839c-fd12790a0791 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:16.767847 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-532d0532-25fb-47e5-839c-fd12790a0791 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:16.770134 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-532d0532-25fb-47e5-839c-fd12790a0791 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:16.771423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-532d0532-25fb-47e5-839c-fd12790a0791 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:16.772130 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-532d0532-25fb-47e5-839c-fd12790a0791 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:16.825094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-532d0532-25fb-47e5-839c-fd12790a0791 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080288 Aug 04 23:18:16.826078 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 295/618] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:18:16 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:18:16.897240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2a099c7c-73ee-459c-9532-d3a3afaa81c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:16.898079 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2a099c7c-73ee-459c-9532-d3a3afaa81c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:16.906489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a099c7c-73ee-459c-9532-d3a3afaa81c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:16.907165 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a099c7c-73ee-459c-9532-d3a3afaa81c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:16.908433 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a099c7c-73ee-459c-9532-d3a3afaa81c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:16.908433 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a099c7c-73ee-459c-9532-d3a3afaa81c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:16.909038 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a099c7c-73ee-459c-9532-d3a3afaa81c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:16.909562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a099c7c-73ee-459c-9532-d3a3afaa81c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:17.082319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-0557e248-005c-4a14-bef6-54be6f3c6f22 req-735bd1d7-0ed6-490d-8823-299b4497f8bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2013d923-81bb-4002-976d-64d3722b15d2", "name": "network-vif-plugged", "status": "completed", "tag": "bae5f1bd-b332-4fbe-8c3e-7f38e098b71d"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:18:17.097671 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-0557e248-005c-4a14-bef6-54be6f3c6f22 req-735bd1d7-0ed6-490d-8823-299b4497f8bf service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:17.098624 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-0557e248-005c-4a14-bef6-54be6f3c6f22 req-735bd1d7-0ed6-490d-8823-299b4497f8bf service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:17.099466 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-0557e248-005c-4a14-bef6-54be6f3c6f22 req-735bd1d7-0ed6-490d-8823-299b4497f8bf service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:17.115327 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-0557e248-005c-4a14-bef6-54be6f3c6f22 req-735bd1d7-0ed6-490d-8823-299b4497f8bf service nova] Creating event network-vif-plugged:bae5f1bd-b332-4fbe-8c3e-7f38e098b71d for instance 2013d923-81bb-4002-976d-64d3722b15d2 on hv-cinder-85221 Aug 04 23:18:17.116607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2a099c7c-73ee-459c-9532-d3a3afaa81c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:17.124866 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-0557e248-005c-4a14-bef6-54be6f3c6f22 req-735bd1d7-0ed6-490d-8823-299b4497f8bf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046910 Aug 04 23:18:17.126533 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 296/619] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:18:17.142116 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2a099c7c-73ee-459c-9532-d3a3afaa81c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:17.145344 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2a099c7c-73ee-459c-9532-d3a3afaa81c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:17.150837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2a099c7c-73ee-459c-9532-d3a3afaa81c1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1808 microversion: 2.20 time: 0.256469 Aug 04 23:18:17.151728 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 324/620] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:18:16 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1808 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:18:17.843196 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2ac7b94b-e970-4305-bb46-20c94852b09d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:17.845456 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2ac7b94b-e970-4305-bb46-20c94852b09d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:17.865263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2ac7b94b-e970-4305-bb46-20c94852b09d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:17.866348 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2ac7b94b-e970-4305-bb46-20c94852b09d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:17.867255 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2ac7b94b-e970-4305-bb46-20c94852b09d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:17.868634 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2ac7b94b-e970-4305-bb46-20c94852b09d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:17.870094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2ac7b94b-e970-4305-bb46-20c94852b09d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:17.871156 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2ac7b94b-e970-4305-bb46-20c94852b09d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:17.940173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:18:17.945082 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2ac7b94b-e970-4305-bb46-20c94852b09d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106592 Aug 04 23:18:17.946191 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 297/621] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:18:17 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:18:18.180876 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-cdd768f8-667a-4753-bce1-516adc408d74 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:18.182141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-cdd768f8-667a-4753-bce1-516adc408d74 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:18.193532 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cdd768f8-667a-4753-bce1-516adc408d74 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:18.194567 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cdd768f8-667a-4753-bce1-516adc408d74 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:18.195339 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cdd768f8-667a-4753-bce1-516adc408d74 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:18.196631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cdd768f8-667a-4753-bce1-516adc408d74 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:18.197730 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cdd768f8-667a-4753-bce1-516adc408d74 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:18.198790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cdd768f8-667a-4753-bce1-516adc408d74 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:18.273213 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0746cef5-5a66-4c39-8f08-74c30983ea05 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1875562664"}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:18:18.274270 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0746cef5-5a66-4c39-8f08-74c30983ea05 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:18.291822 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0746cef5-5a66-4c39-8f08-74c30983ea05 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:18.292464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0746cef5-5a66-4c39-8f08-74c30983ea05 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:18.293072 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0746cef5-5a66-4c39-8f08-74c30983ea05 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:18.293974 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0746cef5-5a66-4c39-8f08-74c30983ea05 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:18.294889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0746cef5-5a66-4c39-8f08-74c30983ea05 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:18.296182 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0746cef5-5a66-4c39-8f08-74c30983ea05 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:18.457821 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cdd768f8-667a-4753-bce1-516adc408d74 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:18.468913 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cdd768f8-667a-4753-bce1-516adc408d74 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:18.470481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cdd768f8-667a-4753-bce1-516adc408d74 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:18.471684 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-cdd768f8-667a-4753-bce1-516adc408d74 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1808 microversion: 2.20 time: 0.298295 Aug 04 23:18:18.472283 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 325/622] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:18:18 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1808 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:18:18.530191 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.network.security_group_api [None req-0746cef5-5a66-4c39-8f08-74c30983ea05 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Adding security group 8e602bcc-14f7-468e-b3a2-d91813c7e72e to port f7c9e9a4-d405-4289-bdbf-6033cb27920c Aug 04 23:18:18.921687 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0746cef5-5a66-4c39-8f08-74c30983ea05 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "POST /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe/action" status: 202 len: 0 microversion: 2.1 time: 0.658438 Aug 04 23:18:18.923085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 298/623] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Aug 4 23:18:18 2022] POST /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe/action => generated 0 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:18:18.932073 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-25c3110f-464b-40e7-93ef-b2153e35bf88 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:18.932705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-25c3110f-464b-40e7-93ef-b2153e35bf88 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:18.934924 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-5fe8d260-fbbf-4c37-b9e8-60a321ab00f2 req-dc7eb0fa-2443-492b-b7f1-b6ebaee27d2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "159d56ac-e70e-41db-ae34-62cc0d59d9fe", "tag": "f7c9e9a4-d405-4289-bdbf-6033cb27920c"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:18:18.940027 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-25c3110f-464b-40e7-93ef-b2153e35bf88 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:18.940518 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-25c3110f-464b-40e7-93ef-b2153e35bf88 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:18.940956 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-25c3110f-464b-40e7-93ef-b2153e35bf88 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:18.941678 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-25c3110f-464b-40e7-93ef-b2153e35bf88 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:18.942189 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-25c3110f-464b-40e7-93ef-b2153e35bf88 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:18.942656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-25c3110f-464b-40e7-93ef-b2153e35bf88 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:18.978113 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-5fe8d260-fbbf-4c37-b9e8-60a321ab00f2 req-dc7eb0fa-2443-492b-b7f1-b6ebaee27d2c service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:18.979007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-5fe8d260-fbbf-4c37-b9e8-60a321ab00f2 req-dc7eb0fa-2443-492b-b7f1-b6ebaee27d2c service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:18.979803 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-5fe8d260-fbbf-4c37-b9e8-60a321ab00f2 req-dc7eb0fa-2443-492b-b7f1-b6ebaee27d2c service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:19.003523 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-5fe8d260-fbbf-4c37-b9e8-60a321ab00f2 req-dc7eb0fa-2443-492b-b7f1-b6ebaee27d2c service nova] Creating event network-changed:f7c9e9a4-d405-4289-bdbf-6033cb27920c for instance 159d56ac-e70e-41db-ae34-62cc0d59d9fe on hv-cinder-85221 Aug 04 23:18:19.012533 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-5fe8d260-fbbf-4c37-b9e8-60a321ab00f2 req-dc7eb0fa-2443-492b-b7f1-b6ebaee27d2c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084206 Aug 04 23:18:19.014659 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 326/624] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:18:19.024955 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b103caad-7af4-4b6c-8064-8e0d86397d95 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:19.029624 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b103caad-7af4-4b6c-8064-8e0d86397d95 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:19.041889 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b103caad-7af4-4b6c-8064-8e0d86397d95 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:19.042802 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b103caad-7af4-4b6c-8064-8e0d86397d95 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:19.043599 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b103caad-7af4-4b6c-8064-8e0d86397d95 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:19.044883 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b103caad-7af4-4b6c-8064-8e0d86397d95 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:19.046331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b103caad-7af4-4b6c-8064-8e0d86397d95 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:19.047394 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b103caad-7af4-4b6c-8064-8e0d86397d95 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:19.053611 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:18:19.095814 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b103caad-7af4-4b6c-8064-8e0d86397d95 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078290 Aug 04 23:18:19.097059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 327/625] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:18:19 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:18:19.173814 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-25c3110f-464b-40e7-93ef-b2153e35bf88 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:19.192173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-25c3110f-464b-40e7-93ef-b2153e35bf88 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1760 microversion: 2.1 time: 0.264400 Aug 04 23:18:19.193204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 299/626] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:18 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1760 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:18:19.505741 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-810c8aba-ddf9-479d-972f-fe2f6b6db742 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:19.506807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-810c8aba-ddf9-479d-972f-fe2f6b6db742 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:19.514687 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-810c8aba-ddf9-479d-972f-fe2f6b6db742 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:19.515295 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-810c8aba-ddf9-479d-972f-fe2f6b6db742 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:19.515807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-810c8aba-ddf9-479d-972f-fe2f6b6db742 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:19.516604 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-810c8aba-ddf9-479d-972f-fe2f6b6db742 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:19.517133 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-810c8aba-ddf9-479d-972f-fe2f6b6db742 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:19.517638 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-810c8aba-ddf9-479d-972f-fe2f6b6db742 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:19.703542 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-810c8aba-ddf9-479d-972f-fe2f6b6db742 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:19.721401 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-810c8aba-ddf9-479d-972f-fe2f6b6db742 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:19.721401 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-810c8aba-ddf9-479d-972f-fe2f6b6db742 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:19.722161 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-810c8aba-ddf9-479d-972f-fe2f6b6db742 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1808 microversion: 2.20 time: 0.222145 Aug 04 23:18:19.723173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 328/627] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:18:19 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:18:20.111785 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-aa76d8e6-e5fd-4761-bb78-2980960750d2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:20.115149 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-aa76d8e6-e5fd-4761-bb78-2980960750d2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:20.126091 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa76d8e6-e5fd-4761-bb78-2980960750d2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:20.126891 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa76d8e6-e5fd-4761-bb78-2980960750d2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:20.127777 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa76d8e6-e5fd-4761-bb78-2980960750d2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:20.129163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa76d8e6-e5fd-4761-bb78-2980960750d2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:20.130212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa76d8e6-e5fd-4761-bb78-2980960750d2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:20.131094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa76d8e6-e5fd-4761-bb78-2980960750d2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:20.185628 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-aa76d8e6-e5fd-4761-bb78-2980960750d2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079487 Aug 04 23:18:20.187599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 300/628] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:18:20 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:18:20.747986 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3c52c903-c283-4a2c-9795-c0a8965eb48a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:20.749424 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3c52c903-c283-4a2c-9795-c0a8965eb48a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:20.756632 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3c52c903-c283-4a2c-9795-c0a8965eb48a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:20.757242 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3c52c903-c283-4a2c-9795-c0a8965eb48a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:20.757921 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3c52c903-c283-4a2c-9795-c0a8965eb48a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:20.759011 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3c52c903-c283-4a2c-9795-c0a8965eb48a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:20.759256 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3c52c903-c283-4a2c-9795-c0a8965eb48a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:20.759925 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3c52c903-c283-4a2c-9795-c0a8965eb48a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:20.899759 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3c52c903-c283-4a2c-9795-c0a8965eb48a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:20.914742 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3c52c903-c283-4a2c-9795-c0a8965eb48a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:20.918195 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3c52c903-c283-4a2c-9795-c0a8965eb48a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:20.920291 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3c52c903-c283-4a2c-9795-c0a8965eb48a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1795 microversion: 2.20 time: 0.176742 Aug 04 23:18:20.921862 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 329/629] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:18:20 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1795 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:18:21.199560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-77a001aa-c860-4565-b020-e6c691dbb5f6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:21.202488 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-77a001aa-c860-4565-b020-e6c691dbb5f6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:21.209456 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77a001aa-c860-4565-b020-e6c691dbb5f6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:21.209842 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77a001aa-c860-4565-b020-e6c691dbb5f6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:21.210537 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77a001aa-c860-4565-b020-e6c691dbb5f6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:21.211232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77a001aa-c860-4565-b020-e6c691dbb5f6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:21.211679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77a001aa-c860-4565-b020-e6c691dbb5f6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:21.212367 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77a001aa-c860-4565-b020-e6c691dbb5f6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:21.246689 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-77a001aa-c860-4565-b020-e6c691dbb5f6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050963 Aug 04 23:18:21.247255 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 301/630] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:18:21 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:18:22.103373 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9875d288-dda8-4664-a7dc-4fee2d63a5a5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:18:22.105644 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9875d288-dda8-4664-a7dc-4fee2d63a5a5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:22.112627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9875d288-dda8-4664-a7dc-4fee2d63a5a5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:22.113110 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9875d288-dda8-4664-a7dc-4fee2d63a5a5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:22.113566 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9875d288-dda8-4664-a7dc-4fee2d63a5a5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:22.114264 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9875d288-dda8-4664-a7dc-4fee2d63a5a5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:22.114749 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9875d288-dda8-4664-a7dc-4fee2d63a5a5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:22.115169 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9875d288-dda8-4664-a7dc-4fee2d63a5a5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:22.147173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.objects.instance [None req-9875d288-dda8-4664-a7dc-4fee2d63a5a5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lazy-loading 'flavor' on Instance uuid 13d950e0-48a6-44d6-9aae-723354b66c48 {{(pid=129791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:18:22.259586 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6438c127-8e51-4206-b1af-1a365f5b3a6a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:22.261803 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6438c127-8e51-4206-b1af-1a365f5b3a6a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:22.270971 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6438c127-8e51-4206-b1af-1a365f5b3a6a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:22.271745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6438c127-8e51-4206-b1af-1a365f5b3a6a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:22.272505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6438c127-8e51-4206-b1af-1a365f5b3a6a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:22.273529 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6438c127-8e51-4206-b1af-1a365f5b3a6a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:22.274240 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6438c127-8e51-4206-b1af-1a365f5b3a6a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:22.274825 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6438c127-8e51-4206-b1af-1a365f5b3a6a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:22.301888 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9875d288-dda8-4664-a7dc-4fee2d63a5a5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "POST /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48/action" status: 200 len: 32 microversion: 2.1 time: 0.201931 Aug 04 23:18:22.303559 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 330/631] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Aug 4 23:18:22 2022] POST /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48/action => generated 32 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 23:18:22.320081 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-de66a591-8564-4231-a66c-0167a2cfe55b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:22.321200 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-de66a591-8564-4231-a66c-0167a2cfe55b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:22.329605 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6438c127-8e51-4206-b1af-1a365f5b3a6a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073911 Aug 04 23:18:22.330740 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 302/632] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:18:22 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 23:18:22.331248 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de66a591-8564-4231-a66c-0167a2cfe55b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:22.332100 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de66a591-8564-4231-a66c-0167a2cfe55b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:22.332803 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de66a591-8564-4231-a66c-0167a2cfe55b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:22.333915 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de66a591-8564-4231-a66c-0167a2cfe55b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:22.334470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de66a591-8564-4231-a66c-0167a2cfe55b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:22.335036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de66a591-8564-4231-a66c-0167a2cfe55b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:22.411143 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f08133fc-71e9-4246-a081-cfccd40db755 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:22.411143 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f08133fc-71e9-4246-a081-cfccd40db755 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:22.419801 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f08133fc-71e9-4246-a081-cfccd40db755 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:22.421166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f08133fc-71e9-4246-a081-cfccd40db755 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:22.422103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f08133fc-71e9-4246-a081-cfccd40db755 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:22.422932 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f08133fc-71e9-4246-a081-cfccd40db755 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:22.423548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f08133fc-71e9-4246-a081-cfccd40db755 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:22.424001 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f08133fc-71e9-4246-a081-cfccd40db755 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:22.452710 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f08133fc-71e9-4246-a081-cfccd40db755 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Going to try to terminate instance {{(pid=129790) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 23:18:22.485841 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-de66a591-8564-4231-a66c-0167a2cfe55b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:22.494870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-de66a591-8564-4231-a66c-0167a2cfe55b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.181687 Aug 04 23:18:22.496102 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 331/633] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:22 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:18:22.547558 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f08133fc-71e9-4246-a081-cfccd40db755 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "DELETE /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 204 len: 0 microversion: 2.1 time: 0.141201 Aug 04 23:18:22.548160 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 303/634] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:18:22 2022] DELETE /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 23:18:22.558532 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6744e085-8e55-4cf6-8b34-c0dec66966cb tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:22.559245 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6744e085-8e55-4cf6-8b34-c0dec66966cb tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:22.566171 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6744e085-8e55-4cf6-8b34-c0dec66966cb tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:22.566841 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6744e085-8e55-4cf6-8b34-c0dec66966cb tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:22.567275 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6744e085-8e55-4cf6-8b34-c0dec66966cb tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:22.567988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6744e085-8e55-4cf6-8b34-c0dec66966cb tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:22.568438 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6744e085-8e55-4cf6-8b34-c0dec66966cb tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:22.568861 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6744e085-8e55-4cf6-8b34-c0dec66966cb tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:22.724163 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6744e085-8e55-4cf6-8b34-c0dec66966cb tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:22.731873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6744e085-8e55-4cf6-8b34-c0dec66966cb tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1681 microversion: 2.1 time: 0.178553 Aug 04 23:18:22.732455 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 332/635] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:22 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:23.518738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0f62b444-9ed4-4256-814f-45661301a424 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:23.519385 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0f62b444-9ed4-4256-814f-45661301a424 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:23.526072 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f62b444-9ed4-4256-814f-45661301a424 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:23.526599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f62b444-9ed4-4256-814f-45661301a424 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:23.527032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f62b444-9ed4-4256-814f-45661301a424 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:23.527743 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f62b444-9ed4-4256-814f-45661301a424 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:23.528198 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f62b444-9ed4-4256-814f-45661301a424 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:23.528624 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f62b444-9ed4-4256-814f-45661301a424 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:23.666078 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0f62b444-9ed4-4256-814f-45661301a424 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:23.674508 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0f62b444-9ed4-4256-814f-45661301a424 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.160547 Aug 04 23:18:23.675094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 304/636] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:23 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:18:23.756878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a1cae31e-ff23-4bec-a1ac-da2a5d8d74fe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:23.756878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a1cae31e-ff23-4bec-a1ac-da2a5d8d74fe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:23.762532 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a1cae31e-ff23-4bec-a1ac-da2a5d8d74fe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:23.763015 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a1cae31e-ff23-4bec-a1ac-da2a5d8d74fe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:23.763447 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a1cae31e-ff23-4bec-a1ac-da2a5d8d74fe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:23.764174 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a1cae31e-ff23-4bec-a1ac-da2a5d8d74fe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:23.764964 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a1cae31e-ff23-4bec-a1ac-da2a5d8d74fe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:23.765391 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a1cae31e-ff23-4bec-a1ac-da2a5d8d74fe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:24.133415 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a1cae31e-ff23-4bec-a1ac-da2a5d8d74fe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:24.143259 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a1cae31e-ff23-4bec-a1ac-da2a5d8d74fe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1681 microversion: 2.1 time: 0.391732 Aug 04 23:18:24.157557 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 333/637] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:23 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1681 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:24.696238 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ce76da45-d3f7-462e-95ef-0fc8a0a252e5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:24.697031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ce76da45-d3f7-462e-95ef-0fc8a0a252e5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:24.704123 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ce76da45-d3f7-462e-95ef-0fc8a0a252e5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:24.704605 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ce76da45-d3f7-462e-95ef-0fc8a0a252e5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:24.705030 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ce76da45-d3f7-462e-95ef-0fc8a0a252e5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:24.705732 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ce76da45-d3f7-462e-95ef-0fc8a0a252e5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:24.706178 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ce76da45-d3f7-462e-95ef-0fc8a0a252e5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:24.706632 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ce76da45-d3f7-462e-95ef-0fc8a0a252e5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:24.844976 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ce76da45-d3f7-462e-95ef-0fc8a0a252e5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:24.853127 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ce76da45-d3f7-462e-95ef-0fc8a0a252e5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.161043 Aug 04 23:18:24.853898 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 305/638] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:24 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:18:25.165164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-da0a2eaf-6ebf-439a-b679-6858c83b54b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:25.165799 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-da0a2eaf-6ebf-439a-b679-6858c83b54b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:25.172385 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-da0a2eaf-6ebf-439a-b679-6858c83b54b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:25.172871 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-da0a2eaf-6ebf-439a-b679-6858c83b54b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:25.173306 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-da0a2eaf-6ebf-439a-b679-6858c83b54b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:25.174010 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-da0a2eaf-6ebf-439a-b679-6858c83b54b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:25.174965 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-da0a2eaf-6ebf-439a-b679-6858c83b54b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:25.174965 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-da0a2eaf-6ebf-439a-b679-6858c83b54b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:25.238116 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-da0a2eaf-6ebf-439a-b679-6858c83b54b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:25.245566 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-da0a2eaf-6ebf-439a-b679-6858c83b54b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 200 len: 1614 microversion: 2.1 time: 0.084304 Aug 04 23:18:25.246132 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 334/639] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:25 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 1614 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:25.505367 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-701fc210-5f2e-4604-a173-76fb9f0caa75 req-c1d44063-ad58-4f73-9b5a-86809143c23d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852287f5-010e-4d74-a6ef-a4bf2f47c477", "name": "network-vif-deleted", "tag": "f5be5be8-6bc4-4f6a-910d-b8fbf2981502"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:18:25.518904 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-701fc210-5f2e-4604-a173-76fb9f0caa75 req-c1d44063-ad58-4f73-9b5a-86809143c23d service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:25.519734 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-701fc210-5f2e-4604-a173-76fb9f0caa75 req-c1d44063-ad58-4f73-9b5a-86809143c23d service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:25.520375 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-701fc210-5f2e-4604-a173-76fb9f0caa75 req-c1d44063-ad58-4f73-9b5a-86809143c23d service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:25.534421 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-701fc210-5f2e-4604-a173-76fb9f0caa75 req-c1d44063-ad58-4f73-9b5a-86809143c23d service nova] Creating event network-vif-deleted:f5be5be8-6bc4-4f6a-910d-b8fbf2981502 for instance 852287f5-010e-4d74-a6ef-a4bf2f47c477 on hv-cinder-85221 Aug 04 23:18:25.541400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-701fc210-5f2e-4604-a173-76fb9f0caa75 req-c1d44063-ad58-4f73-9b5a-86809143c23d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125057 Aug 04 23:18:25.542553 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 306/640] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:18:25.877286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-98151046-47df-4141-9038-42ca65286a42 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:25.878198 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-98151046-47df-4141-9038-42ca65286a42 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:25.885450 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98151046-47df-4141-9038-42ca65286a42 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:25.886181 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98151046-47df-4141-9038-42ca65286a42 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:25.886834 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98151046-47df-4141-9038-42ca65286a42 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:25.887665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98151046-47df-4141-9038-42ca65286a42 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:25.888299 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98151046-47df-4141-9038-42ca65286a42 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:25.888721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98151046-47df-4141-9038-42ca65286a42 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:26.056970 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-98151046-47df-4141-9038-42ca65286a42 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:26.068674 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-98151046-47df-4141-9038-42ca65286a42 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.197517 Aug 04 23:18:26.069246 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 335/641] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:25 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:26.272805 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-79f37f0b-2a8d-41a4-a3fc-9cf6fd50195c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:26.273514 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-79f37f0b-2a8d-41a4-a3fc-9cf6fd50195c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:26.280516 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-79f37f0b-2a8d-41a4-a3fc-9cf6fd50195c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:26.281080 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-79f37f0b-2a8d-41a4-a3fc-9cf6fd50195c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:26.281601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-79f37f0b-2a8d-41a4-a3fc-9cf6fd50195c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:26.282306 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-79f37f0b-2a8d-41a4-a3fc-9cf6fd50195c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:26.282825 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-79f37f0b-2a8d-41a4-a3fc-9cf6fd50195c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:26.283255 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-79f37f0b-2a8d-41a4-a3fc-9cf6fd50195c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:26.300650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-79f37f0b-2a8d-41a4-a3fc-9cf6fd50195c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] HTTP exception thrown: Instance 852287f5-010e-4d74-a6ef-a4bf2f47c477 could not be found. Aug 04 23:18:26.302684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-79f37f0b-2a8d-41a4-a3fc-9cf6fd50195c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Request method failure captured: Aug 04 23:18:26.302684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 HTTP/1.1 Aug 04 23:18:26.302684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:18:26.302684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:18:26.302684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:18:26.302684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:18:26.302684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:18:26.302684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:18:26.302684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:18:26.302684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:18:26.302684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FJxolWXoCq7pteacc3wSoOFRBafzn5l-VFi74XBW7wvTawbOokhRmWW1PKP-C_VKEwuqozn26yg856JLZkvKXgHW09fl1p22BiGh5nneUxE7kKr1M8fWXZ4OILMJgqixZXLBIGcxsElt638y0EWPGUaTW1AOdHEnKwXTKYRir1dpV4 Aug 04 23:18:26.302684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:18:26.302684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:18:26.302684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:18:26.302684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:18:26.302684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:18:26.302684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:18:26.302684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:18:26.302684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:18:26.302684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:18:26.302684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:18:26.304420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0422afbb853d4ef2924edf221499971c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0422afbb853d4ef2924edf221499971c"}]}] Aug 04 23:18:26.304420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:18:26.304420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:18:26.304420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:18:26.304420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:18:26.304420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:18:26.304420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:18:26.304420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: b2ceb35afcc046218bdce1ab4983d9f9 Aug 04 23:18:26.304420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:18:26.304420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:18:26.304420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Instance 852287f5-010e-4d74-a6ef-a4bf2f47c477 could not be found. Aug 04 23:18:26.304420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': '852287f5-010e-4d74-a6ef-a4bf2f47c477'} Aug 04 23:18:26.305662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:18:26.305662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:18:26.305662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:18:26.305662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:18:26.305662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:18:26.305662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:18:26.305662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:18:26.305662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:18:26.305662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:18:26.305662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:18:26.305662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852287f5-010e-4d74-a6ef-a4bf2f47c477 could not be found. Aug 04 23:18:26.305662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:18:26.305662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:18:26.305662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:18:26.305662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:18:26.305662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:18:26.305662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:18:26.305662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:18:26.305662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:18:26.305662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:18:26.307204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:18:26.307204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:18:26.307204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:18:26.307204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:18:26.307204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:18:26.307204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:18:26.307204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:18:26.307204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852287f5-010e-4d74-a6ef-a4bf2f47c477 could not be found. Aug 04 23:18:26.307204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:18:26.307204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:18:26.307204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:18:26.307204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:18:26.307204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:18:26.307204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:18:26.307204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:18:26.307204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:18:26.307204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852287f5-010e-4d74-a6ef-a4bf2f47c477 could not be found. Aug 04 23:18:26.307204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:18:26.308652 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-79f37f0b-2a8d-41a4-a3fc-9cf6fd50195c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Returning 404 to user: Instance 852287f5-010e-4d74-a6ef-a4bf2f47c477 could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:18:26.308652 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-79f37f0b-2a8d-41a4-a3fc-9cf6fd50195c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 404 len: 111 microversion: 2.1 time: 0.039885 Aug 04 23:18:26.308652 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 307/642] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:26 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:18:26.313292 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5acb5056-42d1-4691-a1a8-c06a826e291b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '.version_select at 0x7f6d25f7ee50>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:26.335782 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5acb5056-42d1-4691-a1a8-c06a826e291b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-772314928" status: 202 len: 0 microversion: 2.1 time: 0.026319 Aug 04 23:18:26.336730 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 336/643] 10.222.0.33 () {58 vars in 1218 bytes} [Thu Aug 4 23:18:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-772314928 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:18:27.057234 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7240d8fa-ea15-4926-b0d3-5d1c20904820 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Action: 'create', calling method: .version_select at 0x7f6d25d86ee0>, body: {"keypair": {"name": "tempest-keypair-203967384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVd04NGXAjPof6JJpLDfCldZ0IqLwXj4vDisdvJ2jQ1di2W+9+VmrVcMlDvcBthS5pKtsdvySKazNdfGfEEEa1jbtYhxEhPLiOJZIWrkVsbVB/ajvAqCpBhNUC/z9dD4w=="}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:18:27.075602 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-7240d8fa-ea15-4926-b0d3-5d1c20904820 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Getting quotas for project 0422afbb853d4ef2924edf221499971c. Resources: {'key_pairs'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:18:27.081110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-7240d8fa-ea15-4926-b0d3-5d1c20904820 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Getting quotas for user b2ceb35afcc046218bdce1ab4983d9f9 and project 0422afbb853d4ef2924edf221499971c. Resources: {'key_pairs'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:18:27.091523 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c117495e-900b-4dd7-ad0e-a6d2f5e41253 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:27.092258 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c117495e-900b-4dd7-ad0e-a6d2f5e41253 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:27.099892 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c117495e-900b-4dd7-ad0e-a6d2f5e41253 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:27.100638 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c117495e-900b-4dd7-ad0e-a6d2f5e41253 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:27.101327 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c117495e-900b-4dd7-ad0e-a6d2f5e41253 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:27.102309 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c117495e-900b-4dd7-ad0e-a6d2f5e41253 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:27.102820 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c117495e-900b-4dd7-ad0e-a6d2f5e41253 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:27.103346 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c117495e-900b-4dd7-ad0e-a6d2f5e41253 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:27.110985 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7240d8fa-ea15-4926-b0d3-5d1c20904820 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057595 Aug 04 23:18:27.111835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 308/644] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Aug 4 23:18:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:18:27.288545 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c117495e-900b-4dd7-ad0e-a6d2f5e41253 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:27.298145 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c117495e-900b-4dd7-ad0e-a6d2f5e41253 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.210949 Aug 04 23:18:27.299122 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 337/645] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:27 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:18:28.322395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2c0987e0-b7bb-4b2f-b316-1874caa4ec0f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:28.323368 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2c0987e0-b7bb-4b2f-b316-1874caa4ec0f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:28.330582 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c0987e0-b7bb-4b2f-b316-1874caa4ec0f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:28.331074 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c0987e0-b7bb-4b2f-b316-1874caa4ec0f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:28.331513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c0987e0-b7bb-4b2f-b316-1874caa4ec0f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:28.332254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c0987e0-b7bb-4b2f-b316-1874caa4ec0f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:28.332706 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c0987e0-b7bb-4b2f-b316-1874caa4ec0f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:28.333130 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c0987e0-b7bb-4b2f-b316-1874caa4ec0f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:28.490923 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2c0987e0-b7bb-4b2f-b316-1874caa4ec0f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:28.499488 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2c0987e0-b7bb-4b2f-b316-1874caa4ec0f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.182126 Aug 04 23:18:28.500326 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 309/646] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:28 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:28.755851 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-56b249e3-bc7c-4bd9-a9c7-eb80d953c487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-676190499", "imageRef": "e1e9d70e-b252-44e5-9ecd-bf73cbf00160", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df517527-9f13-4f5f-b34b-4a2b6e5d80c8"}], "security_groups": [{"name": "tempest-securitygroup--694968253"}], "key_name": "tempest-keypair-203967384", "user_data": "}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:18:28.860058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.network.neutron [None req-56b249e3-bc7c-4bd9-a9c7-eb80d953c487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] validate_networks() for [('df517527-9f13-4f5f-b34b-4a2b6e5d80c8', None, None, None, None, None)] {{(pid=129791) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 23:18:29.291181 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-56b249e3-bc7c-4bd9-a9c7-eb80d953c487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Flavor limits 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 23:18:29.291592 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-56b249e3-bc7c-4bd9-a9c7-eb80d953c487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Image limits 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 23:18:29.292050 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-56b249e3-bc7c-4bd9-a9c7-eb80d953c487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Flavor pref 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 23:18:29.292448 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-56b249e3-bc7c-4bd9-a9c7-eb80d953c487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Image pref 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 23:18:29.292849 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-56b249e3-bc7c-4bd9-a9c7-eb80d953c487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 23:18:29.302582 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-56b249e3-bc7c-4bd9-a9c7-eb80d953c487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:29.303061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-56b249e3-bc7c-4bd9-a9c7-eb80d953c487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:29.303497 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-56b249e3-bc7c-4bd9-a9c7-eb80d953c487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:29.304228 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-56b249e3-bc7c-4bd9-a9c7-eb80d953c487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:29.304708 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-56b249e3-bc7c-4bd9-a9c7-eb80d953c487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:29.305131 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-56b249e3-bc7c-4bd9-a9c7-eb80d953c487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:29.325195 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-56b249e3-bc7c-4bd9-a9c7-eb80d953c487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Getting quotas for project 0422afbb853d4ef2924edf221499971c. Resources: {'ram', 'instances', 'cores'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:18:29.329790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-56b249e3-bc7c-4bd9-a9c7-eb80d953c487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Getting quotas for user b2ceb35afcc046218bdce1ab4983d9f9 and project 0422afbb853d4ef2924edf221499971c. Resources: {'ram', 'instances', 'cores'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:18:29.341860 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-56b249e3-bc7c-4bd9-a9c7-eb80d953c487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Going to run 1 instances... {{(pid=129791) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 23:18:29.344383 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-56b249e3-bc7c-4bd9-a9c7-eb80d953c487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1e9d70e-b252-44e5-9ecd-bf73cbf00160',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 23:18:29.392121 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-56b249e3-bc7c-4bd9-a9c7-eb80d953c487 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.640340 Aug 04 23:18:29.392778 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 338/647] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Aug 4 23:18:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 23:18:29.403760 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a1779f84-b70d-4f2c-a8f0-03e692d60b20 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:29.404946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a1779f84-b70d-4f2c-a8f0-03e692d60b20 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:29.474261 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a1779f84-b70d-4f2c-a8f0-03e692d60b20 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:29.482503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a1779f84-b70d-4f2c-a8f0-03e692d60b20 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da" status: 200 len: 1240 microversion: 2.1 time: 0.082344 Aug 04 23:18:29.483884 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 310/648] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:29 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:29.522652 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-79205883-6de3-4650-8d51-c6f76dc7785a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:29.523262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-79205883-6de3-4650-8d51-c6f76dc7785a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:29.530185 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79205883-6de3-4650-8d51-c6f76dc7785a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:29.530798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79205883-6de3-4650-8d51-c6f76dc7785a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:29.531149 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79205883-6de3-4650-8d51-c6f76dc7785a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:29.531903 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79205883-6de3-4650-8d51-c6f76dc7785a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:29.532286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79205883-6de3-4650-8d51-c6f76dc7785a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:29.532712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79205883-6de3-4650-8d51-c6f76dc7785a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:29.679326 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-79205883-6de3-4650-8d51-c6f76dc7785a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:29.688750 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-79205883-6de3-4650-8d51-c6f76dc7785a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.171454 Aug 04 23:18:29.689522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 339/649] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:29 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:30.507634 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3752c6dc-3b10-43d6-a4e7-15daeb3e4935 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:30.508771 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3752c6dc-3b10-43d6-a4e7-15daeb3e4935 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:30.517371 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3752c6dc-3b10-43d6-a4e7-15daeb3e4935 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:30.518214 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3752c6dc-3b10-43d6-a4e7-15daeb3e4935 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:30.519170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3752c6dc-3b10-43d6-a4e7-15daeb3e4935 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:30.520143 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3752c6dc-3b10-43d6-a4e7-15daeb3e4935 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:30.520667 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3752c6dc-3b10-43d6-a4e7-15daeb3e4935 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:30.521097 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3752c6dc-3b10-43d6-a4e7-15daeb3e4935 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:30.596458 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3752c6dc-3b10-43d6-a4e7-15daeb3e4935 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:30.605459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3752c6dc-3b10-43d6-a4e7-15daeb3e4935 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da" status: 200 len: 1300 microversion: 2.1 time: 0.102899 Aug 04 23:18:30.606057 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 311/650] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:30 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da => generated 1300 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:30.710331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-35aba18e-a53d-47bf-9774-2610e66c6951 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:30.710948 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-35aba18e-a53d-47bf-9774-2610e66c6951 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:30.720018 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35aba18e-a53d-47bf-9774-2610e66c6951 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:30.720628 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35aba18e-a53d-47bf-9774-2610e66c6951 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:30.722660 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35aba18e-a53d-47bf-9774-2610e66c6951 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:30.722660 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35aba18e-a53d-47bf-9774-2610e66c6951 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:30.722660 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35aba18e-a53d-47bf-9774-2610e66c6951 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:30.723007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35aba18e-a53d-47bf-9774-2610e66c6951 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:30.865792 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-35aba18e-a53d-47bf-9774-2610e66c6951 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:30.874408 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-35aba18e-a53d-47bf-9774-2610e66c6951 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.167851 Aug 04 23:18:30.874979 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 340/651] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:30 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:31.628564 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1b1b8510-2495-46cd-afb6-c3da32512d12 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:31.630034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1b1b8510-2495-46cd-afb6-c3da32512d12 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:31.634234 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:18:31.640321 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1b1b8510-2495-46cd-afb6-c3da32512d12 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:31.640808 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1b1b8510-2495-46cd-afb6-c3da32512d12 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:31.641243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1b1b8510-2495-46cd-afb6-c3da32512d12 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:31.642153 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1b1b8510-2495-46cd-afb6-c3da32512d12 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:31.642813 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1b1b8510-2495-46cd-afb6-c3da32512d12 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:31.643252 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1b1b8510-2495-46cd-afb6-c3da32512d12 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:31.796392 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1b1b8510-2495-46cd-afb6-c3da32512d12 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:31.805432 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1b1b8510-2495-46cd-afb6-c3da32512d12 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da" status: 200 len: 1365 microversion: 2.1 time: 0.182470 Aug 04 23:18:31.806051 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 312/652] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:31 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:31.896832 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-be6c206e-e60e-4d02-9b5b-3ecaf9f0daf8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:31.897911 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-be6c206e-e60e-4d02-9b5b-3ecaf9f0daf8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:31.906968 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be6c206e-e60e-4d02-9b5b-3ecaf9f0daf8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:31.907562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be6c206e-e60e-4d02-9b5b-3ecaf9f0daf8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:31.908003 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be6c206e-e60e-4d02-9b5b-3ecaf9f0daf8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:31.908810 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be6c206e-e60e-4d02-9b5b-3ecaf9f0daf8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:31.909399 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be6c206e-e60e-4d02-9b5b-3ecaf9f0daf8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:31.909850 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be6c206e-e60e-4d02-9b5b-3ecaf9f0daf8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:31.941913 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-c86563c3-3f7d-4d8f-952d-089beb748973 req-cc0a2cee-c2ce-4d00-83aa-d80c4f30e22f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd92a5bc-ef36-4c4a-a41a-d76abd2b35da", "tag": "934d7a8a-8b75-4939-ab8e-b06776f0fd31"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:18:31.963576 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-c86563c3-3f7d-4d8f-952d-089beb748973 req-cc0a2cee-c2ce-4d00-83aa-d80c4f30e22f service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:31.964402 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-c86563c3-3f7d-4d8f-952d-089beb748973 req-cc0a2cee-c2ce-4d00-83aa-d80c4f30e22f service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:31.965274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-c86563c3-3f7d-4d8f-952d-089beb748973 req-cc0a2cee-c2ce-4d00-83aa-d80c4f30e22f service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:31.979672 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-c86563c3-3f7d-4d8f-952d-089beb748973 req-cc0a2cee-c2ce-4d00-83aa-d80c4f30e22f service nova] Creating event network-changed:934d7a8a-8b75-4939-ab8e-b06776f0fd31 for instance cd92a5bc-ef36-4c4a-a41a-d76abd2b35da on hv-cinder-85221 Aug 04 23:18:31.985929 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-c86563c3-3f7d-4d8f-952d-089beb748973 req-cc0a2cee-c2ce-4d00-83aa-d80c4f30e22f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050456 Aug 04 23:18:31.986905 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 313/653] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:18:32.060127 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-be6c206e-e60e-4d02-9b5b-3ecaf9f0daf8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:32.068883 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-be6c206e-e60e-4d02-9b5b-3ecaf9f0daf8 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.176288 Aug 04 23:18:32.069458 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 341/654] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:31 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:18:32.828130 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5910e230-1e87-437a-b2dc-0554b90f3d62 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:32.829033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5910e230-1e87-437a-b2dc-0554b90f3d62 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:32.837670 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5910e230-1e87-437a-b2dc-0554b90f3d62 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:32.838495 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5910e230-1e87-437a-b2dc-0554b90f3d62 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:32.838989 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5910e230-1e87-437a-b2dc-0554b90f3d62 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:32.839886 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5910e230-1e87-437a-b2dc-0554b90f3d62 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:32.840381 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5910e230-1e87-437a-b2dc-0554b90f3d62 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:32.840856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5910e230-1e87-437a-b2dc-0554b90f3d62 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:32.978846 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5910e230-1e87-437a-b2dc-0554b90f3d62 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:32.986458 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5910e230-1e87-437a-b2dc-0554b90f3d62 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da" status: 200 len: 1365 microversion: 2.1 time: 0.163154 Aug 04 23:18:32.987022 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 314/655] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:32 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:33.092244 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1b2efd5f-007c-4058-a45a-92d7079c3205 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:33.092901 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1b2efd5f-007c-4058-a45a-92d7079c3205 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:33.095409 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:18:33.101244 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b2efd5f-007c-4058-a45a-92d7079c3205 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:33.101722 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b2efd5f-007c-4058-a45a-92d7079c3205 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:33.102180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b2efd5f-007c-4058-a45a-92d7079c3205 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:33.102925 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b2efd5f-007c-4058-a45a-92d7079c3205 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:33.103372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b2efd5f-007c-4058-a45a-92d7079c3205 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:33.103789 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b2efd5f-007c-4058-a45a-92d7079c3205 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:33.237874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1b2efd5f-007c-4058-a45a-92d7079c3205 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:33.245893 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1b2efd5f-007c-4058-a45a-92d7079c3205 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.158060 Aug 04 23:18:33.246474 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 342/656] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:33 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:34.007515 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5c2781a0-0bdb-47f7-b39d-6ee5aa8b0ab1 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:34.008150 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5c2781a0-0bdb-47f7-b39d-6ee5aa8b0ab1 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:34.015888 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c2781a0-0bdb-47f7-b39d-6ee5aa8b0ab1 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:34.016366 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c2781a0-0bdb-47f7-b39d-6ee5aa8b0ab1 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:34.016794 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c2781a0-0bdb-47f7-b39d-6ee5aa8b0ab1 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:34.017488 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c2781a0-0bdb-47f7-b39d-6ee5aa8b0ab1 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:34.017931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c2781a0-0bdb-47f7-b39d-6ee5aa8b0ab1 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:34.018347 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c2781a0-0bdb-47f7-b39d-6ee5aa8b0ab1 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:34.156015 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5c2781a0-0bdb-47f7-b39d-6ee5aa8b0ab1 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:34.163654 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5c2781a0-0bdb-47f7-b39d-6ee5aa8b0ab1 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da" status: 200 len: 1365 microversion: 2.1 time: 0.159944 Aug 04 23:18:34.164232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 315/657] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:34 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:34.269480 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a84c9678-072b-4ebb-bf75-5e9812831893 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:34.270087 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a84c9678-072b-4ebb-bf75-5e9812831893 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:34.276867 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a84c9678-072b-4ebb-bf75-5e9812831893 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:34.277549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a84c9678-072b-4ebb-bf75-5e9812831893 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:34.277988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a84c9678-072b-4ebb-bf75-5e9812831893 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:34.278730 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a84c9678-072b-4ebb-bf75-5e9812831893 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:34.279187 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a84c9678-072b-4ebb-bf75-5e9812831893 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:34.280184 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a84c9678-072b-4ebb-bf75-5e9812831893 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:34.300589 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:18:34.418752 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a84c9678-072b-4ebb-bf75-5e9812831893 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:34.426740 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a84c9678-072b-4ebb-bf75-5e9812831893 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.161047 Aug 04 23:18:34.427310 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 343/658] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:34 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:35.185393 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-cdaed7f8-52a7-4c9f-9432-819e68f3b4b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:35.187124 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-cdaed7f8-52a7-4c9f-9432-819e68f3b4b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:35.193556 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cdaed7f8-52a7-4c9f-9432-819e68f3b4b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:35.194046 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cdaed7f8-52a7-4c9f-9432-819e68f3b4b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:35.194511 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cdaed7f8-52a7-4c9f-9432-819e68f3b4b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:35.195224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cdaed7f8-52a7-4c9f-9432-819e68f3b4b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:35.195680 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cdaed7f8-52a7-4c9f-9432-819e68f3b4b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:35.196104 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cdaed7f8-52a7-4c9f-9432-819e68f3b4b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:35.340138 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-cdaed7f8-52a7-4c9f-9432-819e68f3b4b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:35.348820 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-cdaed7f8-52a7-4c9f-9432-819e68f3b4b9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da" status: 200 len: 1365 microversion: 2.1 time: 0.168008 Aug 04 23:18:35.349434 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 316/659] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:35 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:35.448014 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9e2db182-b4dd-4b77-ab13-7899011871de tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:35.448686 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9e2db182-b4dd-4b77-ab13-7899011871de tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:35.455917 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e2db182-b4dd-4b77-ab13-7899011871de tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:35.456394 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e2db182-b4dd-4b77-ab13-7899011871de tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:35.456825 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e2db182-b4dd-4b77-ab13-7899011871de tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:35.457517 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e2db182-b4dd-4b77-ab13-7899011871de tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:35.457970 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e2db182-b4dd-4b77-ab13-7899011871de tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:35.458452 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e2db182-b4dd-4b77-ab13-7899011871de tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:35.596946 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9e2db182-b4dd-4b77-ab13-7899011871de tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:35.605197 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9e2db182-b4dd-4b77-ab13-7899011871de tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.161016 Aug 04 23:18:35.605830 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 344/660] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:35 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:36.370224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-438535e3-e50a-468b-b75a-af38194b1a3f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:36.371094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-438535e3-e50a-468b-b75a-af38194b1a3f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:36.377826 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-438535e3-e50a-468b-b75a-af38194b1a3f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:36.378311 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-438535e3-e50a-468b-b75a-af38194b1a3f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:36.378773 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-438535e3-e50a-468b-b75a-af38194b1a3f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:36.379483 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-438535e3-e50a-468b-b75a-af38194b1a3f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:36.379934 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-438535e3-e50a-468b-b75a-af38194b1a3f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:36.380355 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-438535e3-e50a-468b-b75a-af38194b1a3f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:36.384959 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:18:36.524200 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-438535e3-e50a-468b-b75a-af38194b1a3f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:36.533459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-438535e3-e50a-468b-b75a-af38194b1a3f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da" status: 200 len: 1365 microversion: 2.1 time: 0.167092 Aug 04 23:18:36.534060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 317/661] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:36 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:36.627003 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6f7ec03e-ef82-4c96-80b3-e46e37c1e70f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:36.628361 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6f7ec03e-ef82-4c96-80b3-e46e37c1e70f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:36.635317 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f7ec03e-ef82-4c96-80b3-e46e37c1e70f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:36.635894 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f7ec03e-ef82-4c96-80b3-e46e37c1e70f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:36.636401 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f7ec03e-ef82-4c96-80b3-e46e37c1e70f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:36.637232 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f7ec03e-ef82-4c96-80b3-e46e37c1e70f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:36.637757 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f7ec03e-ef82-4c96-80b3-e46e37c1e70f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:36.638189 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f7ec03e-ef82-4c96-80b3-e46e37c1e70f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:36.792295 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6f7ec03e-ef82-4c96-80b3-e46e37c1e70f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:36.801298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6f7ec03e-ef82-4c96-80b3-e46e37c1e70f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.178827 Aug 04 23:18:36.801874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 345/662] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:36 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:37.554945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4415015a-2601-4a86-95b9-fa02746c86a6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:37.555588 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4415015a-2601-4a86-95b9-fa02746c86a6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:37.563017 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4415015a-2601-4a86-95b9-fa02746c86a6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:37.563509 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4415015a-2601-4a86-95b9-fa02746c86a6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:37.563951 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4415015a-2601-4a86-95b9-fa02746c86a6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:37.564656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4415015a-2601-4a86-95b9-fa02746c86a6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:37.565106 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4415015a-2601-4a86-95b9-fa02746c86a6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:37.565530 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4415015a-2601-4a86-95b9-fa02746c86a6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:37.703709 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4415015a-2601-4a86-95b9-fa02746c86a6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:37.711413 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4415015a-2601-4a86-95b9-fa02746c86a6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da" status: 200 len: 1365 microversion: 2.1 time: 0.160380 Aug 04 23:18:37.711992 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 318/663] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:37 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:37.822465 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0ed4fea4-9298-443d-a54f-c4de363c96f2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:37.823017 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0ed4fea4-9298-443d-a54f-c4de363c96f2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:37.831711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0ed4fea4-9298-443d-a54f-c4de363c96f2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:37.832201 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0ed4fea4-9298-443d-a54f-c4de363c96f2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:37.832638 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0ed4fea4-9298-443d-a54f-c4de363c96f2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:37.833339 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0ed4fea4-9298-443d-a54f-c4de363c96f2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:37.833797 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0ed4fea4-9298-443d-a54f-c4de363c96f2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:37.834220 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0ed4fea4-9298-443d-a54f-c4de363c96f2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:37.967949 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0ed4fea4-9298-443d-a54f-c4de363c96f2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:37.975987 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0ed4fea4-9298-443d-a54f-c4de363c96f2 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.157415 Aug 04 23:18:37.976552 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 346/664] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:37 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:38.733072 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1fcc94fc-549a-4665-8502-526467be2654 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:38.733681 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1fcc94fc-549a-4665-8502-526467be2654 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:38.740142 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1fcc94fc-549a-4665-8502-526467be2654 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:38.740620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1fcc94fc-549a-4665-8502-526467be2654 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:38.741047 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1fcc94fc-549a-4665-8502-526467be2654 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:38.741796 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1fcc94fc-549a-4665-8502-526467be2654 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:38.742248 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1fcc94fc-549a-4665-8502-526467be2654 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:38.742697 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1fcc94fc-549a-4665-8502-526467be2654 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:38.834662 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-faeae25a-0c2d-4ce7-b45d-84a5e7248bb0 req-f359221b-84f4-4373-bc46-753b58289916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd92a5bc-ef36-4c4a-a41a-d76abd2b35da", "name": "network-vif-plugged", "status": "completed", "tag": "934d7a8a-8b75-4939-ab8e-b06776f0fd31"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:18:38.846038 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-faeae25a-0c2d-4ce7-b45d-84a5e7248bb0 req-f359221b-84f4-4373-bc46-753b58289916 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:38.846565 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-faeae25a-0c2d-4ce7-b45d-84a5e7248bb0 req-f359221b-84f4-4373-bc46-753b58289916 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:38.847161 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-faeae25a-0c2d-4ce7-b45d-84a5e7248bb0 req-f359221b-84f4-4373-bc46-753b58289916 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:38.861698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-faeae25a-0c2d-4ce7-b45d-84a5e7248bb0 req-f359221b-84f4-4373-bc46-753b58289916 service nova] Creating event network-vif-plugged:934d7a8a-8b75-4939-ab8e-b06776f0fd31 for instance cd92a5bc-ef36-4c4a-a41a-d76abd2b35da on hv-cinder-85221 Aug 04 23:18:38.867253 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-faeae25a-0c2d-4ce7-b45d-84a5e7248bb0 req-f359221b-84f4-4373-bc46-753b58289916 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036098 Aug 04 23:18:38.868376 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 347/665] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:18:38.897236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1fcc94fc-549a-4665-8502-526467be2654 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:38.908363 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1fcc94fc-549a-4665-8502-526467be2654 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da" status: 200 len: 1365 microversion: 2.1 time: 0.179521 Aug 04 23:18:38.909763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 319/666] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:38 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:38.998773 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-126c241e-4514-4d42-b0df-dd5d1d83ad2b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:38.999378 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-126c241e-4514-4d42-b0df-dd5d1d83ad2b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:39.005535 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-126c241e-4514-4d42-b0df-dd5d1d83ad2b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:39.006104 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-126c241e-4514-4d42-b0df-dd5d1d83ad2b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:39.006587 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-126c241e-4514-4d42-b0df-dd5d1d83ad2b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:39.007276 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-126c241e-4514-4d42-b0df-dd5d1d83ad2b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:39.007723 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-126c241e-4514-4d42-b0df-dd5d1d83ad2b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:39.008146 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-126c241e-4514-4d42-b0df-dd5d1d83ad2b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:39.144580 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-126c241e-4514-4d42-b0df-dd5d1d83ad2b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:39.152438 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-126c241e-4514-4d42-b0df-dd5d1d83ad2b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.158019 Aug 04 23:18:39.152993 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 348/667] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:38 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:39.930691 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-24c6aa9e-6a16-454d-ae26-16bf1e32568a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:39.931299 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-24c6aa9e-6a16-454d-ae26-16bf1e32568a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:39.933145 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=6 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:18:39.939439 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24c6aa9e-6a16-454d-ae26-16bf1e32568a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:39.939921 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24c6aa9e-6a16-454d-ae26-16bf1e32568a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:39.940351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24c6aa9e-6a16-454d-ae26-16bf1e32568a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:39.941038 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24c6aa9e-6a16-454d-ae26-16bf1e32568a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:39.941487 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24c6aa9e-6a16-454d-ae26-16bf1e32568a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:39.941905 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24c6aa9e-6a16-454d-ae26-16bf1e32568a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:40.077690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-24c6aa9e-6a16-454d-ae26-16bf1e32568a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:40.085379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-24c6aa9e-6a16-454d-ae26-16bf1e32568a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da" status: 200 len: 1365 microversion: 2.1 time: 0.158497 Aug 04 23:18:40.085924 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 320/668] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:39 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:40.174396 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-26db8d5e-22cb-4e9b-88df-1e8fc11d9b08 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:40.175033 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-26db8d5e-22cb-4e9b-88df-1e8fc11d9b08 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:40.177121 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=2 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:18:40.177787 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=6 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:18:40.183988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26db8d5e-22cb-4e9b-88df-1e8fc11d9b08 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:40.184467 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26db8d5e-22cb-4e9b-88df-1e8fc11d9b08 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:40.184891 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26db8d5e-22cb-4e9b-88df-1e8fc11d9b08 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:40.186812 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26db8d5e-22cb-4e9b-88df-1e8fc11d9b08 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:40.187281 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26db8d5e-22cb-4e9b-88df-1e8fc11d9b08 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:40.187703 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26db8d5e-22cb-4e9b-88df-1e8fc11d9b08 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:40.326983 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-26db8d5e-22cb-4e9b-88df-1e8fc11d9b08 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:40.335973 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-26db8d5e-22cb-4e9b-88df-1e8fc11d9b08 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.165787 Aug 04 23:18:40.336475 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 349/669] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:40 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:41.106220 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ad830e39-69a3-42cb-9b7b-a0c5420008e1 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:41.106857 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ad830e39-69a3-42cb-9b7b-a0c5420008e1 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:41.113981 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad830e39-69a3-42cb-9b7b-a0c5420008e1 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:41.114500 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad830e39-69a3-42cb-9b7b-a0c5420008e1 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:41.114937 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad830e39-69a3-42cb-9b7b-a0c5420008e1 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:41.115627 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad830e39-69a3-42cb-9b7b-a0c5420008e1 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:41.116076 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad830e39-69a3-42cb-9b7b-a0c5420008e1 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:41.116496 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad830e39-69a3-42cb-9b7b-a0c5420008e1 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:41.251296 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ad830e39-69a3-42cb-9b7b-a0c5420008e1 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:41.258754 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ad830e39-69a3-42cb-9b7b-a0c5420008e1 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da" status: 200 len: 1556 microversion: 2.1 time: 0.156370 Aug 04 23:18:41.259348 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 321/670] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:41 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:41.278862 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e4e35250-a79b-4f79-92cb-895a6682b847 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:41.280007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e4e35250-a79b-4f79-92cb-895a6682b847 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:41.287177 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4e35250-a79b-4f79-92cb-895a6682b847 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:41.287650 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4e35250-a79b-4f79-92cb-895a6682b847 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:41.288071 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4e35250-a79b-4f79-92cb-895a6682b847 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:41.288761 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4e35250-a79b-4f79-92cb-895a6682b847 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:41.289204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4e35250-a79b-4f79-92cb-895a6682b847 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:41.289617 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4e35250-a79b-4f79-92cb-895a6682b847 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:41.358227 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1843e989-c21d-4f1d-aecb-b450111c1b9b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:41.358959 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1843e989-c21d-4f1d-aecb-b450111c1b9b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:41.364906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1843e989-c21d-4f1d-aecb-b450111c1b9b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:41.365388 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1843e989-c21d-4f1d-aecb-b450111c1b9b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:41.365812 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1843e989-c21d-4f1d-aecb-b450111c1b9b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:41.366548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1843e989-c21d-4f1d-aecb-b450111c1b9b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:41.366990 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1843e989-c21d-4f1d-aecb-b450111c1b9b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:41.367405 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1843e989-c21d-4f1d-aecb-b450111c1b9b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:41.382028 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e4e35250-a79b-4f79-92cb-895a6682b847 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107208 Aug 04 23:18:41.383726 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 350/671] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Aug 4 23:18:41 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:18:41.668808 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1843e989-c21d-4f1d-aecb-b450111c1b9b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:41.678192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1843e989-c21d-4f1d-aecb-b450111c1b9b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.324296 Aug 04 23:18:41.678837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 322/672] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:41 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:18:42.553917 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-29129ebc-81fc-4f7b-9a07-d4d45c9a45da req-6b887481-c9b4-4b6d-8e97-af4ab77e23e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd92a5bc-ef36-4c4a-a41a-d76abd2b35da", "tag": "934d7a8a-8b75-4939-ab8e-b06776f0fd31"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:18:42.566197 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-29129ebc-81fc-4f7b-9a07-d4d45c9a45da req-6b887481-c9b4-4b6d-8e97-af4ab77e23e2 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:42.566745 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-29129ebc-81fc-4f7b-9a07-d4d45c9a45da req-6b887481-c9b4-4b6d-8e97-af4ab77e23e2 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:42.567243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-29129ebc-81fc-4f7b-9a07-d4d45c9a45da req-6b887481-c9b4-4b6d-8e97-af4ab77e23e2 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:42.579171 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-29129ebc-81fc-4f7b-9a07-d4d45c9a45da req-6b887481-c9b4-4b6d-8e97-af4ab77e23e2 service nova] Creating event network-changed:934d7a8a-8b75-4939-ab8e-b06776f0fd31 for instance cd92a5bc-ef36-4c4a-a41a-d76abd2b35da on hv-cinder-85221 Aug 04 23:18:42.584429 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-29129ebc-81fc-4f7b-9a07-d4d45c9a45da req-6b887481-c9b4-4b6d-8e97-af4ab77e23e2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098400 Aug 04 23:18:42.585211 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 351/673] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:18:42.700469 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ab931308-09e9-4bcf-9b19-2196f559dcf0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:42.700469 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ab931308-09e9-4bcf-9b19-2196f559dcf0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:42.706770 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab931308-09e9-4bcf-9b19-2196f559dcf0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:42.707258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab931308-09e9-4bcf-9b19-2196f559dcf0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:42.707687 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab931308-09e9-4bcf-9b19-2196f559dcf0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:42.708388 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab931308-09e9-4bcf-9b19-2196f559dcf0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:42.709067 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab931308-09e9-4bcf-9b19-2196f559dcf0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:42.709252 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab931308-09e9-4bcf-9b19-2196f559dcf0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:42.846780 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ab931308-09e9-4bcf-9b19-2196f559dcf0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:42.855064 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ab931308-09e9-4bcf-9b19-2196f559dcf0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.159224 Aug 04 23:18:42.855640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 323/674] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:42 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:43.877702 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-75f511a0-0891-46e2-a327-89a90386fa2b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:43.878420 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-75f511a0-0891-46e2-a327-89a90386fa2b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:43.885892 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-75f511a0-0891-46e2-a327-89a90386fa2b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:43.886658 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-75f511a0-0891-46e2-a327-89a90386fa2b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:43.887084 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-75f511a0-0891-46e2-a327-89a90386fa2b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:43.887786 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-75f511a0-0891-46e2-a327-89a90386fa2b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:43.888240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-75f511a0-0891-46e2-a327-89a90386fa2b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:43.889352 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-75f511a0-0891-46e2-a327-89a90386fa2b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:44.028767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-75f511a0-0891-46e2-a327-89a90386fa2b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:44.037267 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-75f511a0-0891-46e2-a327-89a90386fa2b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.164695 Aug 04 23:18:44.037829 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 352/675] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:43 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:45.059612 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6cf3a14c-ff9f-4c5d-98eb-9ae656418238 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:45.060246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6cf3a14c-ff9f-4c5d-98eb-9ae656418238 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:45.067009 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6cf3a14c-ff9f-4c5d-98eb-9ae656418238 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:45.067483 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6cf3a14c-ff9f-4c5d-98eb-9ae656418238 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:45.067908 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6cf3a14c-ff9f-4c5d-98eb-9ae656418238 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:45.068582 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6cf3a14c-ff9f-4c5d-98eb-9ae656418238 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:45.069024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6cf3a14c-ff9f-4c5d-98eb-9ae656418238 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:45.069440 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6cf3a14c-ff9f-4c5d-98eb-9ae656418238 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:45.202404 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6cf3a14c-ff9f-4c5d-98eb-9ae656418238 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:45.210426 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6cf3a14c-ff9f-4c5d-98eb-9ae656418238 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.154670 Aug 04 23:18:45.211002 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 324/676] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:45 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:46.234824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2d7dee73-12cb-4028-91b3-e46c352a1650 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:46.235629 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2d7dee73-12cb-4028-91b3-e46c352a1650 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:46.242243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d7dee73-12cb-4028-91b3-e46c352a1650 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:46.242833 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d7dee73-12cb-4028-91b3-e46c352a1650 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:46.243268 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d7dee73-12cb-4028-91b3-e46c352a1650 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:46.243975 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d7dee73-12cb-4028-91b3-e46c352a1650 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:46.244429 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d7dee73-12cb-4028-91b3-e46c352a1650 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:46.244854 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d7dee73-12cb-4028-91b3-e46c352a1650 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:46.383801 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2d7dee73-12cb-4028-91b3-e46c352a1650 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:46.392570 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2d7dee73-12cb-4028-91b3-e46c352a1650 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.162852 Aug 04 23:18:46.393127 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 353/677] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:46 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:47.413930 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5b5bfd6e-44f9-49f1-93e7-0465ee79b439 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:47.414633 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5b5bfd6e-44f9-49f1-93e7-0465ee79b439 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:47.421808 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5b5bfd6e-44f9-49f1-93e7-0465ee79b439 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:47.422288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5b5bfd6e-44f9-49f1-93e7-0465ee79b439 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:47.422741 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5b5bfd6e-44f9-49f1-93e7-0465ee79b439 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:47.423432 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5b5bfd6e-44f9-49f1-93e7-0465ee79b439 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:47.423900 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5b5bfd6e-44f9-49f1-93e7-0465ee79b439 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:47.424396 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5b5bfd6e-44f9-49f1-93e7-0465ee79b439 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:47.573129 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5b5bfd6e-44f9-49f1-93e7-0465ee79b439 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:47.581654 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5b5bfd6e-44f9-49f1-93e7-0465ee79b439 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.171690 Aug 04 23:18:47.582216 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 325/678] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:47 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:48.603590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2dc4a2a3-d8c8-4513-9e1e-f4e8dc1af030 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:48.604194 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2dc4a2a3-d8c8-4513-9e1e-f4e8dc1af030 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:48.611327 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2dc4a2a3-d8c8-4513-9e1e-f4e8dc1af030 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:48.611806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2dc4a2a3-d8c8-4513-9e1e-f4e8dc1af030 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:48.612243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2dc4a2a3-d8c8-4513-9e1e-f4e8dc1af030 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:48.612930 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2dc4a2a3-d8c8-4513-9e1e-f4e8dc1af030 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:48.613378 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2dc4a2a3-d8c8-4513-9e1e-f4e8dc1af030 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:48.613798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2dc4a2a3-d8c8-4513-9e1e-f4e8dc1af030 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:48.743170 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2dc4a2a3-d8c8-4513-9e1e-f4e8dc1af030 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:48.751295 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2dc4a2a3-d8c8-4513-9e1e-f4e8dc1af030 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.151563 Aug 04 23:18:48.751869 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 354/679] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:48 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:49.771921 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a8569356-d6b9-4154-b8de-2cbfba945201 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:49.772552 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a8569356-d6b9-4154-b8de-2cbfba945201 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:49.779123 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8569356-d6b9-4154-b8de-2cbfba945201 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:49.779614 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8569356-d6b9-4154-b8de-2cbfba945201 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:49.780072 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8569356-d6b9-4154-b8de-2cbfba945201 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:49.780738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8569356-d6b9-4154-b8de-2cbfba945201 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:49.781176 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8569356-d6b9-4154-b8de-2cbfba945201 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:49.781590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8569356-d6b9-4154-b8de-2cbfba945201 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:49.922592 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a8569356-d6b9-4154-b8de-2cbfba945201 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:49.930663 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a8569356-d6b9-4154-b8de-2cbfba945201 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.162514 Aug 04 23:18:49.931227 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 326/680] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:49 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:18:50.952304 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ade7dd16-f257-4ed1-a647-749fd4b6f5f0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:50.953092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ade7dd16-f257-4ed1-a647-749fd4b6f5f0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:50.959578 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ade7dd16-f257-4ed1-a647-749fd4b6f5f0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:50.960089 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ade7dd16-f257-4ed1-a647-749fd4b6f5f0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:50.960538 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ade7dd16-f257-4ed1-a647-749fd4b6f5f0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:50.961235 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ade7dd16-f257-4ed1-a647-749fd4b6f5f0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:50.961688 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ade7dd16-f257-4ed1-a647-749fd4b6f5f0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:50.962126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ade7dd16-f257-4ed1-a647-749fd4b6f5f0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:51.098733 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ade7dd16-f257-4ed1-a647-749fd4b6f5f0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:51.106663 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ade7dd16-f257-4ed1-a647-749fd4b6f5f0 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.158773 Aug 04 23:18:51.107223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 355/681] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:50 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:52.128663 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1dc1f958-0035-4534-9fc5-fe6bdfbc1dfa tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:52.129192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1dc1f958-0035-4534-9fc5-fe6bdfbc1dfa tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:52.135869 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1dc1f958-0035-4534-9fc5-fe6bdfbc1dfa tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:52.136348 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1dc1f958-0035-4534-9fc5-fe6bdfbc1dfa tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:52.136781 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1dc1f958-0035-4534-9fc5-fe6bdfbc1dfa tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:52.137468 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1dc1f958-0035-4534-9fc5-fe6bdfbc1dfa tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:52.137917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1dc1f958-0035-4534-9fc5-fe6bdfbc1dfa tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:52.138960 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1dc1f958-0035-4534-9fc5-fe6bdfbc1dfa tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:52.291252 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1dc1f958-0035-4534-9fc5-fe6bdfbc1dfa tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:52.300344 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1dc1f958-0035-4534-9fc5-fe6bdfbc1dfa tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.175566 Aug 04 23:18:52.300924 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 327/682] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:52 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:18:53.322622 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-987b855d-9ce1-41ca-af38-e47d8aacd78e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:53.323398 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-987b855d-9ce1-41ca-af38-e47d8aacd78e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:53.329967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-987b855d-9ce1-41ca-af38-e47d8aacd78e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:53.330483 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-987b855d-9ce1-41ca-af38-e47d8aacd78e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:53.330914 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-987b855d-9ce1-41ca-af38-e47d8aacd78e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:53.331599 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-987b855d-9ce1-41ca-af38-e47d8aacd78e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:53.332044 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-987b855d-9ce1-41ca-af38-e47d8aacd78e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:53.332455 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-987b855d-9ce1-41ca-af38-e47d8aacd78e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:53.466986 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-987b855d-9ce1-41ca-af38-e47d8aacd78e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:53.475481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-987b855d-9ce1-41ca-af38-e47d8aacd78e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1736 microversion: 2.1 time: 0.156841 Aug 04 23:18:53.476055 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 356/683] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:53 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:54.497496 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-755c1bfe-2ea6-4484-afcb-0918888aa7b1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:54.498840 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-755c1bfe-2ea6-4484-afcb-0918888aa7b1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:54.505443 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-755c1bfe-2ea6-4484-afcb-0918888aa7b1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:54.505936 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-755c1bfe-2ea6-4484-afcb-0918888aa7b1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:54.506383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-755c1bfe-2ea6-4484-afcb-0918888aa7b1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:54.507104 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-755c1bfe-2ea6-4484-afcb-0918888aa7b1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:54.507587 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-755c1bfe-2ea6-4484-afcb-0918888aa7b1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:54.507975 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-755c1bfe-2ea6-4484-afcb-0918888aa7b1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:54.644233 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-755c1bfe-2ea6-4484-afcb-0918888aa7b1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:54.652494 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-755c1bfe-2ea6-4484-afcb-0918888aa7b1 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1716 microversion: 2.1 time: 0.158825 Aug 04 23:18:54.653076 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 328/684] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:54 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:54.717661 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b5156c10-7131-48ea-8c30-b3bd0fc101ee tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:54.718261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b5156c10-7131-48ea-8c30-b3bd0fc101ee tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:54.724750 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b5156c10-7131-48ea-8c30-b3bd0fc101ee tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:54.725219 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b5156c10-7131-48ea-8c30-b3bd0fc101ee tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:54.725646 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b5156c10-7131-48ea-8c30-b3bd0fc101ee tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:54.726332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b5156c10-7131-48ea-8c30-b3bd0fc101ee tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:54.726824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b5156c10-7131-48ea-8c30-b3bd0fc101ee tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:54.727236 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b5156c10-7131-48ea-8c30-b3bd0fc101ee tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:54.822563 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-b5156c10-7131-48ea-8c30-b3bd0fc101ee tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] HTTP exception thrown: Cannot 'detach_volume' instance 13d950e0-48a6-44d6-9aae-723354b66c48 while it is in vm_state rescued Aug 04 23:18:54.824180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b5156c10-7131-48ea-8c30-b3bd0fc101ee tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Request method failure captured: Aug 04 23:18:54.824180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: DELETE /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48/os-volume_attachments/c836dab1-62d9-4b8e-b0e6-3ede1b45f2ff HTTP/1.1 Aug 04 23:18:54.824180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:18:54.824180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:18:54.824180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:18:54.824180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 0 Aug 04 23:18:54.824180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:18:54.824180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:18:54.824180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:18:54.824180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:18:54.824180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FJ6RKYMdfsISiTgYEMvks0x5d50WB4Vbj1WQgE1v6AQbUxoUYQTrWgb9IvdiKRoAPbIyfnSaCOdg5gEaB9t_gZ5C6HO6cjgM58wzr3Oq1EOqCSLuKxKWCkjyonkLQBDSxbLmeiJH_Z9CWvDApSZl7vw3VKIMJPpD2CVXPZhXNad-G8 Aug 04 23:18:54.824180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:18:54.824180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:18:54.824180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:18:54.824180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:18:54.824180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:18:54.824180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:18:54.824180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: f50215d0b0ec4a109e14979c183a52a3 Aug 04 23:18:54.824180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-475500057 Aug 04 23:18:54.824180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:18:54.824180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:18:54.827109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f50215d0b0ec4a109e14979c183a52a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f50215d0b0ec4a109e14979c183a52a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f50215d0b0ec4a109e14979c183a52a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f50215d0b0ec4a109e14979c183a52a3"}]}] Aug 04 23:18:54.827109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-ServerRescueNegativeTestJSON-475500057 Aug 04 23:18:54.827109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: f50215d0b0ec4a109e14979c183a52a3 Aug 04 23:18:54.827109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-475500057 Aug 04 23:18:54.827109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-ServerRescueNegativeTestJSON-475500057-project Aug 04 23:18:54.827109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:18:54.827109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:18:54.827109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: 51af2dbb470849a4a044f6f78eef2d45 Aug 04 23:18:54.827109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-ServerRescueNegativeTestJSON-475500057-project Aug 04 23:18:54.827109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: > Aug 04 23:18:54.827109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Cannot 'detach_volume' instance 13d950e0-48a6-44d6-9aae-723354b66c48 while it is in vm_state rescued Aug 04 23:18:54.827863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'server_id': '13d950e0-48a6-44d6-9aae-723354b66c48', 'id': 'c836dab1-62d9-4b8e-b0e6-3ede1b45f2ff'} Aug 04 23:18:54.827863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:18:54.827863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:18:54.827863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 04 23:18:54.827863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 04 23:18:54.827863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 23:18:54.827863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 23:18:54.827863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 23:18:54.827863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 23:18:54.827863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 13d950e0-48a6-44d6-9aae-723354b66c48 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 04 23:18:54.827863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:18:54.827863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:18:54.827863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:18:54.827863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:18:54.827863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:18:54.827863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:18:54.827863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:18:54.827863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:18:54.827863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:18:54.827863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:18:54.829072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 04 23:18:54.829072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 23:18:54.829072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 23:18:54.829072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 23:18:54.829072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 13d950e0-48a6-44d6-9aae-723354b66c48 while it is in vm_state rescued Aug 04 23:18:54.829072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:18:54.829072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:18:54.829072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:18:54.829072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:18:54.829072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:18:54.829072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:18:54.829072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:18:54.829072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:18:54.829072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 13d950e0-48a6-44d6-9aae-723354b66c48 while it is in vm_state rescued Aug 04 23:18:54.829072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:18:54.829072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b5156c10-7131-48ea-8c30-b3bd0fc101ee tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Returning 409 to user: Cannot 'detach_volume' instance 13d950e0-48a6-44d6-9aae-723354b66c48 while it is in vm_state rescued {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:18:54.830965 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b5156c10-7131-48ea-8c30-b3bd0fc101ee tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "DELETE /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48/os-volume_attachments/c836dab1-62d9-4b8e-b0e6-3ede1b45f2ff" status: 409 len: 152 microversion: 2.1 time: 0.112566 Aug 04 23:18:54.830965 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 357/685] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Aug 4 23:18:54 2022] DELETE /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48/os-volume_attachments/c836dab1-62d9-4b8e-b0e6-3ede1b45f2ff => generated 152 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 23:18:54.835623 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5e1c7e0a-85a2-4793-9217-ca817976a7c4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:18:54.835816 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5e1c7e0a-85a2-4793-9217-ca817976a7c4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:54.842235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e1c7e0a-85a2-4793-9217-ca817976a7c4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:54.842759 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e1c7e0a-85a2-4793-9217-ca817976a7c4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:54.843193 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e1c7e0a-85a2-4793-9217-ca817976a7c4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:54.843911 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e1c7e0a-85a2-4793-9217-ca817976a7c4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:54.844351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e1c7e0a-85a2-4793-9217-ca817976a7c4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:54.844769 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e1c7e0a-85a2-4793-9217-ca817976a7c4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:54.921925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5e1c7e0a-85a2-4793-9217-ca817976a7c4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "POST /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48/action" status: 202 len: 0 microversion: 2.1 time: 0.090006 Aug 04 23:18:54.922756 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 329/686] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Aug 4 23:18:54 2022] POST /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:18:54.939246 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-99007b2b-f529-4f18-af9a-f649640db07f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:54.940261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-99007b2b-f529-4f18-af9a-f649640db07f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:54.949021 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-99007b2b-f529-4f18-af9a-f649640db07f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:54.949560 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-99007b2b-f529-4f18-af9a-f649640db07f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:54.949992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-99007b2b-f529-4f18-af9a-f649640db07f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:54.950732 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-99007b2b-f529-4f18-af9a-f649640db07f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:54.951743 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-99007b2b-f529-4f18-af9a-f649640db07f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:54.952315 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-99007b2b-f529-4f18-af9a-f649640db07f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:55.103696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-99007b2b-f529-4f18-af9a-f649640db07f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:55.113383 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-99007b2b-f529-4f18-af9a-f649640db07f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1724 microversion: 2.1 time: 0.181658 Aug 04 23:18:55.113966 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 358/687] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:54 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:56.136180 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6a69a2f9-6728-4398-85ff-4debd71fe15a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:56.136830 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6a69a2f9-6728-4398-85ff-4debd71fe15a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:56.144238 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a69a2f9-6728-4398-85ff-4debd71fe15a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:56.144715 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a69a2f9-6728-4398-85ff-4debd71fe15a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:56.145140 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a69a2f9-6728-4398-85ff-4debd71fe15a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:56.145836 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a69a2f9-6728-4398-85ff-4debd71fe15a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:56.146281 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a69a2f9-6728-4398-85ff-4debd71fe15a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:56.146726 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a69a2f9-6728-4398-85ff-4debd71fe15a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:56.295984 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6a69a2f9-6728-4398-85ff-4debd71fe15a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:56.308573 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6a69a2f9-6728-4398-85ff-4debd71fe15a tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1724 microversion: 2.1 time: 0.176397 Aug 04 23:18:56.309514 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 330/688] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:56 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:57.337169 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0f57e6ba-0f29-4267-978d-402ba56e022f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:57.337789 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0f57e6ba-0f29-4267-978d-402ba56e022f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:57.345490 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f57e6ba-0f29-4267-978d-402ba56e022f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:57.345979 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f57e6ba-0f29-4267-978d-402ba56e022f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:57.346441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f57e6ba-0f29-4267-978d-402ba56e022f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:57.347155 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f57e6ba-0f29-4267-978d-402ba56e022f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:57.347608 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f57e6ba-0f29-4267-978d-402ba56e022f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:57.348026 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f57e6ba-0f29-4267-978d-402ba56e022f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:57.494018 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0f57e6ba-0f29-4267-978d-402ba56e022f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:57.503481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0f57e6ba-0f29-4267-978d-402ba56e022f tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1724 microversion: 2.1 time: 0.170128 Aug 04 23:18:57.504049 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 359/689] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:57 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:58.525202 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-92f98eab-79bf-415e-bb99-a8814e20bc1b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:58.525933 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-92f98eab-79bf-415e-bb99-a8814e20bc1b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:58.533423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92f98eab-79bf-415e-bb99-a8814e20bc1b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:58.533941 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92f98eab-79bf-415e-bb99-a8814e20bc1b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:58.534389 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92f98eab-79bf-415e-bb99-a8814e20bc1b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:58.535100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92f98eab-79bf-415e-bb99-a8814e20bc1b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:58.535548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92f98eab-79bf-415e-bb99-a8814e20bc1b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:58.535965 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92f98eab-79bf-415e-bb99-a8814e20bc1b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:58.671860 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-92f98eab-79bf-415e-bb99-a8814e20bc1b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:58.680358 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-92f98eab-79bf-415e-bb99-a8814e20bc1b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1724 microversion: 2.1 time: 0.158995 Aug 04 23:18:58.680928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 331/690] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:58 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:59.701665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-12118fe2-2dbe-428f-abfe-00df4e5f7c74 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:59.702307 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-12118fe2-2dbe-428f-abfe-00df4e5f7c74 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:59.708802 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-12118fe2-2dbe-428f-abfe-00df4e5f7c74 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:59.709280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-12118fe2-2dbe-428f-abfe-00df4e5f7c74 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:59.709709 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-12118fe2-2dbe-428f-abfe-00df4e5f7c74 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:59.710427 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-12118fe2-2dbe-428f-abfe-00df4e5f7c74 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:59.710880 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-12118fe2-2dbe-428f-abfe-00df4e5f7c74 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:59.711296 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-12118fe2-2dbe-428f-abfe-00df4e5f7c74 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:59.848746 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-12118fe2-2dbe-428f-abfe-00df4e5f7c74 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:18:59.857005 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-12118fe2-2dbe-428f-abfe-00df4e5f7c74 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1730 microversion: 2.1 time: 0.159587 Aug 04 23:18:59.858066 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 360/691] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:18:59 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:18:59.877631 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4b74d0f0-0606-432c-8a8b-2023cae35cbe tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:18:59.878146 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4b74d0f0-0606-432c-8a8b-2023cae35cbe tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:18:59.885577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b74d0f0-0606-432c-8a8b-2023cae35cbe tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:59.886074 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b74d0f0-0606-432c-8a8b-2023cae35cbe tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:59.886581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b74d0f0-0606-432c-8a8b-2023cae35cbe tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:59.887289 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b74d0f0-0606-432c-8a8b-2023cae35cbe tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:18:59.887744 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b74d0f0-0606-432c-8a8b-2023cae35cbe tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:18:59.888197 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b74d0f0-0606-432c-8a8b-2023cae35cbe tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:18:59.971559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4b74d0f0-0606-432c-8a8b-2023cae35cbe tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097755 Aug 04 23:18:59.972149 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 332/692] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Aug 4 23:18:59 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:19:01.105315 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-5d61b011-95cf-4448-99f7-9e0c268b5056 req-785b8a74-a4c9-4609-a0ad-78c5ee0d9e25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13d950e0-48a6-44d6-9aae-723354b66c48", "tag": "e81f804d-489a-45c5-bf6d-27259b247ae5"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:19:01.116998 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-5d61b011-95cf-4448-99f7-9e0c268b5056 req-785b8a74-a4c9-4609-a0ad-78c5ee0d9e25 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:01.117470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-5d61b011-95cf-4448-99f7-9e0c268b5056 req-785b8a74-a4c9-4609-a0ad-78c5ee0d9e25 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:01.117892 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-5d61b011-95cf-4448-99f7-9e0c268b5056 req-785b8a74-a4c9-4609-a0ad-78c5ee0d9e25 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:01.131593 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-5d61b011-95cf-4448-99f7-9e0c268b5056 req-785b8a74-a4c9-4609-a0ad-78c5ee0d9e25 service nova] Creating event network-changed:e81f804d-489a-45c5-bf6d-27259b247ae5 for instance 13d950e0-48a6-44d6-9aae-723354b66c48 on hv-cinder-85221 Aug 04 23:19:01.137140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-5d61b011-95cf-4448-99f7-9e0c268b5056 req-785b8a74-a4c9-4609-a0ad-78c5ee0d9e25 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035992 Aug 04 23:19:01.137893 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 361/693] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:19:03.155197 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-8e586873-8dd5-43ca-bd4b-2870cbca6f7f req-3417bfed-9d48-4aad-b46e-be34b6ded5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13d950e0-48a6-44d6-9aae-723354b66c48", "tag": "e81f804d-489a-45c5-bf6d-27259b247ae5"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:19:03.164341 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=42 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:19:03.175605 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-8e586873-8dd5-43ca-bd4b-2870cbca6f7f req-3417bfed-9d48-4aad-b46e-be34b6ded5f4 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:03.176464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-8e586873-8dd5-43ca-bd4b-2870cbca6f7f req-3417bfed-9d48-4aad-b46e-be34b6ded5f4 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:03.177248 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-8e586873-8dd5-43ca-bd4b-2870cbca6f7f req-3417bfed-9d48-4aad-b46e-be34b6ded5f4 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:03.184387 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:19:03.200177 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-8e586873-8dd5-43ca-bd4b-2870cbca6f7f req-3417bfed-9d48-4aad-b46e-be34b6ded5f4 service nova] Creating event network-changed:e81f804d-489a-45c5-bf6d-27259b247ae5 for instance 13d950e0-48a6-44d6-9aae-723354b66c48 on hv-cinder-85221 Aug 04 23:19:03.210055 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-8e586873-8dd5-43ca-bd4b-2870cbca6f7f req-3417bfed-9d48-4aad-b46e-be34b6ded5f4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061075 Aug 04 23:19:03.211320 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 333/694] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:19:16.916668 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=39 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:19:16.917439 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=96 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:19:16.922164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1156ab30-0a52-4c79-b71d-d65abc640e48 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:19:16.924751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1156ab30-0a52-4c79-b71d-d65abc640e48 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:16.932563 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1156ab30-0a52-4c79-b71d-d65abc640e48 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:16.933053 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1156ab30-0a52-4c79-b71d-d65abc640e48 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:16.933485 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1156ab30-0a52-4c79-b71d-d65abc640e48 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:16.934188 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1156ab30-0a52-4c79-b71d-d65abc640e48 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:16.934726 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1156ab30-0a52-4c79-b71d-d65abc640e48 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:16.935261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1156ab30-0a52-4c79-b71d-d65abc640e48 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:17.020623 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1156ab30-0a52-4c79-b71d-d65abc640e48 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "POST /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe/action" status: 202 len: 0 microversion: 2.1 time: 0.105341 Aug 04 23:19:17.021297 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 362/695] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Aug 4 23:19:16 2022] POST /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:19:17.027680 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:19:17.033121 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e9cedcfd-56d3-42f4-84ad-dd323e5a7648 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:17.037910 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e9cedcfd-56d3-42f4-84ad-dd323e5a7648 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:17.040671 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e9cedcfd-56d3-42f4-84ad-dd323e5a7648 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:17.041154 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e9cedcfd-56d3-42f4-84ad-dd323e5a7648 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:17.041589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e9cedcfd-56d3-42f4-84ad-dd323e5a7648 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:17.042338 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e9cedcfd-56d3-42f4-84ad-dd323e5a7648 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:17.042799 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e9cedcfd-56d3-42f4-84ad-dd323e5a7648 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:17.043224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e9cedcfd-56d3-42f4-84ad-dd323e5a7648 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:17.222398 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e9cedcfd-56d3-42f4-84ad-dd323e5a7648 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:17.232717 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e9cedcfd-56d3-42f4-84ad-dd323e5a7648 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1752 microversion: 2.1 time: 0.205789 Aug 04 23:19:17.233762 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 334/696] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:19:17 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1752 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:19:18.259485 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4ddb370b-9c17-45c9-89e1-bd2a8d87fcc1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:18.260579 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4ddb370b-9c17-45c9-89e1-bd2a8d87fcc1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:18.269013 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ddb370b-9c17-45c9-89e1-bd2a8d87fcc1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:18.269645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ddb370b-9c17-45c9-89e1-bd2a8d87fcc1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:18.270147 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ddb370b-9c17-45c9-89e1-bd2a8d87fcc1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:18.271096 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ddb370b-9c17-45c9-89e1-bd2a8d87fcc1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:18.271582 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ddb370b-9c17-45c9-89e1-bd2a8d87fcc1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:18.272167 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ddb370b-9c17-45c9-89e1-bd2a8d87fcc1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:18.434336 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4ddb370b-9c17-45c9-89e1-bd2a8d87fcc1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:18.443897 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4ddb370b-9c17-45c9-89e1-bd2a8d87fcc1 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1757 microversion: 2.1 time: 0.188845 Aug 04 23:19:18.444480 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 363/697] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:19:18 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:19:19.468665 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-47bad85c-b028-44cf-ba44-2304aa3cba54 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:19.469462 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-47bad85c-b028-44cf-ba44-2304aa3cba54 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:19.476280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-47bad85c-b028-44cf-ba44-2304aa3cba54 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:19.476761 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-47bad85c-b028-44cf-ba44-2304aa3cba54 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:19.477189 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-47bad85c-b028-44cf-ba44-2304aa3cba54 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:19.477894 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-47bad85c-b028-44cf-ba44-2304aa3cba54 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:19.478337 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-47bad85c-b028-44cf-ba44-2304aa3cba54 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:19.478844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-47bad85c-b028-44cf-ba44-2304aa3cba54 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:19.637382 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-47bad85c-b028-44cf-ba44-2304aa3cba54 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:19.645788 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-47bad85c-b028-44cf-ba44-2304aa3cba54 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1757 microversion: 2.1 time: 0.183670 Aug 04 23:19:19.646380 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 335/698] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:19:19 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:19:20.668213 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a04eafe4-5340-46e3-8835-2a8d30216760 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:20.668823 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a04eafe4-5340-46e3-8835-2a8d30216760 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:20.676430 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a04eafe4-5340-46e3-8835-2a8d30216760 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:20.676915 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a04eafe4-5340-46e3-8835-2a8d30216760 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:20.677345 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a04eafe4-5340-46e3-8835-2a8d30216760 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:20.678055 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a04eafe4-5340-46e3-8835-2a8d30216760 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:20.678543 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a04eafe4-5340-46e3-8835-2a8d30216760 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:20.678978 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a04eafe4-5340-46e3-8835-2a8d30216760 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:20.842805 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a04eafe4-5340-46e3-8835-2a8d30216760 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:20.855719 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a04eafe4-5340-46e3-8835-2a8d30216760 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1757 microversion: 2.1 time: 0.190928 Aug 04 23:19:20.857398 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 364/699] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:19:20 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1757 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:19:21.880110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-992a9c94-ce97-46bf-9c54-f933c27e20a3 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:21.880762 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-992a9c94-ce97-46bf-9c54-f933c27e20a3 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:21.888502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-992a9c94-ce97-46bf-9c54-f933c27e20a3 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:21.889052 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-992a9c94-ce97-46bf-9c54-f933c27e20a3 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:21.889528 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-992a9c94-ce97-46bf-9c54-f933c27e20a3 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:21.890450 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-992a9c94-ce97-46bf-9c54-f933c27e20a3 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:21.890866 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-992a9c94-ce97-46bf-9c54-f933c27e20a3 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:21.891422 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-992a9c94-ce97-46bf-9c54-f933c27e20a3 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:22.063213 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-992a9c94-ce97-46bf-9c54-f933c27e20a3 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:22.071612 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-992a9c94-ce97-46bf-9c54-f933c27e20a3 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1757 microversion: 2.1 time: 0.195694 Aug 04 23:19:22.072202 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 336/700] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:19:21 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:19:23.096748 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-33510b0b-bfde-49a3-84c1-00bebe4554ba tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:23.097564 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-33510b0b-bfde-49a3-84c1-00bebe4554ba tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:23.103783 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33510b0b-bfde-49a3-84c1-00bebe4554ba tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:23.104264 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33510b0b-bfde-49a3-84c1-00bebe4554ba tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:23.104689 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33510b0b-bfde-49a3-84c1-00bebe4554ba tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:23.105401 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33510b0b-bfde-49a3-84c1-00bebe4554ba tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:23.105838 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33510b0b-bfde-49a3-84c1-00bebe4554ba tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:23.106259 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33510b0b-bfde-49a3-84c1-00bebe4554ba tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:23.285065 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-33510b0b-bfde-49a3-84c1-00bebe4554ba tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:23.293798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-33510b0b-bfde-49a3-84c1-00bebe4554ba tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1757 microversion: 2.1 time: 0.201827 Aug 04 23:19:23.295213 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 365/701] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:19:23 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1757 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:19:24.316805 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-33c50d56-b38b-403f-91db-0af7712c912c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:24.317422 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-33c50d56-b38b-403f-91db-0af7712c912c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:24.330033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-33c50d56-b38b-403f-91db-0af7712c912c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:24.330550 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-33c50d56-b38b-403f-91db-0af7712c912c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:24.330984 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-33c50d56-b38b-403f-91db-0af7712c912c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:24.331688 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-33c50d56-b38b-403f-91db-0af7712c912c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:24.332133 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-33c50d56-b38b-403f-91db-0af7712c912c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:24.332547 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-33c50d56-b38b-403f-91db-0af7712c912c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:24.509830 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-33c50d56-b38b-403f-91db-0af7712c912c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:24.518820 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-33c50d56-b38b-403f-91db-0af7712c912c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1757 microversion: 2.1 time: 0.205754 Aug 04 23:19:24.519424 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 337/702] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:19:24 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1757 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:19:25.541033 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0f1689ca-fbd5-4742-9447-8c91b5074c45 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:25.541736 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0f1689ca-fbd5-4742-9447-8c91b5074c45 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:25.548623 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f1689ca-fbd5-4742-9447-8c91b5074c45 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:25.549109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f1689ca-fbd5-4742-9447-8c91b5074c45 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:25.549546 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f1689ca-fbd5-4742-9447-8c91b5074c45 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:25.550263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f1689ca-fbd5-4742-9447-8c91b5074c45 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:25.552202 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f1689ca-fbd5-4742-9447-8c91b5074c45 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:25.552202 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0f1689ca-fbd5-4742-9447-8c91b5074c45 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:25.711295 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0f1689ca-fbd5-4742-9447-8c91b5074c45 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:25.720802 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0f1689ca-fbd5-4742-9447-8c91b5074c45 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1757 microversion: 2.1 time: 0.183647 Aug 04 23:19:25.721468 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 366/703] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:19:25 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:19:26.744067 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f0cdf7ac-6b45-4efb-af9f-97c424b75adb tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:26.744773 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f0cdf7ac-6b45-4efb-af9f-97c424b75adb tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:26.752969 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f0cdf7ac-6b45-4efb-af9f-97c424b75adb tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:26.753708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f0cdf7ac-6b45-4efb-af9f-97c424b75adb tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:26.754144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f0cdf7ac-6b45-4efb-af9f-97c424b75adb tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:26.755741 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f0cdf7ac-6b45-4efb-af9f-97c424b75adb tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:26.758041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f0cdf7ac-6b45-4efb-af9f-97c424b75adb tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:26.758519 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f0cdf7ac-6b45-4efb-af9f-97c424b75adb tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:26.915934 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f0cdf7ac-6b45-4efb-af9f-97c424b75adb tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:26.924928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f0cdf7ac-6b45-4efb-af9f-97c424b75adb tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1757 microversion: 2.1 time: 0.184821 Aug 04 23:19:26.925467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 338/704] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:19:26 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:19:27.951866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0becc757-b810-46dc-90f7-6ec5438ef94a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:27.952650 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0becc757-b810-46dc-90f7-6ec5438ef94a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:27.961487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0becc757-b810-46dc-90f7-6ec5438ef94a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:27.962130 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0becc757-b810-46dc-90f7-6ec5438ef94a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:27.962906 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0becc757-b810-46dc-90f7-6ec5438ef94a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:27.964006 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0becc757-b810-46dc-90f7-6ec5438ef94a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:27.964616 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0becc757-b810-46dc-90f7-6ec5438ef94a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:27.965103 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0becc757-b810-46dc-90f7-6ec5438ef94a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:28.011105 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-84b4b443-8e25-4720-b9ca-efabe7cac1f1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:28.011705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-84b4b443-8e25-4720-b9ca-efabe7cac1f1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:28.019665 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-84b4b443-8e25-4720-b9ca-efabe7cac1f1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:28.020234 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-84b4b443-8e25-4720-b9ca-efabe7cac1f1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:28.020659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-84b4b443-8e25-4720-b9ca-efabe7cac1f1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:28.021402 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-84b4b443-8e25-4720-b9ca-efabe7cac1f1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:28.021841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-84b4b443-8e25-4720-b9ca-efabe7cac1f1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:28.022263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-84b4b443-8e25-4720-b9ca-efabe7cac1f1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:28.061989 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-84b4b443-8e25-4720-b9ca-efabe7cac1f1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2/os-volume_attachments/ec4feb6e-a14a-4412-a300-4da2f2848ed9" status: 200 len: 194 microversion: 2.20 time: 0.054801 Aug 04 23:19:28.062650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 339/705] 10.222.0.33 () {60 vars in 1454 bytes} [Thu Aug 4 23:19:28 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2/os-volume_attachments/ec4feb6e-a14a-4412-a300-4da2f2848ed9 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 23:19:28.161873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0becc757-b810-46dc-90f7-6ec5438ef94a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:28.171476 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0becc757-b810-46dc-90f7-6ec5438ef94a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1757 microversion: 2.1 time: 0.224638 Aug 04 23:19:28.172384 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 367/706] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:19:27 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1757 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:19:28.181916 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0ca9160a-743e-484f-ba3b-ca430f3ef768 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:28.182840 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0ca9160a-743e-484f-ba3b-ca430f3ef768 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:28.194606 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0ca9160a-743e-484f-ba3b-ca430f3ef768 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:28.195483 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0ca9160a-743e-484f-ba3b-ca430f3ef768 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:28.196279 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0ca9160a-743e-484f-ba3b-ca430f3ef768 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:28.197576 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0ca9160a-743e-484f-ba3b-ca430f3ef768 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:28.198461 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0ca9160a-743e-484f-ba3b-ca430f3ef768 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:28.199216 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0ca9160a-743e-484f-ba3b-ca430f3ef768 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:28.334201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.objects.instance [None req-0ca9160a-743e-484f-ba3b-ca430f3ef768 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lazy-loading 'services' on Instance uuid 2013d923-81bb-4002-976d-64d3722b15d2 {{(pid=129790) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:19:28.455810 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0ca9160a-743e-484f-ba3b-ca430f3ef768 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2/os-volume_attachments/ec4feb6e-a14a-4412-a300-4da2f2848ed9" status: 202 len: 0 microversion: 2.20 time: 0.281826 Aug 04 23:19:28.456428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 340/707] 10.222.0.33 () {60 vars in 1457 bytes} [Thu Aug 4 23:19:28 2022] DELETE /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2/os-volume_attachments/ec4feb6e-a14a-4412-a300-4da2f2848ed9 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 04 23:19:28.468331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-72d6b872-ff71-4179-bb1e-79e16997201b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:28.471324 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-72d6b872-ff71-4179-bb1e-79e16997201b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:28.477858 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-72d6b872-ff71-4179-bb1e-79e16997201b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:28.478540 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-72d6b872-ff71-4179-bb1e-79e16997201b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:28.478990 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-72d6b872-ff71-4179-bb1e-79e16997201b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:28.479966 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-72d6b872-ff71-4179-bb1e-79e16997201b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:28.480625 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-72d6b872-ff71-4179-bb1e-79e16997201b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:28.481218 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-72d6b872-ff71-4179-bb1e-79e16997201b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:28.524099 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-72d6b872-ff71-4179-bb1e-79e16997201b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061155 Aug 04 23:19:28.524849 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 368/708] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Aug 4 23:19:28 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 23:19:29.208956 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6026f4d7-c376-4f6f-881f-bf0187e27585 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:29.209651 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6026f4d7-c376-4f6f-881f-bf0187e27585 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:29.216577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6026f4d7-c376-4f6f-881f-bf0187e27585 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:29.217007 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6026f4d7-c376-4f6f-881f-bf0187e27585 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:29.217554 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6026f4d7-c376-4f6f-881f-bf0187e27585 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:29.218267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6026f4d7-c376-4f6f-881f-bf0187e27585 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:29.218841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6026f4d7-c376-4f6f-881f-bf0187e27585 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:29.219179 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6026f4d7-c376-4f6f-881f-bf0187e27585 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:29.389791 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6026f4d7-c376-4f6f-881f-bf0187e27585 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:29.399592 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6026f4d7-c376-4f6f-881f-bf0187e27585 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1757 microversion: 2.1 time: 0.195246 Aug 04 23:19:29.400177 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 341/709] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:19:29 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:19:29.537751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-18d9cf07-4e8f-4439-a781-1f40a1519258 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:29.539874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-18d9cf07-4e8f-4439-a781-1f40a1519258 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:29.548081 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18d9cf07-4e8f-4439-a781-1f40a1519258 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:29.548528 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18d9cf07-4e8f-4439-a781-1f40a1519258 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:29.548962 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18d9cf07-4e8f-4439-a781-1f40a1519258 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:29.549674 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18d9cf07-4e8f-4439-a781-1f40a1519258 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:29.550122 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18d9cf07-4e8f-4439-a781-1f40a1519258 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:29.550869 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18d9cf07-4e8f-4439-a781-1f40a1519258 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:29.589517 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-18d9cf07-4e8f-4439-a781-1f40a1519258 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055952 Aug 04 23:19:29.590523 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 369/710] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Aug 4 23:19:29 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 23:19:30.423049 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6377d1c2-956d-4ab6-9e8e-7ddab9ccf92d tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:30.423661 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6377d1c2-956d-4ab6-9e8e-7ddab9ccf92d tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:30.430070 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6377d1c2-956d-4ab6-9e8e-7ddab9ccf92d tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:30.430589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6377d1c2-956d-4ab6-9e8e-7ddab9ccf92d tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:30.431020 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6377d1c2-956d-4ab6-9e8e-7ddab9ccf92d tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:30.431701 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6377d1c2-956d-4ab6-9e8e-7ddab9ccf92d tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:30.432148 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6377d1c2-956d-4ab6-9e8e-7ddab9ccf92d tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:30.432564 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6377d1c2-956d-4ab6-9e8e-7ddab9ccf92d tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:30.575431 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6377d1c2-956d-4ab6-9e8e-7ddab9ccf92d tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:30.583851 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6377d1c2-956d-4ab6-9e8e-7ddab9ccf92d tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1760 microversion: 2.1 time: 0.165396 Aug 04 23:19:30.584428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 342/711] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:19:30 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1760 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:19:30.604920 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8e55850d-bde6-41c9-8005-c333020347ed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:30.608035 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8e55850d-bde6-41c9-8005-c333020347ed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:30.614717 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e55850d-bde6-41c9-8005-c333020347ed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:30.615294 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e55850d-bde6-41c9-8005-c333020347ed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:30.615632 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e55850d-bde6-41c9-8005-c333020347ed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:30.616338 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e55850d-bde6-41c9-8005-c333020347ed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:30.616794 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e55850d-bde6-41c9-8005-c333020347ed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:30.617213 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e55850d-bde6-41c9-8005-c333020347ed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:30.649073 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8e55850d-bde6-41c9-8005-c333020347ed tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048079 Aug 04 23:19:30.649653 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 370/712] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Aug 4 23:19:30 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:19:30.721826 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f26a2b85-9f39-42b4-a847-d539842e912d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:30.722375 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f26a2b85-9f39-42b4-a847-d539842e912d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:30.728573 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f26a2b85-9f39-42b4-a847-d539842e912d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:30.729056 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f26a2b85-9f39-42b4-a847-d539842e912d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:30.729487 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f26a2b85-9f39-42b4-a847-d539842e912d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:30.730187 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f26a2b85-9f39-42b4-a847-d539842e912d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:30.730669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f26a2b85-9f39-42b4-a847-d539842e912d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:30.731093 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f26a2b85-9f39-42b4-a847-d539842e912d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:30.759518 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f26a2b85-9f39-42b4-a847-d539842e912d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Going to try to terminate instance {{(pid=129790) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 23:19:30.840869 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f26a2b85-9f39-42b4-a847-d539842e912d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 204 len: 0 microversion: 2.20 time: 0.124060 Aug 04 23:19:30.841772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 343/713] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Aug 4 23:19:30 2022] DELETE /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 23:19:30.849916 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a3233499-2d2d-4460-b9df-6ae7a96710ac tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:30.850549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a3233499-2d2d-4460-b9df-6ae7a96710ac tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:30.856941 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3233499-2d2d-4460-b9df-6ae7a96710ac tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:30.857723 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3233499-2d2d-4460-b9df-6ae7a96710ac tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:30.858059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3233499-2d2d-4460-b9df-6ae7a96710ac tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:30.858806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3233499-2d2d-4460-b9df-6ae7a96710ac tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:30.859258 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3233499-2d2d-4460-b9df-6ae7a96710ac tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:30.859677 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3233499-2d2d-4460-b9df-6ae7a96710ac tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:31.015236 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a3233499-2d2d-4460-b9df-6ae7a96710ac tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:31.026100 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a3233499-2d2d-4460-b9df-6ae7a96710ac tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:31.026100 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a3233499-2d2d-4460-b9df-6ae7a96710ac tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:31.026100 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a3233499-2d2d-4460-b9df-6ae7a96710ac tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1723 microversion: 2.20 time: 0.180599 Aug 04 23:19:31.028004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 371/714] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:19:30 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:19:32.051760 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5426c34f-859e-4146-9b1c-4a8872219fff tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:32.052388 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5426c34f-859e-4146-9b1c-4a8872219fff tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:32.058906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5426c34f-859e-4146-9b1c-4a8872219fff tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:32.059382 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5426c34f-859e-4146-9b1c-4a8872219fff tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:32.060556 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5426c34f-859e-4146-9b1c-4a8872219fff tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:32.061271 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5426c34f-859e-4146-9b1c-4a8872219fff tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:32.061719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5426c34f-859e-4146-9b1c-4a8872219fff tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:32.062136 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5426c34f-859e-4146-9b1c-4a8872219fff tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:32.197661 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5426c34f-859e-4146-9b1c-4a8872219fff tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:32.205816 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5426c34f-859e-4146-9b1c-4a8872219fff tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:32.207343 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5426c34f-859e-4146-9b1c-4a8872219fff tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:32.208488 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5426c34f-859e-4146-9b1c-4a8872219fff tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1723 microversion: 2.20 time: 0.161112 Aug 04 23:19:32.209035 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 344/715] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:19:32 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:19:33.234229 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b68e35a0-7f9b-409c-b7c7-d2648c656f83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:33.234872 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b68e35a0-7f9b-409c-b7c7-d2648c656f83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:33.241649 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b68e35a0-7f9b-409c-b7c7-d2648c656f83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:33.242128 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b68e35a0-7f9b-409c-b7c7-d2648c656f83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:33.242642 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b68e35a0-7f9b-409c-b7c7-d2648c656f83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:33.243302 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b68e35a0-7f9b-409c-b7c7-d2648c656f83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:33.243749 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b68e35a0-7f9b-409c-b7c7-d2648c656f83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:33.244169 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b68e35a0-7f9b-409c-b7c7-d2648c656f83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:33.384553 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b68e35a0-7f9b-409c-b7c7-d2648c656f83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:33.393489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b68e35a0-7f9b-409c-b7c7-d2648c656f83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:33.395034 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b68e35a0-7f9b-409c-b7c7-d2648c656f83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:33.396195 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b68e35a0-7f9b-409c-b7c7-d2648c656f83 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 200 len: 1723 microversion: 2.20 time: 0.167880 Aug 04 23:19:33.396799 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 372/716] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:19:33 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:19:33.827287 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-76616efa-11a1-4514-aa9e-38445dc3dd0e req-a77bd24f-b982-45c3-9976-c65b8206f811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2013d923-81bb-4002-976d-64d3722b15d2", "name": "network-vif-deleted", "tag": "bae5f1bd-b332-4fbe-8c3e-7f38e098b71d"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:19:33.841757 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-76616efa-11a1-4514-aa9e-38445dc3dd0e req-a77bd24f-b982-45c3-9976-c65b8206f811 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:33.842441 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-76616efa-11a1-4514-aa9e-38445dc3dd0e req-a77bd24f-b982-45c3-9976-c65b8206f811 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:33.842877 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-76616efa-11a1-4514-aa9e-38445dc3dd0e req-a77bd24f-b982-45c3-9976-c65b8206f811 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:33.856278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-76616efa-11a1-4514-aa9e-38445dc3dd0e req-a77bd24f-b982-45c3-9976-c65b8206f811 service nova] Creating event network-vif-deleted:bae5f1bd-b332-4fbe-8c3e-7f38e098b71d for instance 2013d923-81bb-4002-976d-64d3722b15d2 on hv-cinder-85221 Aug 04 23:19:33.862540 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-76616efa-11a1-4514-aa9e-38445dc3dd0e req-a77bd24f-b982-45c3-9976-c65b8206f811 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040235 Aug 04 23:19:33.866409 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 345/717] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:19:34.422470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-21f70889-91f5-4059-ac66-5d59863ee291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:34.423113 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-21f70889-91f5-4059-ac66-5d59863ee291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:34.429186 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21f70889-91f5-4059-ac66-5d59863ee291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:34.429823 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21f70889-91f5-4059-ac66-5d59863ee291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:34.430250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21f70889-91f5-4059-ac66-5d59863ee291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:34.430967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21f70889-91f5-4059-ac66-5d59863ee291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:34.431410 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21f70889-91f5-4059-ac66-5d59863ee291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:34.431825 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21f70889-91f5-4059-ac66-5d59863ee291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:34.446030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-21f70889-91f5-4059-ac66-5d59863ee291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] HTTP exception thrown: Instance 2013d923-81bb-4002-976d-64d3722b15d2 could not be found. Aug 04 23:19:34.447729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-21f70889-91f5-4059-ac66-5d59863ee291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Request method failure captured: Aug 04 23:19:34.447729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 HTTP/1.1 Aug 04 23:19:34.447729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:19:34.447729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:19:34.447729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:19:34.447729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 0 Aug 04 23:19:34.447729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:19:34.447729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:19:34.447729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:19:34.447729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:19:34.447729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FJ_lNPm7_BwGeDsbzR7xUFf6HRmZFVdHZp64YFZgRkmxH-Sh9Zs7zfyI1tg4rz4fIT0_42EdeSItQjFr98mlpv79qnV8bs9XxAhCJvGYFAjNytRR9pArGDXWp3W8Bz65mqFxVRaY2V6pbgLgjW91HXDnTae7piRZaEU3l6aEGpk3Gc Aug 04 23:19:34.447729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:19:34.447729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:19:34.447729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:19:34.447729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:19:34.447729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 23:19:34.447729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:19:34.447729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:19:34.447729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: 6b185a89edfd42a19bfbeff8d9c66e36 Aug 04 23:19:34.447729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-214528859 Aug 04 23:19:34.447729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:19:34.447729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:19:34.449537 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b185a89edfd42a19bfbeff8d9c66e36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6b185a89edfd42a19bfbeff8d9c66e36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b185a89edfd42a19bfbeff8d9c66e36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6b185a89edfd42a19bfbeff8d9c66e36"}]}] Aug 04 23:19:34.449537 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-AttachVolumeShelveTestJSON-214528859 Aug 04 23:19:34.449537 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: 6b185a89edfd42a19bfbeff8d9c66e36 Aug 04 23:19:34.449537 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-214528859 Aug 04 23:19:34.449537 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-AttachVolumeShelveTestJSON-214528859-project Aug 04 23:19:34.449537 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:19:34.449537 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:19:34.449537 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: c01696724a7c4291ae29cc10da276ea6 Aug 04 23:19:34.449537 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-AttachVolumeShelveTestJSON-214528859-project Aug 04 23:19:34.449537 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: > Aug 04 23:19:34.449537 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Instance 2013d923-81bb-4002-976d-64d3722b15d2 could not be found. Aug 04 23:19:34.449537 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'id': '2013d923-81bb-4002-976d-64d3722b15d2'} Aug 04 23:19:34.450521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:19:34.450521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:19:34.450521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:19:34.450521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:19:34.450521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:19:34.450521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:19:34.450521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:19:34.450521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:19:34.450521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:19:34.450521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:19:34.450521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2013d923-81bb-4002-976d-64d3722b15d2 could not be found. Aug 04 23:19:34.450521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:19:34.450521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:19:34.450521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:19:34.450521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:19:34.450521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:19:34.450521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:19:34.450521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:19:34.450521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:19:34.450521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:19:34.452058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:19:34.452058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:19:34.452058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:19:34.452058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:19:34.452058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:19:34.452058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:19:34.452058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:19:34.452058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2013d923-81bb-4002-976d-64d3722b15d2 could not be found. Aug 04 23:19:34.452058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:19:34.452058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:19:34.452058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:19:34.452058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:19:34.452058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:19:34.452058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:19:34.452058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:19:34.452058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:19:34.452058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2013d923-81bb-4002-976d-64d3722b15d2 could not be found. Aug 04 23:19:34.452058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:19:34.453369 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-21f70889-91f5-4059-ac66-5d59863ee291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Returning 404 to user: Instance 2013d923-81bb-4002-976d-64d3722b15d2 could not be found. {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:19:34.453369 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-21f70889-91f5-4059-ac66-5d59863ee291 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 404 len: 111 microversion: 2.20 time: 0.032531 Aug 04 23:19:34.453369 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 373/718] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:19:34 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 23:19:34.460539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d084f11c-b3f9-431e-8031-2c563fc74d51 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '.version_select at 0x7f6d25d6a4c0>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:34.480630 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d084f11c-b3f9-431e-8031-2c563fc74d51 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-530975688" status: 204 len: 0 microversion: 2.20 time: 0.024253 Aug 04 23:19:34.481204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 346/719] 10.222.0.33 () {60 vars in 1259 bytes} [Thu Aug 4 23:19:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-530975688 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 23:19:35.222439 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2e9c5de1-b2c6-45a8-bf65-320b6dd43205 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Action: 'create', calling method: .version_select at 0x7f6d25e623a0>, body: {"keypair": {"name": "tempest-keypair-1076557412", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFO5n8DL+4KSx0fkdQguG7SVHgSppHXdRlPkiCj+w4xwcx8GIqhp0G4Vyt5+ug4mGTx220/i9WFYhPTQNloeC6zgwWsO+U6Ry3O3IxLVZL6Cp9iD3xYNnAbvoCuM39qFg=="}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:19:35.239060 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-2e9c5de1-b2c6-45a8-bf65-320b6dd43205 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Getting quotas for project 6b185a89edfd42a19bfbeff8d9c66e36. Resources: {'key_pairs'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:19:35.242970 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-2e9c5de1-b2c6-45a8-bf65-320b6dd43205 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Getting quotas for user c01696724a7c4291ae29cc10da276ea6 and project 6b185a89edfd42a19bfbeff8d9c66e36. Resources: {'key_pairs'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:19:35.267318 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2e9c5de1-b2c6-45a8-bf65-320b6dd43205 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048814 Aug 04 23:19:35.267907 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 374/720] 10.222.0.33 () {62 vars in 1200 bytes} [Thu Aug 4 23:19:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 23:19:36.539346 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a813513a-3274-43ec-a557-4f3eee15a869 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-486706144", "imageRef": "e1e9d70e-b252-44e5-9ecd-bf73cbf00160", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05e1cbeb-6971-4b4f-93b9-8471afd23a2d"}], "security_groups": [{"name": "tempest-securitygroup--1381286182"}], "key_name": "tempest-keypair-1076557412", "user_data": "}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:19:36.645893 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.network.neutron [None req-a813513a-3274-43ec-a557-4f3eee15a869 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] validate_networks() for [('05e1cbeb-6971-4b4f-93b9-8471afd23a2d', None, None, None, None, None)] {{(pid=129790) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 23:19:37.078456 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-a813513a-3274-43ec-a557-4f3eee15a869 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Flavor limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 23:19:37.078884 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-a813513a-3274-43ec-a557-4f3eee15a869 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Image limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 23:19:37.079365 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-a813513a-3274-43ec-a557-4f3eee15a869 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Flavor pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 23:19:37.079809 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-a813513a-3274-43ec-a557-4f3eee15a869 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Image pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 23:19:37.080219 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-a813513a-3274-43ec-a557-4f3eee15a869 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 23:19:37.090028 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a813513a-3274-43ec-a557-4f3eee15a869 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:37.090571 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a813513a-3274-43ec-a557-4f3eee15a869 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:37.091204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a813513a-3274-43ec-a557-4f3eee15a869 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:37.092428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a813513a-3274-43ec-a557-4f3eee15a869 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:37.092890 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a813513a-3274-43ec-a557-4f3eee15a869 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:37.093328 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a813513a-3274-43ec-a557-4f3eee15a869 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:37.112182 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-a813513a-3274-43ec-a557-4f3eee15a869 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Getting quotas for project 6b185a89edfd42a19bfbeff8d9c66e36. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:19:37.116315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-a813513a-3274-43ec-a557-4f3eee15a869 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Getting quotas for user c01696724a7c4291ae29cc10da276ea6 and project 6b185a89edfd42a19bfbeff8d9c66e36. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:19:37.133755 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a813513a-3274-43ec-a557-4f3eee15a869 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Going to run 1 instances... {{(pid=129790) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 23:19:37.136209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a813513a-3274-43ec-a557-4f3eee15a869 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1e9d70e-b252-44e5-9ecd-bf73cbf00160',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129790) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 23:19:37.185353 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a813513a-3274-43ec-a557-4f3eee15a869 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.650119 Aug 04 23:19:37.186019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 347/721] 10.222.0.33 () {62 vars in 1188 bytes} [Thu Aug 4 23:19:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 23:19:37.197343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d1459c02-6b9f-447d-b9f9-4a16089d4de5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:37.198437 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d1459c02-6b9f-447d-b9f9-4a16089d4de5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:37.255273 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d1459c02-6b9f-447d-b9f9-4a16089d4de5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:37.263664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d1459c02-6b9f-447d-b9f9-4a16089d4de5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:37.265311 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d1459c02-6b9f-447d-b9f9-4a16089d4de5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:37.266567 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d1459c02-6b9f-447d-b9f9-4a16089d4de5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1281 microversion: 2.20 time: 0.073620 Aug 04 23:19:37.267208 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 375/722] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:19:37 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:19:38.290442 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-03fa95e0-0d52-4c24-8793-f2b1f338e60f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:38.291850 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-03fa95e0-0d52-4c24-8793-f2b1f338e60f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:38.302441 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03fa95e0-0d52-4c24-8793-f2b1f338e60f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:38.303214 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03fa95e0-0d52-4c24-8793-f2b1f338e60f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:38.303734 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03fa95e0-0d52-4c24-8793-f2b1f338e60f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:38.304577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03fa95e0-0d52-4c24-8793-f2b1f338e60f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:38.305159 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03fa95e0-0d52-4c24-8793-f2b1f338e60f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:38.305662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03fa95e0-0d52-4c24-8793-f2b1f338e60f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:38.376223 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-03fa95e0-0d52-4c24-8793-f2b1f338e60f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:38.384341 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-03fa95e0-0d52-4c24-8793-f2b1f338e60f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:38.385835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-03fa95e0-0d52-4c24-8793-f2b1f338e60f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:38.386977 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-03fa95e0-0d52-4c24-8793-f2b1f338e60f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1339 microversion: 2.20 time: 0.101958 Aug 04 23:19:38.387523 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 348/723] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:19:38 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1339 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:19:39.409641 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c005ffa3-cf08-40d5-93e3-0fdd8313a5bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:39.410248 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c005ffa3-cf08-40d5-93e3-0fdd8313a5bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:39.417305 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c005ffa3-cf08-40d5-93e3-0fdd8313a5bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:39.417804 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c005ffa3-cf08-40d5-93e3-0fdd8313a5bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:39.418240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c005ffa3-cf08-40d5-93e3-0fdd8313a5bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:39.418998 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c005ffa3-cf08-40d5-93e3-0fdd8313a5bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:39.419476 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c005ffa3-cf08-40d5-93e3-0fdd8313a5bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:39.419908 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c005ffa3-cf08-40d5-93e3-0fdd8313a5bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:39.569502 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c005ffa3-cf08-40d5-93e3-0fdd8313a5bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:39.578834 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c005ffa3-cf08-40d5-93e3-0fdd8313a5bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:39.580400 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c005ffa3-cf08-40d5-93e3-0fdd8313a5bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:39.581730 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c005ffa3-cf08-40d5-93e3-0fdd8313a5bd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1407 microversion: 2.20 time: 0.176109 Aug 04 23:19:39.582286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 376/724] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:19:39 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:19:39.619385 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-6ef45b4c-cacb-4fd7-9e24-a79b06ccba1e req-cb2a427e-aa37-4a56-9e5a-0e850f8ebc7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be84129-cec2-4633-9a4c-de19980d4dd4", "tag": "dfb89816-563a-4deb-9f3f-e2414e3b9eeb"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:19:39.630761 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-6ef45b4c-cacb-4fd7-9e24-a79b06ccba1e req-cb2a427e-aa37-4a56-9e5a-0e850f8ebc7a service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:39.631331 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-6ef45b4c-cacb-4fd7-9e24-a79b06ccba1e req-cb2a427e-aa37-4a56-9e5a-0e850f8ebc7a service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:39.631946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-6ef45b4c-cacb-4fd7-9e24-a79b06ccba1e req-cb2a427e-aa37-4a56-9e5a-0e850f8ebc7a service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:39.647305 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-6ef45b4c-cacb-4fd7-9e24-a79b06ccba1e req-cb2a427e-aa37-4a56-9e5a-0e850f8ebc7a service nova] Creating event network-changed:dfb89816-563a-4deb-9f3f-e2414e3b9eeb for instance 1be84129-cec2-4633-9a4c-de19980d4dd4 on hv-cinder-85221 Aug 04 23:19:39.654224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-6ef45b4c-cacb-4fd7-9e24-a79b06ccba1e req-cb2a427e-aa37-4a56-9e5a-0e850f8ebc7a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038594 Aug 04 23:19:39.655129 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 349/725] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:19:40.604505 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6e805450-4ec4-4c08-9aec-26a82c01c4ce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:40.605057 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6e805450-4ec4-4c08-9aec-26a82c01c4ce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:40.611516 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e805450-4ec4-4c08-9aec-26a82c01c4ce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:40.611988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e805450-4ec4-4c08-9aec-26a82c01c4ce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:40.612418 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e805450-4ec4-4c08-9aec-26a82c01c4ce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:40.613117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e805450-4ec4-4c08-9aec-26a82c01c4ce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:40.613558 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e805450-4ec4-4c08-9aec-26a82c01c4ce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:40.613970 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e805450-4ec4-4c08-9aec-26a82c01c4ce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:40.751592 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6e805450-4ec4-4c08-9aec-26a82c01c4ce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:40.759991 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6e805450-4ec4-4c08-9aec-26a82c01c4ce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:40.761498 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6e805450-4ec4-4c08-9aec-26a82c01c4ce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:40.763151 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6e805450-4ec4-4c08-9aec-26a82c01c4ce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1407 microversion: 2.20 time: 0.162145 Aug 04 23:19:40.763742 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 377/726] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:19:40 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:19:41.786205 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7b482dd6-1bf2-4559-9140-de5ff53e22d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:41.787028 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7b482dd6-1bf2-4559-9140-de5ff53e22d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:41.793661 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b482dd6-1bf2-4559-9140-de5ff53e22d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:41.794334 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b482dd6-1bf2-4559-9140-de5ff53e22d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:41.794873 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b482dd6-1bf2-4559-9140-de5ff53e22d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:41.795476 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b482dd6-1bf2-4559-9140-de5ff53e22d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:41.795932 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b482dd6-1bf2-4559-9140-de5ff53e22d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:41.796352 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b482dd6-1bf2-4559-9140-de5ff53e22d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:41.937569 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7b482dd6-1bf2-4559-9140-de5ff53e22d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:41.945967 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7b482dd6-1bf2-4559-9140-de5ff53e22d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:41.947507 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7b482dd6-1bf2-4559-9140-de5ff53e22d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:41.948662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7b482dd6-1bf2-4559-9140-de5ff53e22d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1407 microversion: 2.20 time: 0.167253 Aug 04 23:19:41.949226 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 350/727] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:19:41 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:19:42.971811 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ee8b00d9-fd86-47f6-ab52-ce89f40264df tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:42.972585 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ee8b00d9-fd86-47f6-ab52-ce89f40264df tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:42.979300 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ee8b00d9-fd86-47f6-ab52-ce89f40264df tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:42.979785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ee8b00d9-fd86-47f6-ab52-ce89f40264df tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:42.980207 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ee8b00d9-fd86-47f6-ab52-ce89f40264df tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:42.980906 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ee8b00d9-fd86-47f6-ab52-ce89f40264df tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:42.981921 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ee8b00d9-fd86-47f6-ab52-ce89f40264df tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:42.982865 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ee8b00d9-fd86-47f6-ab52-ce89f40264df tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:43.124757 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ee8b00d9-fd86-47f6-ab52-ce89f40264df tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:43.133054 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ee8b00d9-fd86-47f6-ab52-ce89f40264df tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:43.134962 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ee8b00d9-fd86-47f6-ab52-ce89f40264df tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:43.136069 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ee8b00d9-fd86-47f6-ab52-ce89f40264df tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1407 microversion: 2.20 time: 0.168187 Aug 04 23:19:43.136627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 378/728] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:19:42 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:19:44.158750 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f4635539-3a0e-4bdd-b733-9cf24c6e4e9c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:44.159551 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f4635539-3a0e-4bdd-b733-9cf24c6e4e9c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:44.166194 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4635539-3a0e-4bdd-b733-9cf24c6e4e9c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:44.167432 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4635539-3a0e-4bdd-b733-9cf24c6e4e9c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:44.167889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4635539-3a0e-4bdd-b733-9cf24c6e4e9c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:44.168677 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4635539-3a0e-4bdd-b733-9cf24c6e4e9c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:44.170263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4635539-3a0e-4bdd-b733-9cf24c6e4e9c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:44.170729 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4635539-3a0e-4bdd-b733-9cf24c6e4e9c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:44.175250 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:19:44.312376 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f4635539-3a0e-4bdd-b733-9cf24c6e4e9c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:44.320272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f4635539-3a0e-4bdd-b733-9cf24c6e4e9c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:44.321777 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f4635539-3a0e-4bdd-b733-9cf24c6e4e9c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:44.322897 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f4635539-3a0e-4bdd-b733-9cf24c6e4e9c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1407 microversion: 2.20 time: 0.168191 Aug 04 23:19:44.323449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 351/729] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:19:44 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:19:45.072712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-c96c954c-b1fb-486d-b3c4-1c2a72aa413c req-8e15b0a6-00c5-4481-abe6-186278586817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be84129-cec2-4633-9a4c-de19980d4dd4", "name": "network-vif-plugged", "status": "completed", "tag": "dfb89816-563a-4deb-9f3f-e2414e3b9eeb"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:19:45.083544 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-c96c954c-b1fb-486d-b3c4-1c2a72aa413c req-8e15b0a6-00c5-4481-abe6-186278586817 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:45.084129 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-c96c954c-b1fb-486d-b3c4-1c2a72aa413c req-8e15b0a6-00c5-4481-abe6-186278586817 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:45.084612 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-c96c954c-b1fb-486d-b3c4-1c2a72aa413c req-8e15b0a6-00c5-4481-abe6-186278586817 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:45.099881 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-c96c954c-b1fb-486d-b3c4-1c2a72aa413c req-8e15b0a6-00c5-4481-abe6-186278586817 service nova] Creating event network-vif-plugged:dfb89816-563a-4deb-9f3f-e2414e3b9eeb for instance 1be84129-cec2-4633-9a4c-de19980d4dd4 on hv-cinder-85221 Aug 04 23:19:45.104782 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-c96c954c-b1fb-486d-b3c4-1c2a72aa413c req-8e15b0a6-00c5-4481-abe6-186278586817 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099947 Aug 04 23:19:45.105408 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 379/730] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:19:45.345934 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-edb9be37-78d6-4559-81c3-4fb2b42f05f8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:45.346569 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-edb9be37-78d6-4559-81c3-4fb2b42f05f8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:45.352914 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edb9be37-78d6-4559-81c3-4fb2b42f05f8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:45.353392 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edb9be37-78d6-4559-81c3-4fb2b42f05f8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:45.353820 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edb9be37-78d6-4559-81c3-4fb2b42f05f8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:45.354558 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edb9be37-78d6-4559-81c3-4fb2b42f05f8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:45.355006 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edb9be37-78d6-4559-81c3-4fb2b42f05f8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:45.355423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edb9be37-78d6-4559-81c3-4fb2b42f05f8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:45.487730 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-edb9be37-78d6-4559-81c3-4fb2b42f05f8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:45.497894 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-edb9be37-78d6-4559-81c3-4fb2b42f05f8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:45.499453 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-edb9be37-78d6-4559-81c3-4fb2b42f05f8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:45.500562 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-edb9be37-78d6-4559-81c3-4fb2b42f05f8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1407 microversion: 2.20 time: 0.158531 Aug 04 23:19:45.501124 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 352/731] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:19:45 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:19:46.524368 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5b892327-bb90-4cec-8ef6-c1b88ed9ca8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:46.525062 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5b892327-bb90-4cec-8ef6-c1b88ed9ca8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:46.531797 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b892327-bb90-4cec-8ef6-c1b88ed9ca8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:46.532271 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b892327-bb90-4cec-8ef6-c1b88ed9ca8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:46.532704 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b892327-bb90-4cec-8ef6-c1b88ed9ca8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:46.533388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b892327-bb90-4cec-8ef6-c1b88ed9ca8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:46.533838 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b892327-bb90-4cec-8ef6-c1b88ed9ca8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:46.534255 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b892327-bb90-4cec-8ef6-c1b88ed9ca8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:46.671358 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5b892327-bb90-4cec-8ef6-c1b88ed9ca8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:46.675230 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:19:46.681274 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5b892327-bb90-4cec-8ef6-c1b88ed9ca8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:46.682808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5b892327-bb90-4cec-8ef6-c1b88ed9ca8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:46.683924 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5b892327-bb90-4cec-8ef6-c1b88ed9ca8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1407 microversion: 2.20 time: 0.164312 Aug 04 23:19:46.684984 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 380/732] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:19:46 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:19:47.706959 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4bab7d5d-2c3e-48c3-b697-b212886fed1b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:47.707562 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4bab7d5d-2c3e-48c3-b697-b212886fed1b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:47.709831 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=2 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:19:47.710504 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=6 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:19:47.711153 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:19:47.718197 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4bab7d5d-2c3e-48c3-b697-b212886fed1b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:47.718710 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4bab7d5d-2c3e-48c3-b697-b212886fed1b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:47.719356 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4bab7d5d-2c3e-48c3-b697-b212886fed1b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:47.719834 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4bab7d5d-2c3e-48c3-b697-b212886fed1b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:47.720403 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4bab7d5d-2c3e-48c3-b697-b212886fed1b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:47.721176 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4bab7d5d-2c3e-48c3-b697-b212886fed1b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:47.868974 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4bab7d5d-2c3e-48c3-b697-b212886fed1b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:47.877789 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4bab7d5d-2c3e-48c3-b697-b212886fed1b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:47.879237 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4bab7d5d-2c3e-48c3-b697-b212886fed1b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:19:47.880400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4bab7d5d-2c3e-48c3-b697-b212886fed1b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1599 microversion: 2.20 time: 0.177432 Aug 04 23:19:47.880953 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 353/733] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:19:47 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1599 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:19:47.902830 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f34f02bd-a79c-4978-8f4d-0182b2c94af3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:19:47.904544 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f34f02bd-a79c-4978-8f4d-0182b2c94af3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:19:47.906253 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=6 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:19:47.907588 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:19:47.915363 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f34f02bd-a79c-4978-8f4d-0182b2c94af3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:47.915847 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f34f02bd-a79c-4978-8f4d-0182b2c94af3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:47.916282 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f34f02bd-a79c-4978-8f4d-0182b2c94af3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:47.916970 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f34f02bd-a79c-4978-8f4d-0182b2c94af3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:47.917417 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f34f02bd-a79c-4978-8f4d-0182b2c94af3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:47.917836 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f34f02bd-a79c-4978-8f4d-0182b2c94af3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:47.995911 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f34f02bd-a79c-4978-8f4d-0182b2c94af3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096897 Aug 04 23:19:47.996496 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 381/734] 10.222.0.33 () {60 vars in 1316 bytes} [Thu Aug 4 23:19:47 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 23:19:49.154661 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-2d16cff7-ee03-415a-b24d-84b3aeb64c91 req-f97748b7-1d06-4b28-9332-b0c3b5f0f4ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be84129-cec2-4633-9a4c-de19980d4dd4", "tag": "dfb89816-563a-4deb-9f3f-e2414e3b9eeb"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:19:49.165070 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-2d16cff7-ee03-415a-b24d-84b3aeb64c91 req-f97748b7-1d06-4b28-9332-b0c3b5f0f4ac service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:19:49.165623 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-2d16cff7-ee03-415a-b24d-84b3aeb64c91 req-f97748b7-1d06-4b28-9332-b0c3b5f0f4ac service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:19:49.166133 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-2d16cff7-ee03-415a-b24d-84b3aeb64c91 req-f97748b7-1d06-4b28-9332-b0c3b5f0f4ac service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:19:49.178676 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-2d16cff7-ee03-415a-b24d-84b3aeb64c91 req-f97748b7-1d06-4b28-9332-b0c3b5f0f4ac service nova] Creating event network-changed:dfb89816-563a-4deb-9f3f-e2414e3b9eeb for instance 1be84129-cec2-4633-9a4c-de19980d4dd4 on hv-cinder-85221 Aug 04 23:19:49.183768 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-2d16cff7-ee03-415a-b24d-84b3aeb64c91 req-f97748b7-1d06-4b28-9332-b0c3b5f0f4ac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033546 Aug 04 23:19:49.185415 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 354/735] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:00.691259 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:20:00.692030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=4 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:20:00.695871 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-46b1fee9-28e3-4ec8-9491-acb08a364aa2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:00.696362 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-46b1fee9-28e3-4ec8-9491-acb08a364aa2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:00.703110 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-46b1fee9-28e3-4ec8-9491-acb08a364aa2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:00.703591 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-46b1fee9-28e3-4ec8-9491-acb08a364aa2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:00.704024 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-46b1fee9-28e3-4ec8-9491-acb08a364aa2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:00.704708 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-46b1fee9-28e3-4ec8-9491-acb08a364aa2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:00.705157 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-46b1fee9-28e3-4ec8-9491-acb08a364aa2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:00.705576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-46b1fee9-28e3-4ec8-9491-acb08a364aa2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:00.729852 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-46b1fee9-28e3-4ec8-9491-acb08a364aa2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da/ips" status: 200 len: 151 microversion: 2.1 time: 0.039862 Aug 04 23:20:00.730449 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 382/736] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Aug 4 23:20:00 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:02.077576 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=3 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:20:02.078311 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=18 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:20:02.083478 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ade67219-23ae-4529-a628-63067ff54db6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cda74555-322c-4218-9310-e521ac120195"}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:02.086042 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ade67219-23ae-4529-a628-63067ff54db6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:02.093223 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ade67219-23ae-4529-a628-63067ff54db6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:02.093704 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ade67219-23ae-4529-a628-63067ff54db6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:02.094139 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ade67219-23ae-4529-a628-63067ff54db6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:02.094882 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ade67219-23ae-4529-a628-63067ff54db6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:02.095334 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ade67219-23ae-4529-a628-63067ff54db6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:02.095755 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ade67219-23ae-4529-a628-63067ff54db6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:02.339970 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ade67219-23ae-4529-a628-63067ff54db6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "POST /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263680 Aug 04 23:20:02.341209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 355/737] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Aug 4 23:20:02 2022] POST /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:07.531542 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1161f55a-91a3-498d-adac-211e255669ce tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:07.532104 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1161f55a-91a3-498d-adac-211e255669ce tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:07.538451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1161f55a-91a3-498d-adac-211e255669ce tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:07.538945 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1161f55a-91a3-498d-adac-211e255669ce tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:07.539376 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1161f55a-91a3-498d-adac-211e255669ce tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:07.540080 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1161f55a-91a3-498d-adac-211e255669ce tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:07.540533 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1161f55a-91a3-498d-adac-211e255669ce tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:07.540957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1161f55a-91a3-498d-adac-211e255669ce tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:07.628170 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.objects.instance [None req-1161f55a-91a3-498d-adac-211e255669ce tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lazy-loading 'services' on Instance uuid 13d950e0-48a6-44d6-9aae-723354b66c48 {{(pid=129791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:20:07.714503 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1161f55a-91a3-498d-adac-211e255669ce tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "DELETE /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48/os-volume_attachments/c836dab1-62d9-4b8e-b0e6-3ede1b45f2ff" status: 202 len: 0 microversion: 2.1 time: 0.187466 Aug 04 23:20:07.715098 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 383/738] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Aug 4 23:20:07 2022] DELETE /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48/os-volume_attachments/c836dab1-62d9-4b8e-b0e6-3ede1b45f2ff => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:20:07.726904 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-71104996-9bd9-4bc2-9aa0-8060ec7dc613 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:07.730212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-71104996-9bd9-4bc2-9aa0-8060ec7dc613 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:07.738992 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-71104996-9bd9-4bc2-9aa0-8060ec7dc613 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:07.739460 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-71104996-9bd9-4bc2-9aa0-8060ec7dc613 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:07.740019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-71104996-9bd9-4bc2-9aa0-8060ec7dc613 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:07.740645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-71104996-9bd9-4bc2-9aa0-8060ec7dc613 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:07.741075 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-71104996-9bd9-4bc2-9aa0-8060ec7dc613 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:07.741496 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-71104996-9bd9-4bc2-9aa0-8060ec7dc613 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:07.772278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-71104996-9bd9-4bc2-9aa0-8060ec7dc613 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051726 Aug 04 23:20:07.772826 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 356/739] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:20:07 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:08.785323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-34640596-db1b-4d14-a8c5-d54ce9026be6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:08.787749 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-34640596-db1b-4d14-a8c5-d54ce9026be6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:08.795374 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-34640596-db1b-4d14-a8c5-d54ce9026be6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:08.795972 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-34640596-db1b-4d14-a8c5-d54ce9026be6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:08.796428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-34640596-db1b-4d14-a8c5-d54ce9026be6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:08.797122 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-34640596-db1b-4d14-a8c5-d54ce9026be6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:08.797601 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-34640596-db1b-4d14-a8c5-d54ce9026be6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:08.798071 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-34640596-db1b-4d14-a8c5-d54ce9026be6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:08.828921 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-34640596-db1b-4d14-a8c5-d54ce9026be6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047851 Aug 04 23:20:08.829481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 384/740] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:20:08 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:09.841509 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1e2eada6-9dbd-4f00-bcef-c5af4f153c4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:09.844212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1e2eada6-9dbd-4f00-bcef-c5af4f153c4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:09.850862 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1e2eada6-9dbd-4f00-bcef-c5af4f153c4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:09.851387 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1e2eada6-9dbd-4f00-bcef-c5af4f153c4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:09.851825 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1e2eada6-9dbd-4f00-bcef-c5af4f153c4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:09.852529 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1e2eada6-9dbd-4f00-bcef-c5af4f153c4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:09.852985 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1e2eada6-9dbd-4f00-bcef-c5af4f153c4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:09.853437 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1e2eada6-9dbd-4f00-bcef-c5af4f153c4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:09.882856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1e2eada6-9dbd-4f00-bcef-c5af4f153c4b tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045446 Aug 04 23:20:09.883429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 357/741] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:20:09 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:09.888902 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ac919835-f3bb-4953-a2b0-56de03422ed7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cda74555-322c-4218-9310-e521ac120195"}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:09.891927 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ac919835-f3bb-4953-a2b0-56de03422ed7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:09.898967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac919835-f3bb-4953-a2b0-56de03422ed7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:09.899443 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac919835-f3bb-4953-a2b0-56de03422ed7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:09.899869 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac919835-f3bb-4953-a2b0-56de03422ed7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:09.900568 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac919835-f3bb-4953-a2b0-56de03422ed7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:09.901453 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac919835-f3bb-4953-a2b0-56de03422ed7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:09.901453 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac919835-f3bb-4953-a2b0-56de03422ed7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:09.988615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-ac919835-f3bb-4953-a2b0-56de03422ed7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] HTTP exception thrown: Invalid volume: volume cda74555-322c-4218-9310-e521ac120195 is already attached to instances: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da Aug 04 23:20:09.990298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ac919835-f3bb-4953-a2b0-56de03422ed7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Request method failure captured: Aug 04 23:20:09.990298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: POST /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da/os-volume_attachments HTTP/1.1 Aug 04 23:20:09.990298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:20:09.990298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:20:09.990298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:20:09.990298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 74 Aug 04 23:20:09.990298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:20:09.990298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:20:09.990298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:20:09.990298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:20:09.990298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FJxolWXoCq7pteacc3wSoOFRBafzn5l-VFi74XBW7wvTawbOokhRmWW1PKP-C_VKEwuqozn26yg856JLZkvKXgHW09fl1p22BiGh5nneUxE7kKr1M8fWXZ4OILMJgqixZXLBIGcxsElt638y0EWPGUaTW1AOdHEnKwXTKYRir1dpV4 Aug 04 23:20:09.990298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:20:09.990298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:20:09.990298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:20:09.990298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:20:09.990298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:20:09.990298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:20:09.990298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:20:09.990298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:20:09.990298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:20:09.990298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:20:09.991784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0422afbb853d4ef2924edf221499971c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0422afbb853d4ef2924edf221499971c"}]}] Aug 04 23:20:09.991784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:20:09.991784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:20:09.991784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:20:09.991784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:20:09.991784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:20:09.991784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:20:09.991784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: b2ceb35afcc046218bdce1ab4983d9f9 Aug 04 23:20:09.991784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:20:09.991784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Aug 04 23:20:09.991784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {"volumeAttachment": {"volumeId": "cda74555-322c-4218-9310-e521ac120195"}} Aug 04 23:20:09.991784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: > Aug 04 23:20:09.992531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Invalid volume: volume cda74555-322c-4218-9310-e521ac120195 is already attached to instances: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da Aug 04 23:20:09.992531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'server_id': 'cd92a5bc-ef36-4c4a-a41a-d76abd2b35da', 'body': {'volumeAttachment': {'volumeId': 'cda74555-322c-4218-9310-e521ac120195'}}} Aug 04 23:20:09.992531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:20:09.992531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:09.992531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 23:20:09.992531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 23:20:09.992531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 23:20:09.992531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 23:20:09.992531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 23:20:09.992531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 23:20:09.992531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 23:20:09.992531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 23:20:09.992531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 23:20:09.992531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 23:20:09.992531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cda74555-322c-4218-9310-e521ac120195 is already attached to instances: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da Aug 04 23:20:09.992531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:09.992531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:20:09.992531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:09.992531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:09.994059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:20:09.994059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:20:09.994059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:20:09.994059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:20:09.994059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:20:09.994059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:20:09.994059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 23:20:09.994059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 23:20:09.994059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 23:20:09.994059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 23:20:09.994059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 23:20:09.994059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 23:20:09.994059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 23:20:09.994059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 23:20:09.994059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cda74555-322c-4218-9310-e521ac120195 is already attached to instances: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da Aug 04 23:20:09.994059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:09.994059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:20:09.994059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:09.994059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:09.994059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:20:09.995321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:20:09.995321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:20:09.995321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:20:09.995321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cda74555-322c-4218-9310-e521ac120195 is already attached to instances: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da Aug 04 23:20:09.995321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:09.995321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ac919835-f3bb-4953-a2b0-56de03422ed7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Returning 400 to user: Invalid volume: volume cda74555-322c-4218-9310-e521ac120195 is already attached to instances: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:20:09.995321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ac919835-f3bb-4953-a2b0-56de03422ed7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "POST /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106898 Aug 04 23:20:09.995321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 385/742] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Aug 4 23:20:09 2022] POST /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 23:20:10.060099 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b9d51886-9529-4e9a-ba55-5decb40148ed tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:10.060523 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b9d51886-9529-4e9a-ba55-5decb40148ed tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:10.067315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b9d51886-9529-4e9a-ba55-5decb40148ed tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:10.067795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b9d51886-9529-4e9a-ba55-5decb40148ed tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:10.068230 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b9d51886-9529-4e9a-ba55-5decb40148ed tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:10.068919 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b9d51886-9529-4e9a-ba55-5decb40148ed tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:10.069373 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b9d51886-9529-4e9a-ba55-5decb40148ed tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:10.069803 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b9d51886-9529-4e9a-ba55-5decb40148ed tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:10.149812 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.objects.instance [None req-b9d51886-9529-4e9a-ba55-5decb40148ed tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lazy-loading 'services' on Instance uuid cd92a5bc-ef36-4c4a-a41a-d76abd2b35da {{(pid=129790) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:20:10.223144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b9d51886-9529-4e9a-ba55-5decb40148ed tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da/os-volume_attachments/cda74555-322c-4218-9310-e521ac120195" status: 202 len: 0 microversion: 2.1 time: 0.166876 Aug 04 23:20:10.223733 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 358/743] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Aug 4 23:20:10 2022] DELETE /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da/os-volume_attachments/cda74555-322c-4218-9310-e521ac120195 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:20:10.232048 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1e4c499e-d5ca-4d4f-a54e-e6156c2411d9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:10.234774 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1e4c499e-d5ca-4d4f-a54e-e6156c2411d9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:10.240819 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1e4c499e-d5ca-4d4f-a54e-e6156c2411d9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:10.241322 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1e4c499e-d5ca-4d4f-a54e-e6156c2411d9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:10.241802 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1e4c499e-d5ca-4d4f-a54e-e6156c2411d9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:10.242481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1e4c499e-d5ca-4d4f-a54e-e6156c2411d9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:10.242942 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1e4c499e-d5ca-4d4f-a54e-e6156c2411d9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:10.243353 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1e4c499e-d5ca-4d4f-a54e-e6156c2411d9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:10.277367 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1e4c499e-d5ca-4d4f-a54e-e6156c2411d9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049192 Aug 04 23:20:10.277983 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 386/744] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:20:10 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:10.696380 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-77318ed8-1eef-4549-8a5d-8f79aa6ac980 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:10.696961 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-77318ed8-1eef-4549-8a5d-8f79aa6ac980 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:10.703371 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77318ed8-1eef-4549-8a5d-8f79aa6ac980 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:10.703852 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77318ed8-1eef-4549-8a5d-8f79aa6ac980 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:10.704294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77318ed8-1eef-4549-8a5d-8f79aa6ac980 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:10.704998 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77318ed8-1eef-4549-8a5d-8f79aa6ac980 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:10.705452 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77318ed8-1eef-4549-8a5d-8f79aa6ac980 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:10.705877 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77318ed8-1eef-4549-8a5d-8f79aa6ac980 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:10.730968 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-77318ed8-1eef-4549-8a5d-8f79aa6ac980 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Going to try to terminate instance {{(pid=129790) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 23:20:10.814387 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-77318ed8-1eef-4549-8a5d-8f79aa6ac980 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 204 len: 0 microversion: 2.1 time: 0.122355 Aug 04 23:20:10.815218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 359/745] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:20:10 2022] DELETE /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 23:20:10.824326 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-adb2fa28-5ffd-4592-920c-04d089d546af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:10.825195 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-adb2fa28-5ffd-4592-920c-04d089d546af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:10.838201 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adb2fa28-5ffd-4592-920c-04d089d546af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:10.838727 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adb2fa28-5ffd-4592-920c-04d089d546af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:10.839160 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adb2fa28-5ffd-4592-920c-04d089d546af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:10.839873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adb2fa28-5ffd-4592-920c-04d089d546af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:10.840316 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adb2fa28-5ffd-4592-920c-04d089d546af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:10.840730 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adb2fa28-5ffd-4592-920c-04d089d546af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:10.896607 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d92a1e68-30a6-40de-ac7a-86c67d17a755 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:10.898989 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d92a1e68-30a6-40de-ac7a-86c67d17a755 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:10.906201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d92a1e68-30a6-40de-ac7a-86c67d17a755 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:10.906869 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d92a1e68-30a6-40de-ac7a-86c67d17a755 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:10.907300 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d92a1e68-30a6-40de-ac7a-86c67d17a755 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:10.908003 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d92a1e68-30a6-40de-ac7a-86c67d17a755 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:10.908443 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d92a1e68-30a6-40de-ac7a-86c67d17a755 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:10.908967 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d92a1e68-30a6-40de-ac7a-86c67d17a755 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:10.939409 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d92a1e68-30a6-40de-ac7a-86c67d17a755 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047293 Aug 04 23:20:10.939965 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 360/746] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:20:10 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 23:20:10.981087 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-adb2fa28-5ffd-4592-920c-04d089d546af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:10.989491 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-adb2fa28-5ffd-4592-920c-04d089d546af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1576 microversion: 2.1 time: 0.170216 Aug 04 23:20:10.990072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 387/747] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:10 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:11.021285 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-89dd4067-73ca-46e3-8d44-ccdbd3936671 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:11.021814 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-89dd4067-73ca-46e3-8d44-ccdbd3936671 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:11.028067 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-89dd4067-73ca-46e3-8d44-ccdbd3936671 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:11.028549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-89dd4067-73ca-46e3-8d44-ccdbd3936671 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:11.028981 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-89dd4067-73ca-46e3-8d44-ccdbd3936671 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:11.029679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-89dd4067-73ca-46e3-8d44-ccdbd3936671 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:11.030830 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-89dd4067-73ca-46e3-8d44-ccdbd3936671 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:11.031256 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-89dd4067-73ca-46e3-8d44-ccdbd3936671 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:11.058991 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-89dd4067-73ca-46e3-8d44-ccdbd3936671 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Going to try to terminate instance {{(pid=129790) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 23:20:11.138022 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-89dd4067-73ca-46e3-8d44-ccdbd3936671 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "DELETE /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 204 len: 0 microversion: 2.1 time: 0.120449 Aug 04 23:20:11.138769 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 361/748] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:20:11 2022] DELETE /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 23:20:11.148320 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a114f9b4-3683-4815-843a-5de5f6099612 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:11.149045 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a114f9b4-3683-4815-843a-5de5f6099612 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:11.155923 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a114f9b4-3683-4815-843a-5de5f6099612 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:11.156422 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a114f9b4-3683-4815-843a-5de5f6099612 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:11.156855 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a114f9b4-3683-4815-843a-5de5f6099612 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:11.157569 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a114f9b4-3683-4815-843a-5de5f6099612 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:11.158016 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a114f9b4-3683-4815-843a-5de5f6099612 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:11.158460 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a114f9b4-3683-4815-843a-5de5f6099612 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:11.290127 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-fa5644bf-9f6a-43e2-8f81-63eb111b722e tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:11.292601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-fa5644bf-9f6a-43e2-8f81-63eb111b722e tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:11.299338 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a114f9b4-3683-4815-843a-5de5f6099612 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:11.300280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fa5644bf-9f6a-43e2-8f81-63eb111b722e tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:11.300763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fa5644bf-9f6a-43e2-8f81-63eb111b722e tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:11.301201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fa5644bf-9f6a-43e2-8f81-63eb111b722e tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:11.301940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fa5644bf-9f6a-43e2-8f81-63eb111b722e tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:11.302412 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fa5644bf-9f6a-43e2-8f81-63eb111b722e tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:11.302837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fa5644bf-9f6a-43e2-8f81-63eb111b722e tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:11.307283 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a114f9b4-3683-4815-843a-5de5f6099612 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1690 microversion: 2.1 time: 0.163352 Aug 04 23:20:11.307856 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 388/749] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:11 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:11.349399 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-fa5644bf-9f6a-43e2-8f81-63eb111b722e tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063637 Aug 04 23:20:11.349956 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 362/750] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:20:11 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:20:12.011633 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4ea91f8e-ea75-4805-afcb-ca7c9e2697cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:12.012241 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4ea91f8e-ea75-4805-afcb-ca7c9e2697cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:12.019687 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ea91f8e-ea75-4805-afcb-ca7c9e2697cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:12.020165 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ea91f8e-ea75-4805-afcb-ca7c9e2697cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:12.020597 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ea91f8e-ea75-4805-afcb-ca7c9e2697cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:12.021289 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ea91f8e-ea75-4805-afcb-ca7c9e2697cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:12.021742 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ea91f8e-ea75-4805-afcb-ca7c9e2697cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:12.022164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ea91f8e-ea75-4805-afcb-ca7c9e2697cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:12.156904 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4ea91f8e-ea75-4805-afcb-ca7c9e2697cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:12.164645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4ea91f8e-ea75-4805-afcb-ca7c9e2697cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1576 microversion: 2.1 time: 0.156878 Aug 04 23:20:12.165205 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 389/751] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:12 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:12.339909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3d2794e6-cdb6-4eb9-b054-e2547c84b7b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:12.340515 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3d2794e6-cdb6-4eb9-b054-e2547c84b7b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:12.347274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d2794e6-cdb6-4eb9-b054-e2547c84b7b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:12.347754 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d2794e6-cdb6-4eb9-b054-e2547c84b7b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:12.348184 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d2794e6-cdb6-4eb9-b054-e2547c84b7b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:12.348883 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d2794e6-cdb6-4eb9-b054-e2547c84b7b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:12.349335 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d2794e6-cdb6-4eb9-b054-e2547c84b7b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:12.349761 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d2794e6-cdb6-4eb9-b054-e2547c84b7b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:12.363283 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f28a1361-a6aa-45d7-b0e5-43a222d26509 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:12.365974 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f28a1361-a6aa-45d7-b0e5-43a222d26509 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:12.372321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f28a1361-a6aa-45d7-b0e5-43a222d26509 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:12.372807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f28a1361-a6aa-45d7-b0e5-43a222d26509 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:12.373241 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f28a1361-a6aa-45d7-b0e5-43a222d26509 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:12.373951 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f28a1361-a6aa-45d7-b0e5-43a222d26509 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:12.374424 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f28a1361-a6aa-45d7-b0e5-43a222d26509 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:12.374847 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f28a1361-a6aa-45d7-b0e5-43a222d26509 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:12.408131 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f28a1361-a6aa-45d7-b0e5-43a222d26509 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049477 Aug 04 23:20:12.408702 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 390/752] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:20:12 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:12.491803 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3d2794e6-cdb6-4eb9-b054-e2547c84b7b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:12.499465 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3d2794e6-cdb6-4eb9-b054-e2547c84b7b3 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1690 microversion: 2.1 time: 0.163781 Aug 04 23:20:12.500025 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 363/753] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:12 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:13.185790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-76803a1c-ad69-4bf8-9546-70c20291d7bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:13.186418 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-76803a1c-ad69-4bf8-9546-70c20291d7bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:13.193838 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-76803a1c-ad69-4bf8-9546-70c20291d7bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:13.194319 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-76803a1c-ad69-4bf8-9546-70c20291d7bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:13.194839 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-76803a1c-ad69-4bf8-9546-70c20291d7bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:13.195794 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-76803a1c-ad69-4bf8-9546-70c20291d7bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:13.196206 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-76803a1c-ad69-4bf8-9546-70c20291d7bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:13.196754 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-76803a1c-ad69-4bf8-9546-70c20291d7bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:13.337428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-76803a1c-ad69-4bf8-9546-70c20291d7bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:13.346514 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-76803a1c-ad69-4bf8-9546-70c20291d7bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1576 microversion: 2.1 time: 0.164496 Aug 04 23:20:13.347125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 391/754] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:13 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:13.420420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-67e361b2-0590-4131-a821-3e0dab92ed9f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:13.423509 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-67e361b2-0590-4131-a821-3e0dab92ed9f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:13.430127 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-67e361b2-0590-4131-a821-3e0dab92ed9f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:13.430756 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-67e361b2-0590-4131-a821-3e0dab92ed9f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:13.431304 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-67e361b2-0590-4131-a821-3e0dab92ed9f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:13.432010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-67e361b2-0590-4131-a821-3e0dab92ed9f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:13.432459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-67e361b2-0590-4131-a821-3e0dab92ed9f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:13.432887 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-67e361b2-0590-4131-a821-3e0dab92ed9f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:13.464463 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-67e361b2-0590-4131-a821-3e0dab92ed9f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047885 Aug 04 23:20:13.465032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 364/755] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:20:13 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:20:13.522788 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-123d62fe-1186-416a-9d08-c820b6f04438 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:13.523775 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-123d62fe-1186-416a-9d08-c820b6f04438 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:13.536924 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-123d62fe-1186-416a-9d08-c820b6f04438 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:13.537418 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-123d62fe-1186-416a-9d08-c820b6f04438 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:13.537855 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-123d62fe-1186-416a-9d08-c820b6f04438 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:13.538614 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-123d62fe-1186-416a-9d08-c820b6f04438 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:13.539071 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-123d62fe-1186-416a-9d08-c820b6f04438 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:13.539495 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-123d62fe-1186-416a-9d08-c820b6f04438 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:13.679637 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-123d62fe-1186-416a-9d08-c820b6f04438 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:13.687348 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-123d62fe-1186-416a-9d08-c820b6f04438 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1690 microversion: 2.1 time: 0.170398 Aug 04 23:20:13.688100 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 392/756] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:13 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:14.369732 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-af0a7258-ddeb-426c-abc7-a960af4d33c1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:14.370247 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-af0a7258-ddeb-426c-abc7-a960af4d33c1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:14.377922 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-af0a7258-ddeb-426c-abc7-a960af4d33c1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:14.378464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-af0a7258-ddeb-426c-abc7-a960af4d33c1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:14.378932 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-af0a7258-ddeb-426c-abc7-a960af4d33c1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:14.379634 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-af0a7258-ddeb-426c-abc7-a960af4d33c1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:14.380078 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-af0a7258-ddeb-426c-abc7-a960af4d33c1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:14.380592 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-af0a7258-ddeb-426c-abc7-a960af4d33c1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:14.478050 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4f42fdb7-93a5-4af4-a519-191b3e2e8c85 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:14.480323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4f42fdb7-93a5-4af4-a519-191b3e2e8c85 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:14.487084 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f42fdb7-93a5-4af4-a519-191b3e2e8c85 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:14.487572 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f42fdb7-93a5-4af4-a519-191b3e2e8c85 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:14.488001 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f42fdb7-93a5-4af4-a519-191b3e2e8c85 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:14.488732 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f42fdb7-93a5-4af4-a519-191b3e2e8c85 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:14.489180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f42fdb7-93a5-4af4-a519-191b3e2e8c85 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:14.489596 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f42fdb7-93a5-4af4-a519-191b3e2e8c85 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:14.522302 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4f42fdb7-93a5-4af4-a519-191b3e2e8c85 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048626 Aug 04 23:20:14.522918 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 393/757] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:20:14 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:14.527110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-af0a7258-ddeb-426c-abc7-a960af4d33c1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:14.535650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-af0a7258-ddeb-426c-abc7-a960af4d33c1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1576 microversion: 2.1 time: 0.170040 Aug 04 23:20:14.536237 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 365/758] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:14 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:20:14.708117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0b80250e-4f32-4e9a-bc92-793745050473 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:14.708725 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0b80250e-4f32-4e9a-bc92-793745050473 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:14.715149 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0b80250e-4f32-4e9a-bc92-793745050473 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:14.715624 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0b80250e-4f32-4e9a-bc92-793745050473 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:14.716053 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0b80250e-4f32-4e9a-bc92-793745050473 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:14.716742 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0b80250e-4f32-4e9a-bc92-793745050473 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:14.717186 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0b80250e-4f32-4e9a-bc92-793745050473 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:14.717608 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0b80250e-4f32-4e9a-bc92-793745050473 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:14.864407 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0b80250e-4f32-4e9a-bc92-793745050473 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:14.872060 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0b80250e-4f32-4e9a-bc92-793745050473 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1690 microversion: 2.1 time: 0.167848 Aug 04 23:20:14.872635 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 394/759] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:14 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:15.534017 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-cad5bb2a-ab8f-49bf-bc7c-6555f67cc046 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:15.536608 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-cad5bb2a-ab8f-49bf-bc7c-6555f67cc046 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:15.543207 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cad5bb2a-ab8f-49bf-bc7c-6555f67cc046 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:15.543685 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cad5bb2a-ab8f-49bf-bc7c-6555f67cc046 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:15.544123 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cad5bb2a-ab8f-49bf-bc7c-6555f67cc046 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:15.544826 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cad5bb2a-ab8f-49bf-bc7c-6555f67cc046 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:15.545272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cad5bb2a-ab8f-49bf-bc7c-6555f67cc046 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:15.545693 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cad5bb2a-ab8f-49bf-bc7c-6555f67cc046 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:15.550381 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:20:15.556886 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-232c47e7-7403-46d1-a9a3-640be2a4fcf5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:15.557604 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-232c47e7-7403-46d1-a9a3-640be2a4fcf5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:15.564996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-232c47e7-7403-46d1-a9a3-640be2a4fcf5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:15.565490 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-232c47e7-7403-46d1-a9a3-640be2a4fcf5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:15.565912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-232c47e7-7403-46d1-a9a3-640be2a4fcf5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:15.566732 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-232c47e7-7403-46d1-a9a3-640be2a4fcf5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:15.567189 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-232c47e7-7403-46d1-a9a3-640be2a4fcf5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:15.567612 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-232c47e7-7403-46d1-a9a3-640be2a4fcf5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:15.578242 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-cad5bb2a-ab8f-49bf-bc7c-6555f67cc046 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048312 Aug 04 23:20:15.578942 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 366/760] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:20:15 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 23:20:15.647524 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-89e2abac-bd43-4145-ae6c-9753ff2ebf12 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:15.648346 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-89e2abac-bd43-4145-ae6c-9753ff2ebf12 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:15.654874 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-89e2abac-bd43-4145-ae6c-9753ff2ebf12 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:15.655379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-89e2abac-bd43-4145-ae6c-9753ff2ebf12 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:15.655815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-89e2abac-bd43-4145-ae6c-9753ff2ebf12 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:15.657086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-89e2abac-bd43-4145-ae6c-9753ff2ebf12 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:15.658499 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-89e2abac-bd43-4145-ae6c-9753ff2ebf12 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:15.658609 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-89e2abac-bd43-4145-ae6c-9753ff2ebf12 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:15.688950 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-89e2abac-bd43-4145-ae6c-9753ff2ebf12 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Going to try to terminate instance {{(pid=129790) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 23:20:15.721197 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-232c47e7-7403-46d1-a9a3-640be2a4fcf5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:15.728762 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-232c47e7-7403-46d1-a9a3-640be2a4fcf5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1576 microversion: 2.1 time: 0.175641 Aug 04 23:20:15.729346 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 395/761] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:15 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:20:15.786712 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-89e2abac-bd43-4145-ae6c-9753ff2ebf12 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da" status: 204 len: 0 microversion: 2.1 time: 0.143683 Aug 04 23:20:15.787546 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 367/762] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:20:15 2022] DELETE /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 23:20:15.795877 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-895a4af2-e92e-4a57-94c9-b33774c25fd8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:15.796492 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-895a4af2-e92e-4a57-94c9-b33774c25fd8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:15.803617 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-895a4af2-e92e-4a57-94c9-b33774c25fd8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:15.804104 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-895a4af2-e92e-4a57-94c9-b33774c25fd8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:15.804525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-895a4af2-e92e-4a57-94c9-b33774c25fd8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:15.805216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-895a4af2-e92e-4a57-94c9-b33774c25fd8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:15.805668 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-895a4af2-e92e-4a57-94c9-b33774c25fd8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:15.806165 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-895a4af2-e92e-4a57-94c9-b33774c25fd8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:15.899864 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-507bbaa8-4618-43f8-9052-553549d5cb27 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:15.901491 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-507bbaa8-4618-43f8-9052-553549d5cb27 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:15.910720 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-507bbaa8-4618-43f8-9052-553549d5cb27 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:15.911984 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-507bbaa8-4618-43f8-9052-553549d5cb27 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:15.912366 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-507bbaa8-4618-43f8-9052-553549d5cb27 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:15.913956 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-507bbaa8-4618-43f8-9052-553549d5cb27 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:15.914758 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-507bbaa8-4618-43f8-9052-553549d5cb27 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:15.915609 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-507bbaa8-4618-43f8-9052-553549d5cb27 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:15.979721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-895a4af2-e92e-4a57-94c9-b33774c25fd8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:15.988631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-895a4af2-e92e-4a57-94c9-b33774c25fd8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da" status: 200 len: 1681 microversion: 2.1 time: 0.196585 Aug 04 23:20:15.989204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 396/763] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:15 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da => generated 1681 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:20:16.086384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-507bbaa8-4618-43f8-9052-553549d5cb27 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:16.096576 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-507bbaa8-4618-43f8-9052-553549d5cb27 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1690 microversion: 2.1 time: 0.202815 Aug 04 23:20:16.097354 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 368/764] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:15 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1690 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:16.755010 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6f097491-9182-4457-8230-36fa413798e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:16.756128 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6f097491-9182-4457-8230-36fa413798e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:16.762227 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f097491-9182-4457-8230-36fa413798e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:16.762744 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f097491-9182-4457-8230-36fa413798e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:16.763173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f097491-9182-4457-8230-36fa413798e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:16.763875 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f097491-9182-4457-8230-36fa413798e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:16.764371 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f097491-9182-4457-8230-36fa413798e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:16.764734 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f097491-9182-4457-8230-36fa413798e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:16.915868 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6f097491-9182-4457-8230-36fa413798e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:16.925033 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6f097491-9182-4457-8230-36fa413798e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1576 microversion: 2.1 time: 0.175033 Aug 04 23:20:16.925625 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 397/765] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:16 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:17.013502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-085fdae8-3692-4830-b09e-844dad98aacd tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:17.014099 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-085fdae8-3692-4830-b09e-844dad98aacd tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:17.022892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-085fdae8-3692-4830-b09e-844dad98aacd tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:17.023379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-085fdae8-3692-4830-b09e-844dad98aacd tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:17.023812 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-085fdae8-3692-4830-b09e-844dad98aacd tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:17.024519 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-085fdae8-3692-4830-b09e-844dad98aacd tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:17.024973 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-085fdae8-3692-4830-b09e-844dad98aacd tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:17.025393 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-085fdae8-3692-4830-b09e-844dad98aacd tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:17.118880 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ce90f26b-8882-4ee3-a87a-2f2647f040c5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:17.119576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ce90f26b-8882-4ee3-a87a-2f2647f040c5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:17.126894 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce90f26b-8882-4ee3-a87a-2f2647f040c5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:17.127680 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce90f26b-8882-4ee3-a87a-2f2647f040c5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:17.128355 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce90f26b-8882-4ee3-a87a-2f2647f040c5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:17.129147 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce90f26b-8882-4ee3-a87a-2f2647f040c5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:17.129680 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce90f26b-8882-4ee3-a87a-2f2647f040c5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:17.130177 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce90f26b-8882-4ee3-a87a-2f2647f040c5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:17.135044 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:20:17.202405 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ce90f26b-8882-4ee3-a87a-2f2647f040c5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:17.206127 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-085fdae8-3692-4830-b09e-844dad98aacd tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:17.214153 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-085fdae8-3692-4830-b09e-844dad98aacd tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da" status: 200 len: 1681 microversion: 2.1 time: 0.204631 Aug 04 23:20:17.215347 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 369/766] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:17 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:17.221354 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ce90f26b-8882-4ee3-a87a-2f2647f040c5 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 200 len: 1622 microversion: 2.1 time: 0.106276 Aug 04 23:20:17.222016 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 398/767] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:17 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 1622 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:20:17.533536 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-4fe56e18-08a9-4bc5-b27f-add87a52467a req-4b078d8b-418d-455e-ade7-cc6c8217804e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13d950e0-48a6-44d6-9aae-723354b66c48", "name": "network-vif-deleted", "tag": "e81f804d-489a-45c5-bf6d-27259b247ae5"}, {"server_uuid": "5507ea1e-7623-46eb-9317-03688967021e", "name": "network-vif-deleted", "tag": "77de594c-7c86-47c2-a1db-2cbb7ecc8978"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:17.565175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-4fe56e18-08a9-4bc5-b27f-add87a52467a req-4b078d8b-418d-455e-ade7-cc6c8217804e service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:17.565973 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-4fe56e18-08a9-4bc5-b27f-add87a52467a req-4b078d8b-418d-455e-ade7-cc6c8217804e service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:17.566598 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-4fe56e18-08a9-4bc5-b27f-add87a52467a req-4b078d8b-418d-455e-ade7-cc6c8217804e service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:17.583698 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-4fe56e18-08a9-4bc5-b27f-add87a52467a req-4b078d8b-418d-455e-ade7-cc6c8217804e service nova] Creating event network-vif-deleted:e81f804d-489a-45c5-bf6d-27259b247ae5 for instance 13d950e0-48a6-44d6-9aae-723354b66c48 on hv-cinder-85221 Aug 04 23:20:17.584688 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-4fe56e18-08a9-4bc5-b27f-add87a52467a req-4b078d8b-418d-455e-ade7-cc6c8217804e service nova] Creating event network-vif-deleted:77de594c-7c86-47c2-a1db-2cbb7ecc8978 for instance 5507ea1e-7623-46eb-9317-03688967021e on hv-cinder-85221 Aug 04 23:20:17.593418 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-4fe56e18-08a9-4bc5-b27f-add87a52467a req-4b078d8b-418d-455e-ade7-cc6c8217804e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064724 Aug 04 23:20:17.596168 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 370/768] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:17.949303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ac14444f-4159-4967-9f66-7ffc738dc5ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:17.950089 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ac14444f-4159-4967-9f66-7ffc738dc5ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:17.962166 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac14444f-4159-4967-9f66-7ffc738dc5ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:17.963128 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac14444f-4159-4967-9f66-7ffc738dc5ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:17.963673 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac14444f-4159-4967-9f66-7ffc738dc5ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:17.964650 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac14444f-4159-4967-9f66-7ffc738dc5ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:17.965432 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac14444f-4159-4967-9f66-7ffc738dc5ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:17.966070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac14444f-4159-4967-9f66-7ffc738dc5ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:18.060050 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac14444f-4159-4967-9f66-7ffc738dc5ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:18.060842 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac14444f-4159-4967-9f66-7ffc738dc5ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:18.061796 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ac14444f-4159-4967-9f66-7ffc738dc5ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:18.064193 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.objects.instance [None req-ac14444f-4159-4967-9f66-7ffc738dc5ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lazy-loading 'fault' on Instance uuid 5507ea1e-7623-46eb-9317-03688967021e {{(pid=129791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:20:18.131548 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ac14444f-4159-4967-9f66-7ffc738dc5ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:18.150507 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ac14444f-4159-4967-9f66-7ffc738dc5ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 200 len: 1230 microversion: 2.1 time: 0.205465 Aug 04 23:20:18.151111 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 399/769] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:17 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 1230 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:18.238189 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-69640bdc-d90b-480c-ab8e-26e856939abe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:18.239916 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-69640bdc-d90b-480c-ab8e-26e856939abe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:18.243952 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-be197dff-be41-4d92-95fd-a9a3a09d3201 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:18.244568 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-be197dff-be41-4d92-95fd-a9a3a09d3201 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 13d950e0-48a6-44d6-9aae-723354b66c48] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:18.247822 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-69640bdc-d90b-480c-ab8e-26e856939abe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:18.248919 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-69640bdc-d90b-480c-ab8e-26e856939abe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:18.249695 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-69640bdc-d90b-480c-ab8e-26e856939abe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:18.251497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-69640bdc-d90b-480c-ab8e-26e856939abe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:18.252239 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-69640bdc-d90b-480c-ab8e-26e856939abe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:18.252894 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-69640bdc-d90b-480c-ab8e-26e856939abe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:18.260458 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be197dff-be41-4d92-95fd-a9a3a09d3201 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:18.261125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be197dff-be41-4d92-95fd-a9a3a09d3201 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:18.261736 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be197dff-be41-4d92-95fd-a9a3a09d3201 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:18.262608 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be197dff-be41-4d92-95fd-a9a3a09d3201 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:18.263430 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be197dff-be41-4d92-95fd-a9a3a09d3201 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:18.264156 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be197dff-be41-4d92-95fd-a9a3a09d3201 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:18.301623 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-be197dff-be41-4d92-95fd-a9a3a09d3201 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] HTTP exception thrown: Instance 13d950e0-48a6-44d6-9aae-723354b66c48 could not be found. Aug 04 23:20:18.305262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-be197dff-be41-4d92-95fd-a9a3a09d3201 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Request method failure captured: Aug 04 23:20:18.305262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 HTTP/1.1 Aug 04 23:20:18.305262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:20:18.305262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:20:18.305262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:20:18.305262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 0 Aug 04 23:20:18.305262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:20:18.305262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:20:18.305262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:20:18.305262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:20:18.305262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FJ6RKYMdfsISiTgYEMvks0x5d50WB4Vbj1WQgE1v6AQbUxoUYQTrWgb9IvdiKRoAPbIyfnSaCOdg5gEaB9t_gZ5C6HO6cjgM58wzr3Oq1EOqCSLuKxKWCkjyonkLQBDSxbLmeiJH_Z9CWvDApSZl7vw3VKIMJPpD2CVXPZhXNad-G8 Aug 04 23:20:18.305262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:20:18.305262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:20:18.305262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:20:18.305262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:20:18.305262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:20:18.305262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:20:18.305262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: f50215d0b0ec4a109e14979c183a52a3 Aug 04 23:20:18.305262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-475500057 Aug 04 23:20:18.305262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:20:18.305262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:20:18.306853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f50215d0b0ec4a109e14979c183a52a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f50215d0b0ec4a109e14979c183a52a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f50215d0b0ec4a109e14979c183a52a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f50215d0b0ec4a109e14979c183a52a3"}]}] Aug 04 23:20:18.306853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-ServerRescueNegativeTestJSON-475500057 Aug 04 23:20:18.306853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: f50215d0b0ec4a109e14979c183a52a3 Aug 04 23:20:18.306853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-475500057 Aug 04 23:20:18.306853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-ServerRescueNegativeTestJSON-475500057-project Aug 04 23:20:18.306853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:20:18.306853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:20:18.306853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: 51af2dbb470849a4a044f6f78eef2d45 Aug 04 23:20:18.306853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-ServerRescueNegativeTestJSON-475500057-project Aug 04 23:20:18.306853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: > Aug 04 23:20:18.306853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Instance 13d950e0-48a6-44d6-9aae-723354b66c48 could not be found. Aug 04 23:20:18.306853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'id': '13d950e0-48a6-44d6-9aae-723354b66c48'} Aug 04 23:20:18.307685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:20:18.307685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:18.307685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:20:18.307685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:20:18.307685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:20:18.307685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:20:18.307685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:20:18.307685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:20:18.307685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:20:18.307685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:20:18.307685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13d950e0-48a6-44d6-9aae-723354b66c48 could not be found. Aug 04 23:20:18.307685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:18.307685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:20:18.307685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:18.307685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:18.307685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:20:18.307685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:20:18.307685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:20:18.307685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:20:18.307685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:20:18.309064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:20:18.309064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:20:18.309064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:20:18.309064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:20:18.309064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:20:18.309064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:20:18.309064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:20:18.309064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13d950e0-48a6-44d6-9aae-723354b66c48 could not be found. Aug 04 23:20:18.309064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:18.309064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:20:18.309064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:18.309064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:18.309064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:20:18.309064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:20:18.309064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:20:18.309064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:20:18.309064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13d950e0-48a6-44d6-9aae-723354b66c48 could not be found. Aug 04 23:20:18.309064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:18.314521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-be197dff-be41-4d92-95fd-a9a3a09d3201 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Returning 404 to user: Instance 13d950e0-48a6-44d6-9aae-723354b66c48 could not be found. {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:20:18.317196 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-be197dff-be41-4d92-95fd-a9a3a09d3201 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48" status: 404 len: 111 microversion: 2.1 time: 0.077525 Aug 04 23:20:18.324223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 400/770] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:18 2022] GET /compute/v2.1/servers/13d950e0-48a6-44d6-9aae-723354b66c48 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 23:20:18.330423 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0ddc880d-70d5-45a3-8cdf-d8a790dc20bc tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '.version_select at 0x7f6d25e4de50>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:18.371908 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0ddc880d-70d5-45a3-8cdf-d8a790dc20bc tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1577644367" status: 202 len: 0 microversion: 2.1 time: 0.046056 Aug 04 23:20:18.377038 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 401/771] 10.222.0.33 () {58 vars in 1221 bytes} [Thu Aug 4 23:20:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1577644367 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:20:18.577562 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-69640bdc-d90b-480c-ab8e-26e856939abe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:18.596598 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-69640bdc-d90b-480c-ab8e-26e856939abe tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da" status: 200 len: 1681 microversion: 2.1 time: 0.364125 Aug 04 23:20:18.597494 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 371/772] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:18 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da => generated 1681 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:19.174685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-64c4b49a-1df2-4af5-adbc-45cf81867338 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:19.176031 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-64c4b49a-1df2-4af5-adbc-45cf81867338 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:19.186605 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-64c4b49a-1df2-4af5-adbc-45cf81867338 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:19.186969 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-64c4b49a-1df2-4af5-adbc-45cf81867338 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:19.187890 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-64c4b49a-1df2-4af5-adbc-45cf81867338 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:19.189567 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-64c4b49a-1df2-4af5-adbc-45cf81867338 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:19.190249 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-64c4b49a-1df2-4af5-adbc-45cf81867338 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:19.190879 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-64c4b49a-1df2-4af5-adbc-45cf81867338 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:19.210322 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-64c4b49a-1df2-4af5-adbc-45cf81867338 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] HTTP exception thrown: Instance 5507ea1e-7623-46eb-9317-03688967021e could not be found. Aug 04 23:20:19.213004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-64c4b49a-1df2-4af5-adbc-45cf81867338 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Request method failure captured: Aug 04 23:20:19.213004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e HTTP/1.1 Aug 04 23:20:19.213004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:20:19.213004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:20:19.213004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:20:19.213004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 0 Aug 04 23:20:19.213004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:20:19.213004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:20:19.213004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:20:19.213004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:20:19.213004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FNHc_exw7mmzHYR1jyubTtj6G3MhJK1aBBv_3qJmnBeA2R71X6H3jEL0OcZhAhNY3eiubbJ6VTuXvmObZLmnmAiMyaDq4JU4MGDh76KH282SNT6WdOttaYrsLZQcPgr2Ui-0Ak8Q6Al_pRlVdFng0L3ZlY5O11R7R0f4L9nqSD-rbQ Aug 04 23:20:19.213004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:20:19.213004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:20:19.213004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:20:19.213004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:20:19.213004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:20:19.213004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:20:19.213004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: 7954e7a03fce4b64b498e68370483def Aug 04 23:20:19.213004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-TestVolumeBootPattern-1875845652 Aug 04 23:20:19.213004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:20:19.213004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:20:19.214681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7954e7a03fce4b64b498e68370483def"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7954e7a03fce4b64b498e68370483def"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7954e7a03fce4b64b498e68370483def"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7954e7a03fce4b64b498e68370483def"}]}] Aug 04 23:20:19.214681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-TestVolumeBootPattern-1875845652 Aug 04 23:20:19.214681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: 7954e7a03fce4b64b498e68370483def Aug 04 23:20:19.214681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-TestVolumeBootPattern-1875845652 Aug 04 23:20:19.214681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-TestVolumeBootPattern-1875845652-project Aug 04 23:20:19.214681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:20:19.214681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:20:19.214681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: 95c10802aacf46be91e86b33dff95abc Aug 04 23:20:19.214681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-TestVolumeBootPattern-1875845652-project Aug 04 23:20:19.214681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: > Aug 04 23:20:19.214681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Instance 5507ea1e-7623-46eb-9317-03688967021e could not be found. Aug 04 23:20:19.214681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'id': '5507ea1e-7623-46eb-9317-03688967021e'} Aug 04 23:20:19.215607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:20:19.215607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:19.215607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:20:19.215607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:20:19.215607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:20:19.215607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:20:19.215607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:20:19.215607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:20:19.215607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:20:19.215607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:20:19.215607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5507ea1e-7623-46eb-9317-03688967021e could not be found. Aug 04 23:20:19.215607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:19.215607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:20:19.215607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:19.215607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:19.215607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:20:19.215607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:20:19.215607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:20:19.215607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:20:19.215607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:20:19.216996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:20:19.216996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:20:19.216996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:20:19.216996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:20:19.216996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:20:19.216996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:20:19.216996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:20:19.216996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5507ea1e-7623-46eb-9317-03688967021e could not be found. Aug 04 23:20:19.216996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:19.216996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:20:19.216996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:19.216996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:19.216996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:20:19.216996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:20:19.216996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:20:19.216996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:20:19.216996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5507ea1e-7623-46eb-9317-03688967021e could not be found. Aug 04 23:20:19.216996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:19.231100 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-64c4b49a-1df2-4af5-adbc-45cf81867338 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Returning 404 to user: Instance 5507ea1e-7623-46eb-9317-03688967021e could not be found. {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:20:19.232471 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-64c4b49a-1df2-4af5-adbc-45cf81867338 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 404 len: 111 microversion: 2.1 time: 0.063027 Aug 04 23:20:19.243450 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 402/773] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:19 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:20:19.347266 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-925261d8-ea20-43e2-87b0-cb5f9263114e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-222953285", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1320467911", "security_groups": [{"name": "tempest-secgroup-smoke-1894323483"}], "block_device_mapping_v2": [{"uuid": "4b572e86-4915-4b2a-a9e1-6d6a10532792", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eab51316-848b-42a4-a608-f9226c6150e3"}]}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:19.494253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.network.neutron [None req-925261d8-ea20-43e2-87b0-cb5f9263114e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] validate_networks() for [('eab51316-848b-42a4-a608-f9226c6150e3', None, None, None, None, None)] {{(pid=129790) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 23:20:19.613216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-9f6a8e5a-ff95-47e9-b619-c6443a8a0925 req-155936e8-9a21-4d99-8fd3-c8056e604f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd92a5bc-ef36-4c4a-a41a-d76abd2b35da", "name": "network-vif-deleted", "tag": "934d7a8a-8b75-4939-ab8e-b06776f0fd31"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:19.624736 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-9f6a8e5a-ff95-47e9-b619-c6443a8a0925 req-155936e8-9a21-4d99-8fd3-c8056e604f2a service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:19.626649 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-9f6a8e5a-ff95-47e9-b619-c6443a8a0925 req-155936e8-9a21-4d99-8fd3-c8056e604f2a service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:19.628044 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-9f6a8e5a-ff95-47e9-b619-c6443a8a0925 req-155936e8-9a21-4d99-8fd3-c8056e604f2a service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:19.643174 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-9f6a8e5a-ff95-47e9-b619-c6443a8a0925 req-155936e8-9a21-4d99-8fd3-c8056e604f2a service nova] Creating event network-vif-deleted:934d7a8a-8b75-4939-ab8e-b06776f0fd31 for instance cd92a5bc-ef36-4c4a-a41a-d76abd2b35da on hv-cinder-85221 Aug 04 23:20:19.649133 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-9f6a8e5a-ff95-47e9-b619-c6443a8a0925 req-155936e8-9a21-4d99-8fd3-c8056e604f2a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040046 Aug 04 23:20:19.650387 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 403/774] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:20:19.660770 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-656f6757-1093-43c3-974e-0205400d6c20 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:19.661807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-656f6757-1093-43c3-974e-0205400d6c20 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:19.669551 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-656f6757-1093-43c3-974e-0205400d6c20 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:19.670450 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-656f6757-1093-43c3-974e-0205400d6c20 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:19.671901 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-656f6757-1093-43c3-974e-0205400d6c20 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:19.672944 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-656f6757-1093-43c3-974e-0205400d6c20 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:19.674590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-656f6757-1093-43c3-974e-0205400d6c20 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:19.675268 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-656f6757-1093-43c3-974e-0205400d6c20 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:19.720017 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-656f6757-1093-43c3-974e-0205400d6c20 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:19.720499 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-656f6757-1093-43c3-974e-0205400d6c20 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:19.720928 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-656f6757-1093-43c3-974e-0205400d6c20 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:19.721382 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.objects.instance [None req-656f6757-1093-43c3-974e-0205400d6c20 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lazy-loading 'fault' on Instance uuid cd92a5bc-ef36-4c4a-a41a-d76abd2b35da {{(pid=129791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:20:19.819798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-656f6757-1093-43c3-974e-0205400d6c20 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:19.841009 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-656f6757-1093-43c3-974e-0205400d6c20 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da" status: 200 len: 1330 microversion: 2.1 time: 0.188805 Aug 04 23:20:19.842014 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 404/775] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:19 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da => generated 1330 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:20.000574 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-925261d8-ea20-43e2-87b0-cb5f9263114e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Flavor limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 23:20:20.001330 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-925261d8-ea20-43e2-87b0-cb5f9263114e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Image limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 23:20:20.001808 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-925261d8-ea20-43e2-87b0-cb5f9263114e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Flavor pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 23:20:20.002219 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-925261d8-ea20-43e2-87b0-cb5f9263114e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Image pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 23:20:20.002698 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-925261d8-ea20-43e2-87b0-cb5f9263114e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 23:20:20.022234 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-925261d8-ea20-43e2-87b0-cb5f9263114e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:20.023272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-925261d8-ea20-43e2-87b0-cb5f9263114e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:20.023913 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-925261d8-ea20-43e2-87b0-cb5f9263114e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:20.025243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-925261d8-ea20-43e2-87b0-cb5f9263114e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:20.025970 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-925261d8-ea20-43e2-87b0-cb5f9263114e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:20.026674 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-925261d8-ea20-43e2-87b0-cb5f9263114e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:20.058491 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-925261d8-ea20-43e2-87b0-cb5f9263114e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Getting quotas for project 7954e7a03fce4b64b498e68370483def. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:20:20.067069 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-925261d8-ea20-43e2-87b0-cb5f9263114e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Getting quotas for user 95c10802aacf46be91e86b33dff95abc and project 7954e7a03fce4b64b498e68370483def. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:20:20.151732 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-925261d8-ea20-43e2-87b0-cb5f9263114e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Going to run 1 instances... {{(pid=129790) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 23:20:20.154047 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-925261d8-ea20-43e2-87b0-cb5f9263114e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4b572e86-4915-4b2a-a9e1-6d6a10532792',volume_size=None,volume_type=None)] {{(pid=129790) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 23:20:20.314810 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-925261d8-ea20-43e2-87b0-cb5f9263114e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.971985 Aug 04 23:20:20.315685 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 372/776] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Aug 4 23:20:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 23:20:20.326784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-69652a23-5778-4ce1-88b5-603ff85546e2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:20.327411 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-69652a23-5778-4ce1-88b5-603ff85546e2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:20.392507 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-69652a23-5778-4ce1-88b5-603ff85546e2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:20.400321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-69652a23-5778-4ce1-88b5-603ff85546e2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1094 microversion: 2.1 time: 0.077544 Aug 04 23:20:20.401130 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 405/777] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:20 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:20.865745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-36153623-3183-49d0-bc34-306928b566b5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:20.866342 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-36153623-3183-49d0-bc34-306928b566b5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:20.872772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-36153623-3183-49d0-bc34-306928b566b5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:20.873260 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-36153623-3183-49d0-bc34-306928b566b5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:20.873705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-36153623-3183-49d0-bc34-306928b566b5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:20.874422 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-36153623-3183-49d0-bc34-306928b566b5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:20.875372 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-36153623-3183-49d0-bc34-306928b566b5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:20.876087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-36153623-3183-49d0-bc34-306928b566b5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:20.889622 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-36153623-3183-49d0-bc34-306928b566b5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] HTTP exception thrown: Instance cd92a5bc-ef36-4c4a-a41a-d76abd2b35da could not be found. Aug 04 23:20:20.891815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-36153623-3183-49d0-bc34-306928b566b5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Request method failure captured: Aug 04 23:20:20.891815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da HTTP/1.1 Aug 04 23:20:20.891815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:20:20.891815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:20:20.891815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:20:20.891815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:20:20.891815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:20:20.891815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:20:20.891815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:20:20.891815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:20:20.891815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FJxolWXoCq7pteacc3wSoOFRBafzn5l-VFi74XBW7wvTawbOokhRmWW1PKP-C_VKEwuqozn26yg856JLZkvKXgHW09fl1p22BiGh5nneUxE7kKr1M8fWXZ4OILMJgqixZXLBIGcxsElt638y0EWPGUaTW1AOdHEnKwXTKYRir1dpV4 Aug 04 23:20:20.891815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:20:20.891815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:20:20.891815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:20:20.891815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:20:20.891815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:20:20.891815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:20:20.891815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:20:20.891815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:20:20.891815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:20:20.891815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:20:20.893407 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0422afbb853d4ef2924edf221499971c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0422afbb853d4ef2924edf221499971c"}]}] Aug 04 23:20:20.893407 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:20:20.893407 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:20:20.893407 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:20:20.893407 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:20:20.893407 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:20:20.893407 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:20:20.893407 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: b2ceb35afcc046218bdce1ab4983d9f9 Aug 04 23:20:20.893407 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:20:20.893407 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:20:20.893407 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Instance cd92a5bc-ef36-4c4a-a41a-d76abd2b35da could not be found. Aug 04 23:20:20.893407 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': 'cd92a5bc-ef36-4c4a-a41a-d76abd2b35da'} Aug 04 23:20:20.894349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:20:20.894349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:20.894349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:20:20.894349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:20:20.894349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:20:20.894349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:20:20.894349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:20:20.894349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:20:20.894349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:20:20.894349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:20:20.894349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd92a5bc-ef36-4c4a-a41a-d76abd2b35da could not be found. Aug 04 23:20:20.894349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:20:20.894349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:20:20.894349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:20:20.894349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:20.894349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:20:20.894349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:20:20.894349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:20:20.894349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:20:20.894349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:20:20.895855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:20:20.895855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:20:20.895855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:20:20.895855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:20:20.895855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:20:20.895855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:20:20.895855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:20:20.895855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd92a5bc-ef36-4c4a-a41a-d76abd2b35da could not be found. Aug 04 23:20:20.895855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:20:20.895855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:20:20.895855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:20:20.895855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:20.895855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:20:20.895855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:20:20.895855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:20:20.895855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:20:20.895855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd92a5bc-ef36-4c4a-a41a-d76abd2b35da could not be found. Aug 04 23:20:20.895855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:20:20.897036 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-36153623-3183-49d0-bc34-306928b566b5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Returning 404 to user: Instance cd92a5bc-ef36-4c4a-a41a-d76abd2b35da could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:20:20.897036 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-36153623-3183-49d0-bc34-306928b566b5 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da" status: 404 len: 111 microversion: 2.1 time: 0.031996 Aug 04 23:20:20.897036 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 373/778] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:20 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:20:20.904812 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0c1276e7-e583-43ad-addd-0dce69590cc4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '.version_select at 0x7f6d25e62f70>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:20.929536 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0c1276e7-e583-43ad-addd-0dce69590cc4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-203967384" status: 202 len: 0 microversion: 2.1 time: 0.028350 Aug 04 23:20:20.931184 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 406/779] 10.222.0.33 () {58 vars in 1218 bytes} [Thu Aug 4 23:20:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-203967384 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:20:21.424750 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-01ee9654-5fa9-4725-a70c-ba6e69e19eaa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:21.426057 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-01ee9654-5fa9-4725-a70c-ba6e69e19eaa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:21.433558 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-01ee9654-5fa9-4725-a70c-ba6e69e19eaa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:21.434426 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-01ee9654-5fa9-4725-a70c-ba6e69e19eaa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:21.435057 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-01ee9654-5fa9-4725-a70c-ba6e69e19eaa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:21.436534 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-01ee9654-5fa9-4725-a70c-ba6e69e19eaa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:21.437067 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-01ee9654-5fa9-4725-a70c-ba6e69e19eaa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:21.438108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-01ee9654-5fa9-4725-a70c-ba6e69e19eaa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:21.550574 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-01ee9654-5fa9-4725-a70c-ba6e69e19eaa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:21.558617 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-01ee9654-5fa9-4725-a70c-ba6e69e19eaa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1210 microversion: 2.1 time: 0.141108 Aug 04 23:20:21.559884 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 374/780] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:21 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1210 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:21.611725 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-44580e96-d56a-4c5c-b0e0-d2f96583573a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Action: 'create', calling method: .version_select at 0x7f6d25e07820>, body: {"keypair": {"name": "tempest-keypair-1000550659", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqs8MQF9agT15sVhRasWhOZNnbrLUSJucYzvnk7m6hwopmKIcftsyjJp1tAvDCluN8kZyuoKG5UYta5mJrpYavHbGvkdAXoM9LWOgwQNsbp75hQ7ZNKf59zKGsF7bN0SQ=="}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:21.628700 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-44580e96-d56a-4c5c-b0e0-d2f96583573a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Getting quotas for project 0422afbb853d4ef2924edf221499971c. Resources: {'key_pairs'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:20:21.633130 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-44580e96-d56a-4c5c-b0e0-d2f96583573a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Getting quotas for user b2ceb35afcc046218bdce1ab4983d9f9 and project 0422afbb853d4ef2924edf221499971c. Resources: {'key_pairs'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:20:21.656713 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-531ea2b3-6474-48b0-93a1-03244915a443 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:21.657205 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-531ea2b3-6474-48b0-93a1-03244915a443 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:21.658406 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-44580e96-d56a-4c5c-b0e0-d2f96583573a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051225 Aug 04 23:20:21.658996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 407/781] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Aug 4 23:20:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:21.669248 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-531ea2b3-6474-48b0-93a1-03244915a443 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:21.669734 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-531ea2b3-6474-48b0-93a1-03244915a443 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:21.670171 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-531ea2b3-6474-48b0-93a1-03244915a443 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:21.670899 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-531ea2b3-6474-48b0-93a1-03244915a443 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:21.671554 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-531ea2b3-6474-48b0-93a1-03244915a443 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:21.672150 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-531ea2b3-6474-48b0-93a1-03244915a443 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:21.700446 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-531ea2b3-6474-48b0-93a1-03244915a443 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Going to try to terminate instance {{(pid=129790) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 23:20:21.796110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-531ea2b3-6474-48b0-93a1-03244915a443 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 204 len: 0 microversion: 2.1 time: 0.142532 Aug 04 23:20:21.798068 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 375/782] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:20:21 2022] DELETE /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 23:20:21.807361 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2690e1e4-d026-4575-9a31-c6b1773ee125 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:21.808171 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2690e1e4-d026-4575-9a31-c6b1773ee125 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:21.822085 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2690e1e4-d026-4575-9a31-c6b1773ee125 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:21.822773 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2690e1e4-d026-4575-9a31-c6b1773ee125 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:21.823350 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2690e1e4-d026-4575-9a31-c6b1773ee125 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:21.824241 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2690e1e4-d026-4575-9a31-c6b1773ee125 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:21.824793 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2690e1e4-d026-4575-9a31-c6b1773ee125 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:21.825370 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2690e1e4-d026-4575-9a31-c6b1773ee125 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:22.052935 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2690e1e4-d026-4575-9a31-c6b1773ee125 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:22.064815 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2690e1e4-d026-4575-9a31-c6b1773ee125 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1508 microversion: 2.1 time: 0.262105 Aug 04 23:20:22.083621 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 408/783] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:21 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1508 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:20:22.582109 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-bb879761-9e0e-4ede-8b20-6711db703cae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:22.583547 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-bb879761-9e0e-4ede-8b20-6711db703cae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:22.591956 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb879761-9e0e-4ede-8b20-6711db703cae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:22.592272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb879761-9e0e-4ede-8b20-6711db703cae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:22.592699 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb879761-9e0e-4ede-8b20-6711db703cae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:22.593628 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb879761-9e0e-4ede-8b20-6711db703cae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:22.594984 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb879761-9e0e-4ede-8b20-6711db703cae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:22.595602 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb879761-9e0e-4ede-8b20-6711db703cae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:22.838529 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-bb879761-9e0e-4ede-8b20-6711db703cae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:22.849261 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-bb879761-9e0e-4ede-8b20-6711db703cae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1266 microversion: 2.1 time: 0.272466 Aug 04 23:20:22.850431 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 376/784] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:22 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:23.089545 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-256ae42f-596f-4b6b-8e82-30b24ebb9e56 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:23.090242 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-256ae42f-596f-4b6b-8e82-30b24ebb9e56 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:23.099914 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-256ae42f-596f-4b6b-8e82-30b24ebb9e56 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:23.102422 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-256ae42f-596f-4b6b-8e82-30b24ebb9e56 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:23.103096 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-256ae42f-596f-4b6b-8e82-30b24ebb9e56 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:23.103998 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-256ae42f-596f-4b6b-8e82-30b24ebb9e56 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:23.104471 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-256ae42f-596f-4b6b-8e82-30b24ebb9e56 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:23.104899 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-256ae42f-596f-4b6b-8e82-30b24ebb9e56 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:23.284239 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-0520b8c9-c050-4bb9-ad2b-9465c5f95db6 req-4f92aabd-6e83-4479-ac1c-0eca32611911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee044da9-1338-4d15-a87d-7fcc18f8354a", "tag": "bb606376-a4bc-447a-9437-537ad4e184ad"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:23.296334 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-0520b8c9-c050-4bb9-ad2b-9465c5f95db6 req-4f92aabd-6e83-4479-ac1c-0eca32611911 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:23.297308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-0520b8c9-c050-4bb9-ad2b-9465c5f95db6 req-4f92aabd-6e83-4479-ac1c-0eca32611911 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:23.298164 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-0520b8c9-c050-4bb9-ad2b-9465c5f95db6 req-4f92aabd-6e83-4479-ac1c-0eca32611911 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:23.314647 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-0520b8c9-c050-4bb9-ad2b-9465c5f95db6 req-4f92aabd-6e83-4479-ac1c-0eca32611911 service nova] Creating event network-changed:bb606376-a4bc-447a-9437-537ad4e184ad for instance ee044da9-1338-4d15-a87d-7fcc18f8354a on hv-cinder-85221 Aug 04 23:20:23.320668 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-0520b8c9-c050-4bb9-ad2b-9465c5f95db6 req-4f92aabd-6e83-4479-ac1c-0eca32611911 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041713 Aug 04 23:20:23.321839 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 377/785] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:20:23.325220 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-256ae42f-596f-4b6b-8e82-30b24ebb9e56 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:23.337184 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-394d2085-43aa-4e37-ac45-5e7aceccbc57 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-881021473", "imageRef": "e1e9d70e-b252-44e5-9ecd-bf73cbf00160", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df517527-9f13-4f5f-b34b-4a2b6e5d80c8"}], "security_groups": [{"name": "tempest-securitygroup--613875288"}], "key_name": "tempest-keypair-1000550659", "user_data": "}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:23.339320 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-256ae42f-596f-4b6b-8e82-30b24ebb9e56 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1508 microversion: 2.1 time: 0.253897 Aug 04 23:20:23.352468 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 409/786] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:23 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1508 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:23.445662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.network.neutron [None req-394d2085-43aa-4e37-ac45-5e7aceccbc57 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] validate_networks() for [('df517527-9f13-4f5f-b34b-4a2b6e5d80c8', None, None, None, None, None)] {{(pid=129790) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 23:20:23.873251 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6973834b-8ed3-4cbb-b8c9-9b00e2622b2f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:23.875756 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6973834b-8ed3-4cbb-b8c9-9b00e2622b2f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:23.885785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6973834b-8ed3-4cbb-b8c9-9b00e2622b2f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:23.887724 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6973834b-8ed3-4cbb-b8c9-9b00e2622b2f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:23.888844 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6973834b-8ed3-4cbb-b8c9-9b00e2622b2f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:23.889854 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6973834b-8ed3-4cbb-b8c9-9b00e2622b2f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:23.890582 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6973834b-8ed3-4cbb-b8c9-9b00e2622b2f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:23.891165 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6973834b-8ed3-4cbb-b8c9-9b00e2622b2f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:24.115706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6973834b-8ed3-4cbb-b8c9-9b00e2622b2f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:24.124353 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6973834b-8ed3-4cbb-b8c9-9b00e2622b2f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1266 microversion: 2.1 time: 0.254943 Aug 04 23:20:24.125692 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 410/787] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:23 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:20:24.217699 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-394d2085-43aa-4e37-ac45-5e7aceccbc57 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Flavor limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 23:20:24.218241 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-394d2085-43aa-4e37-ac45-5e7aceccbc57 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Image limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 23:20:24.218634 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-394d2085-43aa-4e37-ac45-5e7aceccbc57 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Flavor pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 23:20:24.219119 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-394d2085-43aa-4e37-ac45-5e7aceccbc57 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Image pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 23:20:24.219546 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-394d2085-43aa-4e37-ac45-5e7aceccbc57 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 23:20:24.232006 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-394d2085-43aa-4e37-ac45-5e7aceccbc57 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:24.232490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-394d2085-43aa-4e37-ac45-5e7aceccbc57 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:24.232929 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-394d2085-43aa-4e37-ac45-5e7aceccbc57 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:24.233696 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-394d2085-43aa-4e37-ac45-5e7aceccbc57 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:24.234691 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-394d2085-43aa-4e37-ac45-5e7aceccbc57 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:24.235609 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-394d2085-43aa-4e37-ac45-5e7aceccbc57 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:24.253761 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-394d2085-43aa-4e37-ac45-5e7aceccbc57 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Getting quotas for project 0422afbb853d4ef2924edf221499971c. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:20:24.257667 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-394d2085-43aa-4e37-ac45-5e7aceccbc57 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Getting quotas for user b2ceb35afcc046218bdce1ab4983d9f9 and project 0422afbb853d4ef2924edf221499971c. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:20:24.266913 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:20:24.269735 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-394d2085-43aa-4e37-ac45-5e7aceccbc57 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Going to run 1 instances... {{(pid=129790) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 23:20:24.272392 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-394d2085-43aa-4e37-ac45-5e7aceccbc57 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1e9d70e-b252-44e5-9ecd-bf73cbf00160',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129790) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 23:20:24.320703 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-394d2085-43aa-4e37-ac45-5e7aceccbc57 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.988147 Aug 04 23:20:24.321443 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 378/788] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Aug 4 23:20:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 23:20:24.332282 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fd376b5c-c770-46c4-bfcb-0114bd91a5b0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:24.332986 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-fd376b5c-c770-46c4-bfcb-0114bd91a5b0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:24.364105 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b0136253-e4f3-492a-8f4b-f7447b58c31e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:24.364859 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b0136253-e4f3-492a-8f4b-f7447b58c31e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:24.371523 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0136253-e4f3-492a-8f4b-f7447b58c31e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:24.372170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0136253-e4f3-492a-8f4b-f7447b58c31e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:24.372744 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0136253-e4f3-492a-8f4b-f7447b58c31e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:24.373546 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0136253-e4f3-492a-8f4b-f7447b58c31e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:24.374261 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0136253-e4f3-492a-8f4b-f7447b58c31e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:24.374947 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0136253-e4f3-492a-8f4b-f7447b58c31e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:24.388539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fd376b5c-c770-46c4-bfcb-0114bd91a5b0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:24.395976 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-fd376b5c-c770-46c4-bfcb-0114bd91a5b0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3" status: 200 len: 1241 microversion: 2.1 time: 0.067649 Aug 04 23:20:24.396623 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 411/789] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:24 2022] GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:24.410640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0136253-e4f3-492a-8f4b-f7447b58c31e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:24.411122 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0136253-e4f3-492a-8f4b-f7447b58c31e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:24.411553 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0136253-e4f3-492a-8f4b-f7447b58c31e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:24.411993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.objects.instance [None req-b0136253-e4f3-492a-8f4b-f7447b58c31e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lazy-loading 'fault' on Instance uuid 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 {{(pid=129790) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:20:24.461024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b0136253-e4f3-492a-8f4b-f7447b58c31e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:24.470469 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b0136253-e4f3-492a-8f4b-f7447b58c31e tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 200 len: 1312 microversion: 2.1 time: 0.109357 Aug 04 23:20:24.471142 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 379/790] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:24 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 1312 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:25.147251 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e7be5e5c-c797-4e8f-a72f-c27abe7a968b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:25.147856 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e7be5e5c-c797-4e8f-a72f-c27abe7a968b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:25.161603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e7be5e5c-c797-4e8f-a72f-c27abe7a968b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:25.162089 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e7be5e5c-c797-4e8f-a72f-c27abe7a968b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:25.162551 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e7be5e5c-c797-4e8f-a72f-c27abe7a968b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:25.163287 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e7be5e5c-c797-4e8f-a72f-c27abe7a968b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:25.163709 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e7be5e5c-c797-4e8f-a72f-c27abe7a968b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:25.164230 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e7be5e5c-c797-4e8f-a72f-c27abe7a968b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:25.348780 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e7be5e5c-c797-4e8f-a72f-c27abe7a968b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:25.356894 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e7be5e5c-c797-4e8f-a72f-c27abe7a968b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1266 microversion: 2.1 time: 0.212925 Aug 04 23:20:25.357464 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 412/791] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:25 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:25.366330 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-0a9e1ecb-0d03-4959-b72d-c62c980e72c3 req-26b8a29c-2752-45bb-a513-0370633eedb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cd10c30-2a58-4afa-b3c3-2da74e98b7d9", "name": "network-vif-deleted", "tag": "f0661d6e-dd49-44fb-9a40-a031958d1e11"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:25.378595 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-0a9e1ecb-0d03-4959-b72d-c62c980e72c3 req-26b8a29c-2752-45bb-a513-0370633eedb6 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:25.379332 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-0a9e1ecb-0d03-4959-b72d-c62c980e72c3 req-26b8a29c-2752-45bb-a513-0370633eedb6 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:25.380033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-0a9e1ecb-0d03-4959-b72d-c62c980e72c3 req-26b8a29c-2752-45bb-a513-0370633eedb6 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:25.392640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-0a9e1ecb-0d03-4959-b72d-c62c980e72c3 req-26b8a29c-2752-45bb-a513-0370633eedb6 service nova] Creating event network-vif-deleted:f0661d6e-dd49-44fb-9a40-a031958d1e11 for instance 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 on hv-cinder-85221 Aug 04 23:20:25.399726 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-0a9e1ecb-0d03-4959-b72d-c62c980e72c3 req-26b8a29c-2752-45bb-a513-0370633eedb6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037687 Aug 04 23:20:25.400330 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 380/792] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:25.416953 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8bd26208-03d1-47b6-a27c-c6282e6a737b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:25.417691 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8bd26208-03d1-47b6-a27c-c6282e6a737b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:25.425594 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8bd26208-03d1-47b6-a27c-c6282e6a737b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:25.426071 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8bd26208-03d1-47b6-a27c-c6282e6a737b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:25.426520 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8bd26208-03d1-47b6-a27c-c6282e6a737b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:25.427209 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8bd26208-03d1-47b6-a27c-c6282e6a737b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:25.427648 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8bd26208-03d1-47b6-a27c-c6282e6a737b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:25.428063 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8bd26208-03d1-47b6-a27c-c6282e6a737b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:25.492742 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d79ebaa2-7b22-4c57-9f7a-5e379458f800 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:25.493466 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d79ebaa2-7b22-4c57-9f7a-5e379458f800 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:25.493755 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8bd26208-03d1-47b6-a27c-c6282e6a737b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:25.500458 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d79ebaa2-7b22-4c57-9f7a-5e379458f800 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:25.501131 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d79ebaa2-7b22-4c57-9f7a-5e379458f800 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:25.501519 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d79ebaa2-7b22-4c57-9f7a-5e379458f800 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:25.501870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8bd26208-03d1-47b6-a27c-c6282e6a737b tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3" status: 200 len: 1293 microversion: 2.1 time: 0.089051 Aug 04 23:20:25.502215 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d79ebaa2-7b22-4c57-9f7a-5e379458f800 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:25.502629 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 413/793] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:25 2022] GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:25.505454 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d79ebaa2-7b22-4c57-9f7a-5e379458f800 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:25.506051 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d79ebaa2-7b22-4c57-9f7a-5e379458f800 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:25.520978 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-d79ebaa2-7b22-4c57-9f7a-5e379458f800 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] HTTP exception thrown: Instance 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 could not be found. Aug 04 23:20:25.522660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d79ebaa2-7b22-4c57-9f7a-5e379458f800 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Request method failure captured: Aug 04 23:20:25.522660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 HTTP/1.1 Aug 04 23:20:25.522660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:20:25.522660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:20:25.522660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:20:25.522660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:20:25.522660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:20:25.522660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:20:25.522660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:20:25.522660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:20:25.522660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FJ6RKYMdfsISiTgYEMvks0x5d50WB4Vbj1WQgE1v6AQbUxoUYQTrWgb9IvdiKRoAPbIyfnSaCOdg5gEaB9t_gZ5C6HO6cjgM58wzr3Oq1EOqCSLuKxKWCkjyonkLQBDSxbLmeiJH_Z9CWvDApSZl7vw3VKIMJPpD2CVXPZhXNad-G8 Aug 04 23:20:25.522660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:20:25.522660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:20:25.522660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:20:25.522660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:20:25.522660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:20:25.522660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:20:25.522660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: f50215d0b0ec4a109e14979c183a52a3 Aug 04 23:20:25.522660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-475500057 Aug 04 23:20:25.522660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:20:25.522660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:20:25.524243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f50215d0b0ec4a109e14979c183a52a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f50215d0b0ec4a109e14979c183a52a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f50215d0b0ec4a109e14979c183a52a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f50215d0b0ec4a109e14979c183a52a3"}]}] Aug 04 23:20:25.524243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-ServerRescueNegativeTestJSON-475500057 Aug 04 23:20:25.524243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: f50215d0b0ec4a109e14979c183a52a3 Aug 04 23:20:25.524243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-475500057 Aug 04 23:20:25.524243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-ServerRescueNegativeTestJSON-475500057-project Aug 04 23:20:25.524243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:20:25.524243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:20:25.524243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: 51af2dbb470849a4a044f6f78eef2d45 Aug 04 23:20:25.524243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-ServerRescueNegativeTestJSON-475500057-project Aug 04 23:20:25.524243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:20:25.524243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Instance 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 could not be found. Aug 04 23:20:25.524243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': '2cd10c30-2a58-4afa-b3c3-2da74e98b7d9'} Aug 04 23:20:25.525110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:20:25.525110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:25.525110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:20:25.525110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:20:25.525110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:20:25.525110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:20:25.525110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:20:25.525110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:20:25.525110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:20:25.525110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:20:25.525110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 could not be found. Aug 04 23:20:25.525110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:20:25.525110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:20:25.525110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:20:25.525110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:25.525110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:20:25.525110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:20:25.525110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:20:25.525110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:20:25.525110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:20:25.526616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:20:25.526616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:20:25.526616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:20:25.526616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:20:25.526616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:20:25.526616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:20:25.526616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:20:25.526616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 could not be found. Aug 04 23:20:25.526616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:20:25.526616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:20:25.526616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:20:25.526616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:25.526616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:20:25.526616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:20:25.526616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:20:25.526616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:20:25.526616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 could not be found. Aug 04 23:20:25.526616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:20:25.527995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d79ebaa2-7b22-4c57-9f7a-5e379458f800 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Returning 404 to user: Instance 2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:20:25.527995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d79ebaa2-7b22-4c57-9f7a-5e379458f800 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9" status: 404 len: 111 microversion: 2.1 time: 0.035849 Aug 04 23:20:25.527995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 381/794] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:25 2022] GET /compute/v2.1/servers/2cd10c30-2a58-4afa-b3c3-2da74e98b7d9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:20:25.533895 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-65effceb-e9a9-42f8-9c89-0d6d446b13b6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:25.534810 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-65effceb-e9a9-42f8-9c89-0d6d446b13b6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:25.541691 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-65effceb-e9a9-42f8-9c89-0d6d446b13b6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:25.542207 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-65effceb-e9a9-42f8-9c89-0d6d446b13b6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:25.542677 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-65effceb-e9a9-42f8-9c89-0d6d446b13b6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:25.543397 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-65effceb-e9a9-42f8-9c89-0d6d446b13b6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:25.543835 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-65effceb-e9a9-42f8-9c89-0d6d446b13b6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:25.544259 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-65effceb-e9a9-42f8-9c89-0d6d446b13b6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:25.570040 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-65effceb-e9a9-42f8-9c89-0d6d446b13b6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Going to try to terminate instance {{(pid=129791) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 23:20:25.648490 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-65effceb-e9a9-42f8-9c89-0d6d446b13b6 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 204 len: 0 microversion: 2.1 time: 0.119379 Aug 04 23:20:25.649277 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 414/795] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:20:25 2022] DELETE /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 23:20:25.659235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-48c69fab-8085-4328-b9b8-61362db945b4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:25.659919 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-48c69fab-8085-4328-b9b8-61362db945b4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:25.667068 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48c69fab-8085-4328-b9b8-61362db945b4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:25.668001 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48c69fab-8085-4328-b9b8-61362db945b4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:25.668664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48c69fab-8085-4328-b9b8-61362db945b4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:25.669578 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48c69fab-8085-4328-b9b8-61362db945b4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:25.670116 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48c69fab-8085-4328-b9b8-61362db945b4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:25.670647 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48c69fab-8085-4328-b9b8-61362db945b4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:25.821347 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-48c69fab-8085-4328-b9b8-61362db945b4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:25.829458 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-48c69fab-8085-4328-b9b8-61362db945b4 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1523 microversion: 2.1 time: 0.175191 Aug 04 23:20:25.830030 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 382/796] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:25 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:26.381333 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c5a13253-dcdd-4f6f-a28d-280841eaccdf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:26.382330 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c5a13253-dcdd-4f6f-a28d-280841eaccdf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:26.388844 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c5a13253-dcdd-4f6f-a28d-280841eaccdf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:26.389395 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c5a13253-dcdd-4f6f-a28d-280841eaccdf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:26.389892 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c5a13253-dcdd-4f6f-a28d-280841eaccdf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:26.391194 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c5a13253-dcdd-4f6f-a28d-280841eaccdf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:26.391898 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c5a13253-dcdd-4f6f-a28d-280841eaccdf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:26.392497 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c5a13253-dcdd-4f6f-a28d-280841eaccdf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:26.524044 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f64de2a5-e8a4-44b0-bcbc-679f33962cb8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:26.525168 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f64de2a5-e8a4-44b0-bcbc-679f33962cb8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:26.532879 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f64de2a5-e8a4-44b0-bcbc-679f33962cb8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:26.533548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f64de2a5-e8a4-44b0-bcbc-679f33962cb8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:26.534093 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f64de2a5-e8a4-44b0-bcbc-679f33962cb8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:26.534924 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f64de2a5-e8a4-44b0-bcbc-679f33962cb8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:26.535699 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f64de2a5-e8a4-44b0-bcbc-679f33962cb8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:26.536358 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f64de2a5-e8a4-44b0-bcbc-679f33962cb8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:26.595721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c5a13253-dcdd-4f6f-a28d-280841eaccdf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:26.603369 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c5a13253-dcdd-4f6f-a28d-280841eaccdf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1266 microversion: 2.1 time: 0.227178 Aug 04 23:20:26.603931 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 415/797] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:26 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:26.611545 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f64de2a5-e8a4-44b0-bcbc-679f33962cb8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:26.615812 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:20:26.621157 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f64de2a5-e8a4-44b0-bcbc-679f33962cb8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3" status: 200 len: 1299 microversion: 2.1 time: 0.102324 Aug 04 23:20:26.621761 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 383/798] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:26 2022] GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 => generated 1299 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:20:26.851717 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-81b7e112-132e-4abb-afbb-09a216e16153 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:26.852329 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-81b7e112-132e-4abb-afbb-09a216e16153 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:26.858457 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-81b7e112-132e-4abb-afbb-09a216e16153 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:26.858941 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-81b7e112-132e-4abb-afbb-09a216e16153 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:26.860617 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-81b7e112-132e-4abb-afbb-09a216e16153 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:26.861336 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-81b7e112-132e-4abb-afbb-09a216e16153 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:26.861861 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-81b7e112-132e-4abb-afbb-09a216e16153 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:26.862203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-81b7e112-132e-4abb-afbb-09a216e16153 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:27.003914 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-81b7e112-132e-4abb-afbb-09a216e16153 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:27.011729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-81b7e112-132e-4abb-afbb-09a216e16153 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1523 microversion: 2.1 time: 0.163797 Aug 04 23:20:27.012302 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 416/799] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:26 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:27.626642 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8c4d7781-9a6e-4edc-815b-6c2685e6784f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:27.628054 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8c4d7781-9a6e-4edc-815b-6c2685e6784f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:27.636881 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c4d7781-9a6e-4edc-815b-6c2685e6784f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:27.637366 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c4d7781-9a6e-4edc-815b-6c2685e6784f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:27.637842 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c4d7781-9a6e-4edc-815b-6c2685e6784f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:27.638539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c4d7781-9a6e-4edc-815b-6c2685e6784f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:27.638987 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c4d7781-9a6e-4edc-815b-6c2685e6784f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:27.639407 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c4d7781-9a6e-4edc-815b-6c2685e6784f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:27.645716 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-23f43e79-d1a4-4168-a683-06ece40e373d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:27.647324 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-23f43e79-d1a4-4168-a683-06ece40e373d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:27.651772 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:20:27.658463 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23f43e79-d1a4-4168-a683-06ece40e373d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:27.659102 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23f43e79-d1a4-4168-a683-06ece40e373d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:27.659639 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23f43e79-d1a4-4168-a683-06ece40e373d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:27.660634 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23f43e79-d1a4-4168-a683-06ece40e373d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:27.661499 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23f43e79-d1a4-4168-a683-06ece40e373d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:27.662508 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23f43e79-d1a4-4168-a683-06ece40e373d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:27.780857 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-23f43e79-d1a4-4168-a683-06ece40e373d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:27.789193 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-23f43e79-d1a4-4168-a683-06ece40e373d tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3" status: 200 len: 1299 microversion: 2.1 time: 0.149659 Aug 04 23:20:27.790123 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 417/800] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:27 2022] GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 => generated 1299 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:20:27.815845 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-6ab20f1b-2b7a-47c2-8b2e-591256504f1f req-ca7993d5-3bc5-449f-9c6c-aea9f6f1aaf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b9e29c3-d35b-4e35-90fb-6184265d0ecf", "name": "network-vif-deleted", "tag": "a99ad26c-475b-45a9-a064-2c729edd77f1"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:27.826998 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-6ab20f1b-2b7a-47c2-8b2e-591256504f1f req-ca7993d5-3bc5-449f-9c6c-aea9f6f1aaf5 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:27.827744 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-6ab20f1b-2b7a-47c2-8b2e-591256504f1f req-ca7993d5-3bc5-449f-9c6c-aea9f6f1aaf5 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:27.828789 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-6ab20f1b-2b7a-47c2-8b2e-591256504f1f req-ca7993d5-3bc5-449f-9c6c-aea9f6f1aaf5 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:27.846910 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-6ab20f1b-2b7a-47c2-8b2e-591256504f1f req-ca7993d5-3bc5-449f-9c6c-aea9f6f1aaf5 service nova] Creating event network-vif-deleted:a99ad26c-475b-45a9-a064-2c729edd77f1 for instance 9b9e29c3-d35b-4e35-90fb-6184265d0ecf on hv-cinder-85221 Aug 04 23:20:27.852176 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-6ab20f1b-2b7a-47c2-8b2e-591256504f1f req-ca7993d5-3bc5-449f-9c6c-aea9f6f1aaf5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046430 Aug 04 23:20:27.853106 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 418/801] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:20:27.861502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8c4d7781-9a6e-4edc-815b-6c2685e6784f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:27.872339 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8c4d7781-9a6e-4edc-815b-6c2685e6784f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1266 microversion: 2.1 time: 0.250712 Aug 04 23:20:27.873159 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 384/802] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:27 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:28.034740 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ce5dfbb8-e58f-4cf9-b5e6-201c0f418736 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:28.035733 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ce5dfbb8-e58f-4cf9-b5e6-201c0f418736 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:28.042312 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce5dfbb8-e58f-4cf9-b5e6-201c0f418736 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:28.043085 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce5dfbb8-e58f-4cf9-b5e6-201c0f418736 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:28.043525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce5dfbb8-e58f-4cf9-b5e6-201c0f418736 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:28.044239 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce5dfbb8-e58f-4cf9-b5e6-201c0f418736 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:28.044696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce5dfbb8-e58f-4cf9-b5e6-201c0f418736 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:28.045126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce5dfbb8-e58f-4cf9-b5e6-201c0f418736 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:28.083675 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce5dfbb8-e58f-4cf9-b5e6-201c0f418736 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:28.084156 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce5dfbb8-e58f-4cf9-b5e6-201c0f418736 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:28.084585 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce5dfbb8-e58f-4cf9-b5e6-201c0f418736 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:28.085031 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.objects.instance [None req-ce5dfbb8-e58f-4cf9-b5e6-201c0f418736 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lazy-loading 'fault' on Instance uuid 9b9e29c3-d35b-4e35-90fb-6184265d0ecf {{(pid=129791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:20:28.136115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ce5dfbb8-e58f-4cf9-b5e6-201c0f418736 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51af2dbb470849a4a044f6f78eef2d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50215d0b0ec4a109e14979c183a52a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:28.142427 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:20:28.153725 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ce5dfbb8-e58f-4cf9-b5e6-201c0f418736 tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 200 len: 1312 microversion: 2.1 time: 0.123753 Aug 04 23:20:28.154868 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 419/803] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:28 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 1312 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:28.810125 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-aa93ec0c-e6a5-4b8c-aa87-88b074e73fad tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:28.811094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-aa93ec0c-e6a5-4b8c-aa87-88b074e73fad tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:28.818216 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa93ec0c-e6a5-4b8c-aa87-88b074e73fad tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:28.819004 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa93ec0c-e6a5-4b8c-aa87-88b074e73fad tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:28.819633 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa93ec0c-e6a5-4b8c-aa87-88b074e73fad tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:28.820718 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa93ec0c-e6a5-4b8c-aa87-88b074e73fad tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:28.821186 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa93ec0c-e6a5-4b8c-aa87-88b074e73fad tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:28.821737 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa93ec0c-e6a5-4b8c-aa87-88b074e73fad tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:28.897325 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fcfab4d2-a992-445e-96b2-6d5d137e0f5f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:28.898945 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-fcfab4d2-a992-445e-96b2-6d5d137e0f5f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:28.906775 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fcfab4d2-a992-445e-96b2-6d5d137e0f5f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:28.907308 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fcfab4d2-a992-445e-96b2-6d5d137e0f5f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:28.907739 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fcfab4d2-a992-445e-96b2-6d5d137e0f5f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:28.908586 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fcfab4d2-a992-445e-96b2-6d5d137e0f5f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:28.909044 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fcfab4d2-a992-445e-96b2-6d5d137e0f5f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:28.909463 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fcfab4d2-a992-445e-96b2-6d5d137e0f5f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:29.015624 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-aa93ec0c-e6a5-4b8c-aa87-88b074e73fad tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:29.024242 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-aa93ec0c-e6a5-4b8c-aa87-88b074e73fad tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3" status: 200 len: 1366 microversion: 2.1 time: 0.217942 Aug 04 23:20:29.024791 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 385/804] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:28 2022] GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:29.083287 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fcfab4d2-a992-445e-96b2-6d5d137e0f5f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:29.092863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-fcfab4d2-a992-445e-96b2-6d5d137e0f5f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1266 microversion: 2.1 time: 0.200930 Aug 04 23:20:29.093566 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 420/805] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:28 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:20:29.176292 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-016f1afb-a5db-4d0e-ab7f-193e8a6657fb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:29.177134 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-016f1afb-a5db-4d0e-ab7f-193e8a6657fb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] [instance: 9b9e29c3-d35b-4e35-90fb-6184265d0ecf] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:29.183505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-016f1afb-a5db-4d0e-ab7f-193e8a6657fb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:29.184000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-016f1afb-a5db-4d0e-ab7f-193e8a6657fb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:29.184442 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-016f1afb-a5db-4d0e-ab7f-193e8a6657fb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:29.185170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-016f1afb-a5db-4d0e-ab7f-193e8a6657fb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:29.185632 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-016f1afb-a5db-4d0e-ab7f-193e8a6657fb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:29.186058 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-016f1afb-a5db-4d0e-ab7f-193e8a6657fb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:29.202608 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-016f1afb-a5db-4d0e-ab7f-193e8a6657fb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] HTTP exception thrown: Instance 9b9e29c3-d35b-4e35-90fb-6184265d0ecf could not be found. Aug 04 23:20:29.204892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-016f1afb-a5db-4d0e-ab7f-193e8a6657fb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Request method failure captured: Aug 04 23:20:29.204892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf HTTP/1.1 Aug 04 23:20:29.204892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:20:29.204892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:20:29.204892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:20:29.204892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:20:29.204892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:20:29.204892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:20:29.204892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:20:29.204892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:20:29.204892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FJ6RKYMdfsISiTgYEMvks0x5d50WB4Vbj1WQgE1v6AQbUxoUYQTrWgb9IvdiKRoAPbIyfnSaCOdg5gEaB9t_gZ5C6HO6cjgM58wzr3Oq1EOqCSLuKxKWCkjyonkLQBDSxbLmeiJH_Z9CWvDApSZl7vw3VKIMJPpD2CVXPZhXNad-G8 Aug 04 23:20:29.204892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:20:29.204892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:20:29.204892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:20:29.204892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:20:29.204892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:20:29.204892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:20:29.204892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: f50215d0b0ec4a109e14979c183a52a3 Aug 04 23:20:29.204892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-475500057 Aug 04 23:20:29.204892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:20:29.204892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:20:29.207034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f50215d0b0ec4a109e14979c183a52a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f50215d0b0ec4a109e14979c183a52a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f50215d0b0ec4a109e14979c183a52a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f50215d0b0ec4a109e14979c183a52a3"}]}] Aug 04 23:20:29.207034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-ServerRescueNegativeTestJSON-475500057 Aug 04 23:20:29.207034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: f50215d0b0ec4a109e14979c183a52a3 Aug 04 23:20:29.207034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-475500057 Aug 04 23:20:29.207034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-ServerRescueNegativeTestJSON-475500057-project Aug 04 23:20:29.207034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:20:29.207034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:20:29.207034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: 51af2dbb470849a4a044f6f78eef2d45 Aug 04 23:20:29.207034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-ServerRescueNegativeTestJSON-475500057-project Aug 04 23:20:29.207034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:20:29.207034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Instance 9b9e29c3-d35b-4e35-90fb-6184265d0ecf could not be found. Aug 04 23:20:29.207034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': '9b9e29c3-d35b-4e35-90fb-6184265d0ecf'} Aug 04 23:20:29.207963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:20:29.207963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:29.207963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:20:29.207963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:20:29.207963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:20:29.207963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:20:29.207963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:20:29.207963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:20:29.207963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:20:29.207963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:20:29.207963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b9e29c3-d35b-4e35-90fb-6184265d0ecf could not be found. Aug 04 23:20:29.207963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:20:29.207963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:20:29.207963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:20:29.207963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:29.207963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:20:29.207963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:20:29.207963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:20:29.207963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:20:29.207963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:20:29.210386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:20:29.210386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:20:29.210386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:20:29.210386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:20:29.210386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:20:29.210386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:20:29.210386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:20:29.210386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b9e29c3-d35b-4e35-90fb-6184265d0ecf could not be found. Aug 04 23:20:29.210386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:20:29.210386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:20:29.210386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:20:29.210386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:29.210386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:20:29.210386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:20:29.210386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:20:29.210386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:20:29.210386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b9e29c3-d35b-4e35-90fb-6184265d0ecf could not be found. Aug 04 23:20:29.210386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:20:29.211936 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-016f1afb-a5db-4d0e-ab7f-193e8a6657fb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] Returning 404 to user: Instance 9b9e29c3-d35b-4e35-90fb-6184265d0ecf could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:20:29.211936 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-016f1afb-a5db-4d0e-ab7f-193e8a6657fb tempest-ServerRescueNegativeTestJSON-475500057 tempest-ServerRescueNegativeTestJSON-475500057-project] 10.222.0.33 "GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf" status: 404 len: 111 microversion: 2.1 time: 0.033917 Aug 04 23:20:29.211936 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 386/806] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:29 2022] GET /compute/v2.1/servers/9b9e29c3-d35b-4e35-90fb-6184265d0ecf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:20:29.885605 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-d0e10207-850a-44a6-8939-ba650431aa58 req-99077745-74a0-496a-b76d-a4ee6a93d456 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3", "tag": "69a97291-effb-47b6-bee6-f324bb5f636f"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:29.895972 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-d0e10207-850a-44a6-8939-ba650431aa58 req-99077745-74a0-496a-b76d-a4ee6a93d456 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:29.896222 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-d0e10207-850a-44a6-8939-ba650431aa58 req-99077745-74a0-496a-b76d-a4ee6a93d456 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:29.896621 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-d0e10207-850a-44a6-8939-ba650431aa58 req-99077745-74a0-496a-b76d-a4ee6a93d456 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:29.909117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-d0e10207-850a-44a6-8939-ba650431aa58 req-99077745-74a0-496a-b76d-a4ee6a93d456 service nova] Creating event network-changed:69a97291-effb-47b6-bee6-f324bb5f636f for instance 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 on hv-cinder-85221 Aug 04 23:20:29.914014 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-d0e10207-850a-44a6-8939-ba650431aa58 req-99077745-74a0-496a-b76d-a4ee6a93d456 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032104 Aug 04 23:20:29.914660 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 421/807] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:30.046250 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1c29ed5f-81a6-4e9f-bbb6-c44e4dd21c10 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:30.047709 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1c29ed5f-81a6-4e9f-bbb6-c44e4dd21c10 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:30.054216 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c29ed5f-81a6-4e9f-bbb6-c44e4dd21c10 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:30.054778 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c29ed5f-81a6-4e9f-bbb6-c44e4dd21c10 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:30.055208 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c29ed5f-81a6-4e9f-bbb6-c44e4dd21c10 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:30.055909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c29ed5f-81a6-4e9f-bbb6-c44e4dd21c10 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:30.056353 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c29ed5f-81a6-4e9f-bbb6-c44e4dd21c10 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:30.058967 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c29ed5f-81a6-4e9f-bbb6-c44e4dd21c10 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:30.115719 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b45e8c8b-c4cc-415e-aa59-121a62a2de14 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:30.116453 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b45e8c8b-c4cc-415e-aa59-121a62a2de14 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:30.122880 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b45e8c8b-c4cc-415e-aa59-121a62a2de14 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:30.123367 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b45e8c8b-c4cc-415e-aa59-121a62a2de14 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:30.123799 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b45e8c8b-c4cc-415e-aa59-121a62a2de14 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:30.124495 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b45e8c8b-c4cc-415e-aa59-121a62a2de14 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:30.125536 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b45e8c8b-c4cc-415e-aa59-121a62a2de14 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:30.125955 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b45e8c8b-c4cc-415e-aa59-121a62a2de14 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:30.348848 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1c29ed5f-81a6-4e9f-bbb6-c44e4dd21c10 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:30.356560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1c29ed5f-81a6-4e9f-bbb6-c44e4dd21c10 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3" status: 200 len: 1366 microversion: 2.1 time: 0.314079 Aug 04 23:20:30.357126 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 387/808] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:30 2022] GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:30.397682 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b45e8c8b-c4cc-415e-aa59-121a62a2de14 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:30.405787 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b45e8c8b-c4cc-415e-aa59-121a62a2de14 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1266 microversion: 2.1 time: 0.294163 Aug 04 23:20:30.407084 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 422/809] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:30 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:31.378450 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-17471304-ceeb-4fc8-9752-027582ff3a38 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:31.379229 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-17471304-ceeb-4fc8-9752-027582ff3a38 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:31.385790 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17471304-ceeb-4fc8-9752-027582ff3a38 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:31.386380 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17471304-ceeb-4fc8-9752-027582ff3a38 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:31.387073 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17471304-ceeb-4fc8-9752-027582ff3a38 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:31.388022 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17471304-ceeb-4fc8-9752-027582ff3a38 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:31.388550 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17471304-ceeb-4fc8-9752-027582ff3a38 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:31.389036 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17471304-ceeb-4fc8-9752-027582ff3a38 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:31.429268 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-af72431d-b2bc-4a0c-b669-a237c62903ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:31.429892 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-af72431d-b2bc-4a0c-b669-a237c62903ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:31.436597 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af72431d-b2bc-4a0c-b669-a237c62903ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:31.437117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af72431d-b2bc-4a0c-b669-a237c62903ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:31.437551 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af72431d-b2bc-4a0c-b669-a237c62903ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:31.438842 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af72431d-b2bc-4a0c-b669-a237c62903ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:31.439503 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af72431d-b2bc-4a0c-b669-a237c62903ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:31.439928 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af72431d-b2bc-4a0c-b669-a237c62903ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:31.637456 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-17471304-ceeb-4fc8-9752-027582ff3a38 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:31.648355 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-17471304-ceeb-4fc8-9752-027582ff3a38 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3" status: 200 len: 1366 microversion: 2.1 time: 0.274639 Aug 04 23:20:31.649148 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 388/810] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:31 2022] GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:31.723514 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-af72431d-b2bc-4a0c-b669-a237c62903ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:31.733201 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-af72431d-b2bc-4a0c-b669-a237c62903ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1266 microversion: 2.1 time: 0.308047 Aug 04 23:20:31.733798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 423/811] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:31 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:32.672464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5e875fbf-0376-4974-ad90-209b66b2da0c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:32.673092 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5e875fbf-0376-4974-ad90-209b66b2da0c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:32.680540 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e875fbf-0376-4974-ad90-209b66b2da0c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:32.681317 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e875fbf-0376-4974-ad90-209b66b2da0c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:32.681921 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e875fbf-0376-4974-ad90-209b66b2da0c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:32.682885 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e875fbf-0376-4974-ad90-209b66b2da0c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:32.683494 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e875fbf-0376-4974-ad90-209b66b2da0c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:32.684112 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e875fbf-0376-4974-ad90-209b66b2da0c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:32.755331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4f92762c-5805-4941-9db1-c25985f169f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:32.756739 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4f92762c-5805-4941-9db1-c25985f169f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:32.768527 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f92762c-5805-4941-9db1-c25985f169f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:32.769284 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f92762c-5805-4941-9db1-c25985f169f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:32.769719 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f92762c-5805-4941-9db1-c25985f169f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:32.770664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f92762c-5805-4941-9db1-c25985f169f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:32.771117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f92762c-5805-4941-9db1-c25985f169f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:32.771712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f92762c-5805-4941-9db1-c25985f169f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:32.946308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5e875fbf-0376-4974-ad90-209b66b2da0c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:32.955930 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5e875fbf-0376-4974-ad90-209b66b2da0c tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3" status: 200 len: 1366 microversion: 2.1 time: 0.288074 Aug 04 23:20:32.957193 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 389/812] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:32 2022] GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:20:33.041376 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4f92762c-5805-4941-9db1-c25985f169f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:33.051133 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4f92762c-5805-4941-9db1-c25985f169f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1266 microversion: 2.1 time: 0.299881 Aug 04 23:20:33.051713 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 424/813] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:32 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1266 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:20:33.980533 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1408d899-951f-463e-a346-032157726045 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:33.981124 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1408d899-951f-463e-a346-032157726045 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:33.987822 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1408d899-951f-463e-a346-032157726045 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:33.988396 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1408d899-951f-463e-a346-032157726045 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:33.988828 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1408d899-951f-463e-a346-032157726045 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:33.989547 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1408d899-951f-463e-a346-032157726045 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:33.989994 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1408d899-951f-463e-a346-032157726045 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:33.990442 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1408d899-951f-463e-a346-032157726045 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:34.074269 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ef06a4b1-e49f-4ef4-8b9c-a49928da0210 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:34.075242 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ef06a4b1-e49f-4ef4-8b9c-a49928da0210 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:34.084144 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef06a4b1-e49f-4ef4-8b9c-a49928da0210 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:34.084955 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef06a4b1-e49f-4ef4-8b9c-a49928da0210 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:34.085389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef06a4b1-e49f-4ef4-8b9c-a49928da0210 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:34.086300 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef06a4b1-e49f-4ef4-8b9c-a49928da0210 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:34.087033 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef06a4b1-e49f-4ef4-8b9c-a49928da0210 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:34.087797 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef06a4b1-e49f-4ef4-8b9c-a49928da0210 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:34.150891 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1408d899-951f-463e-a346-032157726045 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:34.160335 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1408d899-951f-463e-a346-032157726045 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3" status: 200 len: 1366 microversion: 2.1 time: 0.183838 Aug 04 23:20:34.161889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 390/814] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:33 2022] GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:34.248978 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ef06a4b1-e49f-4ef4-8b9c-a49928da0210 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:34.256924 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ef06a4b1-e49f-4ef4-8b9c-a49928da0210 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1266 microversion: 2.1 time: 0.188907 Aug 04 23:20:34.257880 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 425/815] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:34 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:34.350677 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-62352a83-def2-44a0-b028-369ca1452189 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1875562664"}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:34.351141 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-62352a83-def2-44a0-b028-369ca1452189 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:34.352988 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=4 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:20:34.353802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=12 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:20:34.360259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-62352a83-def2-44a0-b028-369ca1452189 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:34.360747 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-62352a83-def2-44a0-b028-369ca1452189 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:34.361190 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-62352a83-def2-44a0-b028-369ca1452189 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:34.361899 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-62352a83-def2-44a0-b028-369ca1452189 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:34.362423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-62352a83-def2-44a0-b028-369ca1452189 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:34.362810 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-62352a83-def2-44a0-b028-369ca1452189 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:34.511969 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.network.security_group_api [None req-62352a83-def2-44a0-b028-369ca1452189 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Removing security group 8e602bcc-14f7-468e-b3a2-d91813c7e72e from port f7c9e9a4-d405-4289-bdbf-6033cb27920c Aug 04 23:20:34.927567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-62352a83-def2-44a0-b028-369ca1452189 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "POST /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe/action" status: 202 len: 0 microversion: 2.1 time: 0.580737 Aug 04 23:20:34.929309 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 391/816] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Aug 4 23:20:34 2022] POST /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe/action => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:20:34.943799 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-4aa1573a-2746-4eab-970d-644df1f19eb4 req-3dbc50c7-3b8b-48ac-a4e6-dc28d6272f59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "159d56ac-e70e-41db-ae34-62cc0d59d9fe", "tag": "f7c9e9a4-d405-4289-bdbf-6033cb27920c"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:34.957075 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=8 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:20:34.960148 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-4aa1573a-2746-4eab-970d-644df1f19eb4 req-3dbc50c7-3b8b-48ac-a4e6-dc28d6272f59 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:34.963512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-4aa1573a-2746-4eab-970d-644df1f19eb4 req-3dbc50c7-3b8b-48ac-a4e6-dc28d6272f59 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:34.964207 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-4aa1573a-2746-4eab-970d-644df1f19eb4 req-3dbc50c7-3b8b-48ac-a4e6-dc28d6272f59 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:34.995348 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-4aa1573a-2746-4eab-970d-644df1f19eb4 req-3dbc50c7-3b8b-48ac-a4e6-dc28d6272f59 service nova] Creating event network-changed:f7c9e9a4-d405-4289-bdbf-6033cb27920c for instance 159d56ac-e70e-41db-ae34-62cc0d59d9fe on hv-cinder-85221 Aug 04 23:20:35.011044 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-4aa1573a-2746-4eab-970d-644df1f19eb4 req-3dbc50c7-3b8b-48ac-a4e6-dc28d6272f59 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075908 Aug 04 23:20:35.012536 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 426/817] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:35.183812 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4c949c1c-87bf-47f2-beaf-f773672225c4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:35.185371 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4c949c1c-87bf-47f2-beaf-f773672225c4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:35.194776 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c949c1c-87bf-47f2-beaf-f773672225c4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:35.195272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c949c1c-87bf-47f2-beaf-f773672225c4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:35.195913 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c949c1c-87bf-47f2-beaf-f773672225c4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:35.196658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c949c1c-87bf-47f2-beaf-f773672225c4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:35.197115 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c949c1c-87bf-47f2-beaf-f773672225c4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:35.197706 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c949c1c-87bf-47f2-beaf-f773672225c4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:35.280784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8b41011d-80b3-4b07-9d88-0f69cbf72ea9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:35.282707 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8b41011d-80b3-4b07-9d88-0f69cbf72ea9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:35.291319 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8b41011d-80b3-4b07-9d88-0f69cbf72ea9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:35.291812 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8b41011d-80b3-4b07-9d88-0f69cbf72ea9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:35.292592 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8b41011d-80b3-4b07-9d88-0f69cbf72ea9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:35.293856 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8b41011d-80b3-4b07-9d88-0f69cbf72ea9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:35.294699 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8b41011d-80b3-4b07-9d88-0f69cbf72ea9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:35.295437 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8b41011d-80b3-4b07-9d88-0f69cbf72ea9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:35.446152 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4c949c1c-87bf-47f2-beaf-f773672225c4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:35.455669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4c949c1c-87bf-47f2-beaf-f773672225c4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3" status: 200 len: 1366 microversion: 2.1 time: 0.277536 Aug 04 23:20:35.467235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 392/818] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:35 2022] GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:35.644202 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8b41011d-80b3-4b07-9d88-0f69cbf72ea9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:35.665970 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8b41011d-80b3-4b07-9d88-0f69cbf72ea9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1266 microversion: 2.1 time: 0.389928 Aug 04 23:20:35.685895 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 427/819] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:35 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1266 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:20:35.847286 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-137259a7-9e8a-4e88-abb6-47a585b61350 req-90125b58-ce61-43e4-abec-065126bb340c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3", "name": "network-vif-plugged", "status": "completed", "tag": "69a97291-effb-47b6-bee6-f324bb5f636f"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:35.890614 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-137259a7-9e8a-4e88-abb6-47a585b61350 req-90125b58-ce61-43e4-abec-065126bb340c service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:35.890953 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-137259a7-9e8a-4e88-abb6-47a585b61350 req-90125b58-ce61-43e4-abec-065126bb340c service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:35.891795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-137259a7-9e8a-4e88-abb6-47a585b61350 req-90125b58-ce61-43e4-abec-065126bb340c service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:35.913634 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-137259a7-9e8a-4e88-abb6-47a585b61350 req-90125b58-ce61-43e4-abec-065126bb340c service nova] Creating event network-vif-plugged:69a97291-effb-47b6-bee6-f324bb5f636f for instance 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 on hv-cinder-85221 Aug 04 23:20:35.929348 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-137259a7-9e8a-4e88-abb6-47a585b61350 req-90125b58-ce61-43e4-abec-065126bb340c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092245 Aug 04 23:20:35.933831 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 393/820] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:36.482524 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-cea9654a-974b-4993-9e86-7b317c90a266 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:36.483294 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-cea9654a-974b-4993-9e86-7b317c90a266 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:36.491677 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cea9654a-974b-4993-9e86-7b317c90a266 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:36.492591 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cea9654a-974b-4993-9e86-7b317c90a266 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:36.493269 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cea9654a-974b-4993-9e86-7b317c90a266 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:36.494867 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cea9654a-974b-4993-9e86-7b317c90a266 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:36.495633 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cea9654a-974b-4993-9e86-7b317c90a266 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:36.496281 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cea9654a-974b-4993-9e86-7b317c90a266 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:36.700938 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-43d0f82a-c314-4fb5-866b-84db4dbd3779 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:36.702466 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-43d0f82a-c314-4fb5-866b-84db4dbd3779 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:36.710838 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-43d0f82a-c314-4fb5-866b-84db4dbd3779 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:36.711540 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-43d0f82a-c314-4fb5-866b-84db4dbd3779 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:36.712147 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-43d0f82a-c314-4fb5-866b-84db4dbd3779 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:36.713075 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cea9654a-974b-4993-9e86-7b317c90a266 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:36.713527 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-43d0f82a-c314-4fb5-866b-84db4dbd3779 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:36.714146 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-43d0f82a-c314-4fb5-866b-84db4dbd3779 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:36.714766 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-43d0f82a-c314-4fb5-866b-84db4dbd3779 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:36.726487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-cea9654a-974b-4993-9e86-7b317c90a266 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3" status: 200 len: 1366 microversion: 2.1 time: 0.249283 Aug 04 23:20:36.727085 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 428/821] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:36 2022] GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:36.857550 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e0140a1f-1cd9-45ca-93d2-c97df70c647c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:36.858478 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e0140a1f-1cd9-45ca-93d2-c97df70c647c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:36.869612 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0140a1f-1cd9-45ca-93d2-c97df70c647c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:36.870481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0140a1f-1cd9-45ca-93d2-c97df70c647c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:36.872528 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0140a1f-1cd9-45ca-93d2-c97df70c647c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:36.873539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0140a1f-1cd9-45ca-93d2-c97df70c647c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:36.875861 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0140a1f-1cd9-45ca-93d2-c97df70c647c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:36.876622 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0140a1f-1cd9-45ca-93d2-c97df70c647c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:36.908445 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-43d0f82a-c314-4fb5-866b-84db4dbd3779 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:36.917272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-43d0f82a-c314-4fb5-866b-84db4dbd3779 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1266 microversion: 2.1 time: 0.221416 Aug 04 23:20:36.918471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 394/822] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:36 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:36.985821 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.objects.instance [None req-e0140a1f-1cd9-45ca-93d2-c97df70c647c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lazy-loading 'services' on Instance uuid 159d56ac-e70e-41db-ae34-62cc0d59d9fe {{(pid=129791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:20:37.037680 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-df8f706d-8ed7-403e-a83e-24eb75fa1223 req-a75430e4-2b8e-471e-bb6e-bb89475924ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "159d56ac-e70e-41db-ae34-62cc0d59d9fe", "tag": "f7c9e9a4-d405-4289-bdbf-6033cb27920c"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:37.054351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-df8f706d-8ed7-403e-a83e-24eb75fa1223 req-a75430e4-2b8e-471e-bb6e-bb89475924ac service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:37.057201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-df8f706d-8ed7-403e-a83e-24eb75fa1223 req-a75430e4-2b8e-471e-bb6e-bb89475924ac service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:37.058138 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-df8f706d-8ed7-403e-a83e-24eb75fa1223 req-a75430e4-2b8e-471e-bb6e-bb89475924ac service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:37.074006 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-df8f706d-8ed7-403e-a83e-24eb75fa1223 req-a75430e4-2b8e-471e-bb6e-bb89475924ac service nova] Creating event network-changed:f7c9e9a4-d405-4289-bdbf-6033cb27920c for instance 159d56ac-e70e-41db-ae34-62cc0d59d9fe on hv-cinder-85221 Aug 04 23:20:37.097038 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-df8f706d-8ed7-403e-a83e-24eb75fa1223 req-a75430e4-2b8e-471e-bb6e-bb89475924ac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063054 Aug 04 23:20:37.098099 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 395/823] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:20:37.133766 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e0140a1f-1cd9-45ca-93d2-c97df70c647c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "DELETE /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe/os-volume_attachments/fcd9ebe8-281e-4e7c-9fa9-6c127d07738a" status: 202 len: 0 microversion: 2.1 time: 0.281279 Aug 04 23:20:37.134562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 429/824] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Aug 4 23:20:36 2022] DELETE /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe/os-volume_attachments/fcd9ebe8-281e-4e7c-9fa9-6c127d07738a => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:20:37.154263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c540e3d4-a3cc-44c0-9780-c39911700d7b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:37.157830 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c540e3d4-a3cc-44c0-9780-c39911700d7b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:37.165649 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c540e3d4-a3cc-44c0-9780-c39911700d7b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:37.166469 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c540e3d4-a3cc-44c0-9780-c39911700d7b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:37.167138 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c540e3d4-a3cc-44c0-9780-c39911700d7b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:37.168071 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c540e3d4-a3cc-44c0-9780-c39911700d7b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:37.168761 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c540e3d4-a3cc-44c0-9780-c39911700d7b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:37.169402 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c540e3d4-a3cc-44c0-9780-c39911700d7b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:37.204491 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c540e3d4-a3cc-44c0-9780-c39911700d7b tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064930 Aug 04 23:20:37.210747 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 396/825] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:20:37 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:37.759601 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9d16a8db-41b4-4954-b11e-88c6b2dc01c0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:37.760337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9d16a8db-41b4-4954-b11e-88c6b2dc01c0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:37.768466 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d16a8db-41b4-4954-b11e-88c6b2dc01c0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:37.768961 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d16a8db-41b4-4954-b11e-88c6b2dc01c0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:37.769402 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d16a8db-41b4-4954-b11e-88c6b2dc01c0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:37.770147 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d16a8db-41b4-4954-b11e-88c6b2dc01c0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:37.770646 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d16a8db-41b4-4954-b11e-88c6b2dc01c0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:37.771300 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d16a8db-41b4-4954-b11e-88c6b2dc01c0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:37.943014 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2e6f08ab-97ce-4d2b-aa46-1c503052a86c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:37.944303 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2e6f08ab-97ce-4d2b-aa46-1c503052a86c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:37.952015 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e6f08ab-97ce-4d2b-aa46-1c503052a86c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:37.953086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e6f08ab-97ce-4d2b-aa46-1c503052a86c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:37.953766 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e6f08ab-97ce-4d2b-aa46-1c503052a86c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:37.954847 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e6f08ab-97ce-4d2b-aa46-1c503052a86c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:37.955628 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e6f08ab-97ce-4d2b-aa46-1c503052a86c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:37.956263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e6f08ab-97ce-4d2b-aa46-1c503052a86c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:38.350767 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2e6f08ab-97ce-4d2b-aa46-1c503052a86c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:38.360845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2e6f08ab-97ce-4d2b-aa46-1c503052a86c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1266 microversion: 2.1 time: 0.421795 Aug 04 23:20:38.377589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 397/826] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:37 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1266 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:38.383696 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6fd44c8e-7efd-43d0-8d0d-8b59bb4ddeb4 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:38.387970 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6fd44c8e-7efd-43d0-8d0d-8b59bb4ddeb4 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:38.393513 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9d16a8db-41b4-4954-b11e-88c6b2dc01c0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:38.397377 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6fd44c8e-7efd-43d0-8d0d-8b59bb4ddeb4 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:38.398392 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6fd44c8e-7efd-43d0-8d0d-8b59bb4ddeb4 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:38.399002 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6fd44c8e-7efd-43d0-8d0d-8b59bb4ddeb4 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:38.399867 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6fd44c8e-7efd-43d0-8d0d-8b59bb4ddeb4 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:38.400472 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6fd44c8e-7efd-43d0-8d0d-8b59bb4ddeb4 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:38.401061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6fd44c8e-7efd-43d0-8d0d-8b59bb4ddeb4 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:38.402163 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9d16a8db-41b4-4954-b11e-88c6b2dc01c0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3" status: 200 len: 1366 microversion: 2.1 time: 0.653675 Aug 04 23:20:38.403822 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 430/827] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:37 2022] GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 => generated 1366 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:38.470754 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6fd44c8e-7efd-43d0-8d0d-8b59bb4ddeb4 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091452 Aug 04 23:20:38.471357 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 398/828] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:20:38 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:39.382326 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-18f6a7cb-da6b-4a61-9684-939a5d63a99f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:39.383772 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-18f6a7cb-da6b-4a61-9684-939a5d63a99f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:39.398106 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18f6a7cb-da6b-4a61-9684-939a5d63a99f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:39.400255 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18f6a7cb-da6b-4a61-9684-939a5d63a99f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:39.402626 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18f6a7cb-da6b-4a61-9684-939a5d63a99f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:39.403544 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18f6a7cb-da6b-4a61-9684-939a5d63a99f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:39.408136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18f6a7cb-da6b-4a61-9684-939a5d63a99f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:39.408603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18f6a7cb-da6b-4a61-9684-939a5d63a99f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:39.424568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-806033c9-925b-4a50-a65a-2fc9472e8bb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:39.425174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-806033c9-925b-4a50-a65a-2fc9472e8bb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:39.440344 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-806033c9-925b-4a50-a65a-2fc9472e8bb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:39.440847 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-806033c9-925b-4a50-a65a-2fc9472e8bb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:39.441283 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-806033c9-925b-4a50-a65a-2fc9472e8bb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:39.442266 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-806033c9-925b-4a50-a65a-2fc9472e8bb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:39.442906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-806033c9-925b-4a50-a65a-2fc9472e8bb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:39.443485 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-806033c9-925b-4a50-a65a-2fc9472e8bb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:39.715358 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-18f6a7cb-da6b-4a61-9684-939a5d63a99f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:39.727216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-18f6a7cb-da6b-4a61-9684-939a5d63a99f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1266 microversion: 2.1 time: 0.347726 Aug 04 23:20:39.729523 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 431/829] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:39 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1266 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:39.735456 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-806033c9-925b-4a50-a65a-2fc9472e8bb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:39.743975 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-806033c9-925b-4a50-a65a-2fc9472e8bb9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3" status: 200 len: 1556 microversion: 2.1 time: 0.323835 Aug 04 23:20:39.744936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0b2568e9-c666-42e5-8514-62edb538c7ae tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:39.746338 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 399/830] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:39 2022] GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 => generated 1556 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:20:39.748430 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0b2568e9-c666-42e5-8514-62edb538c7ae tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:39.757978 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-127b3fd8-8261-4b82-a8d1-fe040fba6fbd req-22e56ae6-6f14-4d64-b314-e1d0b1d210cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee044da9-1338-4d15-a87d-7fcc18f8354a", "name": "network-vif-plugged", "status": "completed", "tag": "bb606376-a4bc-447a-9437-537ad4e184ad"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:39.768506 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0b2568e9-c666-42e5-8514-62edb538c7ae tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:39.769102 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0b2568e9-c666-42e5-8514-62edb538c7ae tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:39.769611 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0b2568e9-c666-42e5-8514-62edb538c7ae tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:39.770479 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0b2568e9-c666-42e5-8514-62edb538c7ae tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:39.771024 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0b2568e9-c666-42e5-8514-62edb538c7ae tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:39.775254 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0b2568e9-c666-42e5-8514-62edb538c7ae tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:39.775923 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-127b3fd8-8261-4b82-a8d1-fe040fba6fbd req-22e56ae6-6f14-4d64-b314-e1d0b1d210cd service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:39.776621 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-127b3fd8-8261-4b82-a8d1-fe040fba6fbd req-22e56ae6-6f14-4d64-b314-e1d0b1d210cd service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:39.777908 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-127b3fd8-8261-4b82-a8d1-fe040fba6fbd req-22e56ae6-6f14-4d64-b314-e1d0b1d210cd service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:39.798053 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-127b3fd8-8261-4b82-a8d1-fe040fba6fbd req-22e56ae6-6f14-4d64-b314-e1d0b1d210cd service nova] Creating event network-vif-plugged:bb606376-a4bc-447a-9437-537ad4e184ad for instance ee044da9-1338-4d15-a87d-7fcc18f8354a on hv-cinder-85221 Aug 04 23:20:39.806444 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-127b3fd8-8261-4b82-a8d1-fe040fba6fbd req-22e56ae6-6f14-4d64-b314-e1d0b1d210cd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058458 Aug 04 23:20:39.807911 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 400/831] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:39.828660 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0b2568e9-c666-42e5-8514-62edb538c7ae tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095489 Aug 04 23:20:39.829903 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 432/832] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:20:39 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 23:20:39.842336 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8a700f4d-e657-44d9-908d-89f6a461909c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:39.845383 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8a700f4d-e657-44d9-908d-89f6a461909c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:39.852259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-eb27f25f-9061-4758-9f07-89e0a768f1f6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:39.853208 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-eb27f25f-9061-4758-9f07-89e0a768f1f6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:39.864226 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb27f25f-9061-4758-9f07-89e0a768f1f6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:39.865858 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb27f25f-9061-4758-9f07-89e0a768f1f6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:39.867063 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb27f25f-9061-4758-9f07-89e0a768f1f6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:39.868388 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb27f25f-9061-4758-9f07-89e0a768f1f6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:39.869888 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb27f25f-9061-4758-9f07-89e0a768f1f6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:39.870155 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8a700f4d-e657-44d9-908d-89f6a461909c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:39.870337 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb27f25f-9061-4758-9f07-89e0a768f1f6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:39.870870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8a700f4d-e657-44d9-908d-89f6a461909c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:39.871508 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8a700f4d-e657-44d9-908d-89f6a461909c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:39.872545 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8a700f4d-e657-44d9-908d-89f6a461909c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:39.873173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8a700f4d-e657-44d9-908d-89f6a461909c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:39.873741 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8a700f4d-e657-44d9-908d-89f6a461909c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:39.990457 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-eb27f25f-9061-4758-9f07-89e0a768f1f6 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.180427 Aug 04 23:20:39.996066 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 401/833] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Aug 4 23:20:39 2022] GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3/os-interface => generated 284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:40.005678 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-8a700f4d-e657-44d9-908d-89f6a461909c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] HTTP exception thrown: Instance 159d56ac-e70e-41db-ae34-62cc0d59d9fe is not attached to volume fcd9ebe8-281e-4e7c-9fa9-6c127d07738a Aug 04 23:20:40.008627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8a700f4d-e657-44d9-908d-89f6a461909c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Request method failure captured: Aug 04 23:20:40.008627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: DELETE /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe/os-volume_attachments/fcd9ebe8-281e-4e7c-9fa9-6c127d07738a HTTP/1.1 Aug 04 23:20:40.008627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:20:40.008627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:20:40.008627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:20:40.008627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 0 Aug 04 23:20:40.008627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:20:40.008627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:20:40.008627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:20:40.008627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:20:40.008627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FNrJ-zcIz5JFvRJimEPG_Q7LdCT34G3giGT8iBQXiIHE3mW18YBUpxtoXlrHu3HYZZ56-9-cpSXTYnzrzIXlTvmx15n3vpqRJw4VV-J84g-wy34qvDRYpuFlpv_jd2q844nJ7UdI6gWsWOXVJZIte4ELuXeduorOSrubPvdMdyOUuM Aug 04 23:20:40.008627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:20:40.008627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:20:40.008627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:20:40.008627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:20:40.008627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:20:40.008627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:20:40.008627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: 40fcbf40bf6c44a8a740c357bc8b36d1 Aug 04 23:20:40.008627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-TestMinimumBasicScenario-1429862453 Aug 04 23:20:40.008627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:20:40.008627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:20:40.011446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40fcbf40bf6c44a8a740c357bc8b36d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40fcbf40bf6c44a8a740c357bc8b36d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40fcbf40bf6c44a8a740c357bc8b36d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40fcbf40bf6c44a8a740c357bc8b36d1"}]}] Aug 04 23:20:40.011446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-TestMinimumBasicScenario-1429862453 Aug 04 23:20:40.011446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: 40fcbf40bf6c44a8a740c357bc8b36d1 Aug 04 23:20:40.011446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1429862453 Aug 04 23:20:40.011446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-TestMinimumBasicScenario-1429862453-project Aug 04 23:20:40.011446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:20:40.011446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:20:40.011446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: fc87f238e5c94ddea864c1e9c928fc6d Aug 04 23:20:40.011446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-TestMinimumBasicScenario-1429862453-project Aug 04 23:20:40.011446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: > Aug 04 23:20:40.011446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Instance 159d56ac-e70e-41db-ae34-62cc0d59d9fe is not attached to volume fcd9ebe8-281e-4e7c-9fa9-6c127d07738a Aug 04 23:20:40.013451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'server_id': '159d56ac-e70e-41db-ae34-62cc0d59d9fe', 'id': 'fcd9ebe8-281e-4e7c-9fa9-6c127d07738a'} Aug 04 23:20:40.013451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:20:40.013451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:40.013451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 23:20:40.013451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 23:20:40.013451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 23:20:40.013451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 23:20:40.013451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 23:20:40.013451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 23:20:40.013451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fcd9ebe8-281e-4e7c-9fa9-6c127d07738a. Aug 04 23:20:40.013451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:40.013451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:20:40.013451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:40.013451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:40.013451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:20:40.013451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:20:40.013451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:20:40.013451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:20:40.013451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:20:40.018481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:20:40.018481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 23:20:40.018481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 23:20:40.018481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 159d56ac-e70e-41db-ae34-62cc0d59d9fe is not attached to volume fcd9ebe8-281e-4e7c-9fa9-6c127d07738a Aug 04 23:20:40.018481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:40.018481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:20:40.018481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:40.018481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:40.018481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:20:40.018481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:20:40.018481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:20:40.018481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:20:40.018481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 159d56ac-e70e-41db-ae34-62cc0d59d9fe is not attached to volume fcd9ebe8-281e-4e7c-9fa9-6c127d07738a Aug 04 23:20:40.018481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:40.018481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8a700f4d-e657-44d9-908d-89f6a461909c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Returning 404 to user: Instance 159d56ac-e70e-41db-ae34-62cc0d59d9fe is not attached to volume fcd9ebe8-281e-4e7c-9fa9-6c127d07738a {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:20:40.022307 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8a700f4d-e657-44d9-908d-89f6a461909c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "DELETE /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe/os-volume_attachments/fcd9ebe8-281e-4e7c-9fa9-6c127d07738a" status: 404 len: 154 microversion: 2.1 time: 0.174183 Aug 04 23:20:40.036323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 433/834] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Aug 4 23:20:39 2022] DELETE /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe/os-volume_attachments/fcd9ebe8-281e-4e7c-9fa9-6c127d07738a => generated 154 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:20:40.751589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a8da9c34-b294-423d-a705-76f84c17ec8f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:40.752296 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a8da9c34-b294-423d-a705-76f84c17ec8f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:40.760281 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8da9c34-b294-423d-a705-76f84c17ec8f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:40.761445 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8da9c34-b294-423d-a705-76f84c17ec8f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:40.761899 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8da9c34-b294-423d-a705-76f84c17ec8f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:40.766959 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8da9c34-b294-423d-a705-76f84c17ec8f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:40.770577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8da9c34-b294-423d-a705-76f84c17ec8f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:40.773889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8da9c34-b294-423d-a705-76f84c17ec8f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:41.266972 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a8da9c34-b294-423d-a705-76f84c17ec8f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:41.275201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a8da9c34-b294-423d-a705-76f84c17ec8f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1266 microversion: 2.1 time: 0.528077 Aug 04 23:20:41.275771 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 402/835] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:40 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1266 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:41.340721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-10b59b3b-b758-4ae4-ac7e-952201c3ca4a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:41.341511 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-10b59b3b-b758-4ae4-ac7e-952201c3ca4a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:41.349102 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-10b59b3b-b758-4ae4-ac7e-952201c3ca4a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:41.349592 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-10b59b3b-b758-4ae4-ac7e-952201c3ca4a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:41.350113 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-10b59b3b-b758-4ae4-ac7e-952201c3ca4a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:41.350743 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-10b59b3b-b758-4ae4-ac7e-952201c3ca4a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:41.351190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-10b59b3b-b758-4ae4-ac7e-952201c3ca4a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:41.351610 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-10b59b3b-b758-4ae4-ac7e-952201c3ca4a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:41.387849 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-10b59b3b-b758-4ae4-ac7e-952201c3ca4a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Going to try to terminate instance {{(pid=129791) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 23:20:41.518033 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-10b59b3b-b758-4ae4-ac7e-952201c3ca4a tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "DELETE /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 204 len: 0 microversion: 2.1 time: 0.181206 Aug 04 23:20:41.519457 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 434/836] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:20:41 2022] DELETE /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 23:20:41.547963 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7ef29c25-fb28-4a5d-95c4-3d3dd8b46302 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:41.548706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7ef29c25-fb28-4a5d-95c4-3d3dd8b46302 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:41.556948 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7ef29c25-fb28-4a5d-95c4-3d3dd8b46302 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:41.558217 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7ef29c25-fb28-4a5d-95c4-3d3dd8b46302 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:41.558963 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7ef29c25-fb28-4a5d-95c4-3d3dd8b46302 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:41.565381 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7ef29c25-fb28-4a5d-95c4-3d3dd8b46302 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:41.566039 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7ef29c25-fb28-4a5d-95c4-3d3dd8b46302 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:41.566508 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7ef29c25-fb28-4a5d-95c4-3d3dd8b46302 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:41.589630 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:20:41.678533 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-647d17e7-9ba3-4ebf-b4c6-9d6cfa80e59a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Action: 'create', calling method: .version_select at 0x7f6d25c4fc10>, body: {"keypair": {"name": "tempest-keypair-718283364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOeEu/rDNbsXUEX2kR1lCtMZyoe2fVUzZzvv4vhp6WBHOapU8oHbrXfQaS5eQdb1t3/F/E91C+2TIxeL52Aqax+AdbjnWHWd8VUlQuO/4JbPRVxbb8FELSNOEpJM64gDg=="}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:41.703560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-647d17e7-9ba3-4ebf-b4c6-9d6cfa80e59a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Getting quotas for project c5dd21e824d843aea197d84ef1ab1319. Resources: {'key_pairs'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:20:41.714641 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-647d17e7-9ba3-4ebf-b4c6-9d6cfa80e59a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Getting quotas for user 3a00aba057b548b1bc81e68acffea150 and project c5dd21e824d843aea197d84ef1ab1319. Resources: {'key_pairs'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:20:41.767006 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-647d17e7-9ba3-4ebf-b4c6-9d6cfa80e59a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.315679 Aug 04 23:20:41.767680 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 403/837] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Aug 4 23:20:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:20:41.778542 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7ef29c25-fb28-4a5d-95c4-3d3dd8b46302 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:41.782547 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-eba8da6b-a702-4b98-a60b-00e16c82f4c6 req-b47e697c-2e35-4b1f-b3dd-78a1b91934bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3", "tag": "69a97291-effb-47b6-bee6-f324bb5f636f"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:41.803387 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-eba8da6b-a702-4b98-a60b-00e16c82f4c6 req-b47e697c-2e35-4b1f-b3dd-78a1b91934bb service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:41.804140 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-eba8da6b-a702-4b98-a60b-00e16c82f4c6 req-b47e697c-2e35-4b1f-b3dd-78a1b91934bb service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:41.804769 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-eba8da6b-a702-4b98-a60b-00e16c82f4c6 req-b47e697c-2e35-4b1f-b3dd-78a1b91934bb service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:41.806585 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7ef29c25-fb28-4a5d-95c4-3d3dd8b46302 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1554 microversion: 2.1 time: 0.282209 Aug 04 23:20:41.807168 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 435/838] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:41 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1554 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:41.817355 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-eba8da6b-a702-4b98-a60b-00e16c82f4c6 req-b47e697c-2e35-4b1f-b3dd-78a1b91934bb service nova] Creating event network-changed:69a97291-effb-47b6-bee6-f324bb5f636f for instance 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 on hv-cinder-85221 Aug 04 23:20:41.828399 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-eba8da6b-a702-4b98-a60b-00e16c82f4c6 req-b47e697c-2e35-4b1f-b3dd-78a1b91934bb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056745 Aug 04 23:20:41.830204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 404/839] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:42.299153 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-20edc682-eda3-4de1-9634-0458566594d4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:42.300195 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-20edc682-eda3-4de1-9634-0458566594d4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:42.310303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20edc682-eda3-4de1-9634-0458566594d4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:42.310984 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20edc682-eda3-4de1-9634-0458566594d4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:42.311429 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20edc682-eda3-4de1-9634-0458566594d4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:42.312241 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20edc682-eda3-4de1-9634-0458566594d4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:42.312706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20edc682-eda3-4de1-9634-0458566594d4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:42.313856 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20edc682-eda3-4de1-9634-0458566594d4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:42.542551 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-20edc682-eda3-4de1-9634-0458566594d4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:42.553921 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-20edc682-eda3-4de1-9634-0458566594d4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1266 microversion: 2.1 time: 0.260247 Aug 04 23:20:42.555146 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 436/840] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:42 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:42.833159 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ed4675ee-02b3-4ab8-9f18-4f62a6e7c460 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:42.834583 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ed4675ee-02b3-4ab8-9f18-4f62a6e7c460 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:42.844838 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed4675ee-02b3-4ab8-9f18-4f62a6e7c460 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:42.846300 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed4675ee-02b3-4ab8-9f18-4f62a6e7c460 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:42.847012 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed4675ee-02b3-4ab8-9f18-4f62a6e7c460 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:42.848528 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed4675ee-02b3-4ab8-9f18-4f62a6e7c460 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:42.849189 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed4675ee-02b3-4ab8-9f18-4f62a6e7c460 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:42.850611 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed4675ee-02b3-4ab8-9f18-4f62a6e7c460 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:42.881822 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:20:43.070510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ed4675ee-02b3-4ab8-9f18-4f62a6e7c460 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:43.080783 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ed4675ee-02b3-4ab8-9f18-4f62a6e7c460 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1554 microversion: 2.1 time: 0.253453 Aug 04 23:20:43.081538 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 405/841] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:42 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1554 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:43.581020 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e601dae2-d9d6-486e-8a92-156203211d68 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:43.582675 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e601dae2-d9d6-486e-8a92-156203211d68 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:43.594012 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e601dae2-d9d6-486e-8a92-156203211d68 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:43.594564 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e601dae2-d9d6-486e-8a92-156203211d68 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:43.595002 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e601dae2-d9d6-486e-8a92-156203211d68 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:43.596029 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e601dae2-d9d6-486e-8a92-156203211d68 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:43.596491 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e601dae2-d9d6-486e-8a92-156203211d68 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:43.597303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e601dae2-d9d6-486e-8a92-156203211d68 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:43.675004 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-93b029a4-148d-44b2-b4cb-492908d28e6c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1461008891", "imageRef": "e1e9d70e-b252-44e5-9ecd-bf73cbf00160", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d7f9022-75c8-4e4b-87c1-156284fe0318"}], "security_groups": [{"name": "tempest-securitygroup--1055440059"}], "key_name": "tempest-keypair-718283364", "user_data": "}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:43.827307 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e601dae2-d9d6-486e-8a92-156203211d68 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:43.842402 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.network.neutron [None req-93b029a4-148d-44b2-b4cb-492908d28e6c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] validate_networks() for [('0d7f9022-75c8-4e4b-87c1-156284fe0318', None, None, None, None, None)] {{(pid=129790) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 23:20:43.847264 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e601dae2-d9d6-486e-8a92-156203211d68 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1452 microversion: 2.1 time: 0.272535 Aug 04 23:20:43.870470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 437/842] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:43 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1452 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:20:43.882849 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-89b02c97-48af-4bd8-9261-1eb2dd63baf6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:43.884239 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-89b02c97-48af-4bd8-9261-1eb2dd63baf6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:43.903162 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-89b02c97-48af-4bd8-9261-1eb2dd63baf6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:43.904212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-89b02c97-48af-4bd8-9261-1eb2dd63baf6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:43.904816 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-89b02c97-48af-4bd8-9261-1eb2dd63baf6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:43.907328 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-89b02c97-48af-4bd8-9261-1eb2dd63baf6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:43.908019 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-89b02c97-48af-4bd8-9261-1eb2dd63baf6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:43.908705 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-89b02c97-48af-4bd8-9261-1eb2dd63baf6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:44.201643 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-89b02c97-48af-4bd8-9261-1eb2dd63baf6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:44.211933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-89b02c97-48af-4bd8-9261-1eb2dd63baf6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1452 microversion: 2.1 time: 0.339321 Aug 04 23:20:44.212897 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 438/843] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:43 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1452 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:44.217798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-46ce242a-8b5c-49fe-823d-b14f34a68a4c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:44.221906 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-46ce242a-8b5c-49fe-823d-b14f34a68a4c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:44.236292 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-46ce242a-8b5c-49fe-823d-b14f34a68a4c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:44.237364 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-46ce242a-8b5c-49fe-823d-b14f34a68a4c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:44.238121 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-46ce242a-8b5c-49fe-823d-b14f34a68a4c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:44.240149 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-46ce242a-8b5c-49fe-823d-b14f34a68a4c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:44.241090 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-46ce242a-8b5c-49fe-823d-b14f34a68a4c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:44.241745 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-46ce242a-8b5c-49fe-823d-b14f34a68a4c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:44.543570 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-46ce242a-8b5c-49fe-823d-b14f34a68a4c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc87f238e5c94ddea864c1e9c928fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fcbf40bf6c44a8a740c357bc8b36d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:44.554701 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-46ce242a-8b5c-49fe-823d-b14f34a68a4c tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 200 len: 1554 microversion: 2.1 time: 0.340480 Aug 04 23:20:44.555553 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 439/844] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:44 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 1554 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:44.578560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-93b029a4-148d-44b2-b4cb-492908d28e6c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Flavor limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 23:20:44.579445 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-93b029a4-148d-44b2-b4cb-492908d28e6c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Image limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 23:20:44.579923 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-93b029a4-148d-44b2-b4cb-492908d28e6c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Flavor pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 23:20:44.580326 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-93b029a4-148d-44b2-b4cb-492908d28e6c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Image pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 23:20:44.580906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-93b029a4-148d-44b2-b4cb-492908d28e6c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 23:20:44.591186 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-93b029a4-148d-44b2-b4cb-492908d28e6c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:44.591941 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-93b029a4-148d-44b2-b4cb-492908d28e6c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:44.592381 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-93b029a4-148d-44b2-b4cb-492908d28e6c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:44.593865 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-93b029a4-148d-44b2-b4cb-492908d28e6c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:44.594319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-93b029a4-148d-44b2-b4cb-492908d28e6c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:44.594768 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-93b029a4-148d-44b2-b4cb-492908d28e6c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:44.616661 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-93b029a4-148d-44b2-b4cb-492908d28e6c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Getting quotas for project c5dd21e824d843aea197d84ef1ab1319. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:20:44.622590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-93b029a4-148d-44b2-b4cb-492908d28e6c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Getting quotas for user 3a00aba057b548b1bc81e68acffea150 and project c5dd21e824d843aea197d84ef1ab1319. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:20:44.643038 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-93b029a4-148d-44b2-b4cb-492908d28e6c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Going to run 1 instances... {{(pid=129790) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 23:20:44.646951 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-93b029a4-148d-44b2-b4cb-492908d28e6c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1e9d70e-b252-44e5-9ecd-bf73cbf00160',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129790) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 23:20:44.711784 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-93b029a4-148d-44b2-b4cb-492908d28e6c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.042022 Aug 04 23:20:44.713308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 406/845] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Aug 4 23:20:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 23:20:44.725234 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f42d4b35-bd32-44fd-8d11-3edbe92dfe76 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:44.725863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f42d4b35-bd32-44fd-8d11-3edbe92dfe76 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:44.798836 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f42d4b35-bd32-44fd-8d11-3edbe92dfe76 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:44.806013 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f42d4b35-bd32-44fd-8d11-3edbe92dfe76 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1237 microversion: 2.1 time: 0.085059 Aug 04 23:20:44.808224 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 440/846] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:44 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:44.908588 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-fcd825d6-5263-4595-842b-9b25ff281f6b req-895b070d-1395-4c47-abdb-5dc82b72d474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159d56ac-e70e-41db-ae34-62cc0d59d9fe", "name": "network-vif-deleted", "tag": "f7c9e9a4-d405-4289-bdbf-6033cb27920c"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:44.919681 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-fcd825d6-5263-4595-842b-9b25ff281f6b req-895b070d-1395-4c47-abdb-5dc82b72d474 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:44.920828 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-fcd825d6-5263-4595-842b-9b25ff281f6b req-895b070d-1395-4c47-abdb-5dc82b72d474 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:44.921553 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-fcd825d6-5263-4595-842b-9b25ff281f6b req-895b070d-1395-4c47-abdb-5dc82b72d474 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:44.940268 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-fcd825d6-5263-4595-842b-9b25ff281f6b req-895b070d-1395-4c47-abdb-5dc82b72d474 service nova] Creating event network-vif-deleted:f7c9e9a4-d405-4289-bdbf-6033cb27920c for instance 159d56ac-e70e-41db-ae34-62cc0d59d9fe on hv-cinder-85221 Aug 04 23:20:44.949869 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-fcd825d6-5263-4595-842b-9b25ff281f6b req-895b070d-1395-4c47-abdb-5dc82b72d474 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045575 Aug 04 23:20:44.950889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 407/847] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:45.580035 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-129167d8-f3ed-46db-8063-edeacbee06df tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:45.581265 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-129167d8-f3ed-46db-8063-edeacbee06df tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] [instance: 159d56ac-e70e-41db-ae34-62cc0d59d9fe] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:45.591818 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-129167d8-f3ed-46db-8063-edeacbee06df tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:45.592395 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-129167d8-f3ed-46db-8063-edeacbee06df tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:45.593779 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-129167d8-f3ed-46db-8063-edeacbee06df tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:45.594801 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-129167d8-f3ed-46db-8063-edeacbee06df tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:45.595358 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-129167d8-f3ed-46db-8063-edeacbee06df tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:45.595853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-129167d8-f3ed-46db-8063-edeacbee06df tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:45.613718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-129167d8-f3ed-46db-8063-edeacbee06df tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] HTTP exception thrown: Instance 159d56ac-e70e-41db-ae34-62cc0d59d9fe could not be found. Aug 04 23:20:45.616988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-129167d8-f3ed-46db-8063-edeacbee06df tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Request method failure captured: Aug 04 23:20:45.616988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe HTTP/1.1 Aug 04 23:20:45.616988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:20:45.616988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:20:45.616988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:20:45.616988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 0 Aug 04 23:20:45.616988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:20:45.616988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:20:45.616988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:20:45.616988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:20:45.616988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FNrJ-zcIz5JFvRJimEPG_Q7LdCT34G3giGT8iBQXiIHE3mW18YBUpxtoXlrHu3HYZZ56-9-cpSXTYnzrzIXlTvmx15n3vpqRJw4VV-J84g-wy34qvDRYpuFlpv_jd2q844nJ7UdI6gWsWOXVJZIte4ELuXeduorOSrubPvdMdyOUuM Aug 04 23:20:45.616988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:20:45.616988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:20:45.616988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:20:45.616988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:20:45.616988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:20:45.616988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:20:45.616988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: 40fcbf40bf6c44a8a740c357bc8b36d1 Aug 04 23:20:45.616988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-TestMinimumBasicScenario-1429862453 Aug 04 23:20:45.616988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:20:45.616988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:20:45.618303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40fcbf40bf6c44a8a740c357bc8b36d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40fcbf40bf6c44a8a740c357bc8b36d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40fcbf40bf6c44a8a740c357bc8b36d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40fcbf40bf6c44a8a740c357bc8b36d1"}]}] Aug 04 23:20:45.618303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-TestMinimumBasicScenario-1429862453 Aug 04 23:20:45.618303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: 40fcbf40bf6c44a8a740c357bc8b36d1 Aug 04 23:20:45.618303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1429862453 Aug 04 23:20:45.618303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-TestMinimumBasicScenario-1429862453-project Aug 04 23:20:45.618303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:20:45.618303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:20:45.618303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: fc87f238e5c94ddea864c1e9c928fc6d Aug 04 23:20:45.618303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-TestMinimumBasicScenario-1429862453-project Aug 04 23:20:45.618303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: > Aug 04 23:20:45.618303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Instance 159d56ac-e70e-41db-ae34-62cc0d59d9fe could not be found. Aug 04 23:20:45.618303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'id': '159d56ac-e70e-41db-ae34-62cc0d59d9fe'} Aug 04 23:20:45.619539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:20:45.619539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:45.619539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:20:45.619539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:20:45.619539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:20:45.619539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:20:45.619539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:20:45.619539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:20:45.619539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:20:45.619539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:20:45.619539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 159d56ac-e70e-41db-ae34-62cc0d59d9fe could not be found. Aug 04 23:20:45.619539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:45.619539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:20:45.619539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:45.619539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:45.619539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:20:45.619539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:20:45.619539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:20:45.619539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:20:45.619539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:20:45.621215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:20:45.621215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:20:45.621215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:20:45.621215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:20:45.621215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:20:45.621215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:20:45.621215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:20:45.621215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 159d56ac-e70e-41db-ae34-62cc0d59d9fe could not be found. Aug 04 23:20:45.621215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:45.621215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:20:45.621215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:45.621215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:20:45.621215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:20:45.621215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:20:45.621215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:20:45.621215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:20:45.621215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 159d56ac-e70e-41db-ae34-62cc0d59d9fe could not be found. Aug 04 23:20:45.621215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:20:45.623725 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-129167d8-f3ed-46db-8063-edeacbee06df tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Returning 404 to user: Instance 159d56ac-e70e-41db-ae34-62cc0d59d9fe could not be found. {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:20:45.625257 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-129167d8-f3ed-46db-8063-edeacbee06df tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe" status: 404 len: 111 microversion: 2.1 time: 0.052594 Aug 04 23:20:45.626393 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 441/848] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:45 2022] GET /compute/v2.1/servers/159d56ac-e70e-41db-ae34-62cc0d59d9fe => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:20:45.636267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-124ea015-8180-44d1-9e98-56e10139e7c7 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] Calling method '.version_select at 0x7f6d25c99a60>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:45.665329 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-124ea015-8180-44d1-9e98-56e10139e7c7 tempest-TestMinimumBasicScenario-1429862453 tempest-TestMinimumBasicScenario-1429862453-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-777286432" status: 202 len: 0 microversion: 2.1 time: 0.032415 Aug 04 23:20:45.665956 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 408/849] 10.222.0.33 () {58 vars in 1269 bytes} [Thu Aug 4 23:20:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-777286432 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:20:45.837934 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-02bc89bf-ccdf-49e4-8528-ba77d1eea43e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:45.840452 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-02bc89bf-ccdf-49e4-8528-ba77d1eea43e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:45.850001 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02bc89bf-ccdf-49e4-8528-ba77d1eea43e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:45.850517 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02bc89bf-ccdf-49e4-8528-ba77d1eea43e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:45.850959 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02bc89bf-ccdf-49e4-8528-ba77d1eea43e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:45.851668 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02bc89bf-ccdf-49e4-8528-ba77d1eea43e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:45.852511 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02bc89bf-ccdf-49e4-8528-ba77d1eea43e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:45.853164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02bc89bf-ccdf-49e4-8528-ba77d1eea43e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:45.932105 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-02bc89bf-ccdf-49e4-8528-ba77d1eea43e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:45.941067 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-02bc89bf-ccdf-49e4-8528-ba77d1eea43e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1289 microversion: 2.1 time: 0.116409 Aug 04 23:20:45.942005 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 442/850] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:45 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1289 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:46.963912 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-422e1585-68d3-43d9-b6e9-45f1cb0c0ba5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:46.964564 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-422e1585-68d3-43d9-b6e9-45f1cb0c0ba5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:46.971859 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-422e1585-68d3-43d9-b6e9-45f1cb0c0ba5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:46.972623 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-422e1585-68d3-43d9-b6e9-45f1cb0c0ba5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:46.973254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-422e1585-68d3-43d9-b6e9-45f1cb0c0ba5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:46.974127 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-422e1585-68d3-43d9-b6e9-45f1cb0c0ba5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:46.974617 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-422e1585-68d3-43d9-b6e9-45f1cb0c0ba5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:46.975048 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-422e1585-68d3-43d9-b6e9-45f1cb0c0ba5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:47.079996 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-422e1585-68d3-43d9-b6e9-45f1cb0c0ba5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:47.089152 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-422e1585-68d3-43d9-b6e9-45f1cb0c0ba5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1295 microversion: 2.1 time: 0.129485 Aug 04 23:20:47.090337 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 409/851] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:46 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1295 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:47.601893 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-59a87268-1063-4767-9fdc-45ca29202bde req-1f2166b7-6419-492c-ac9d-3d93e1d1725e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee044da9-1338-4d15-a87d-7fcc18f8354a", "tag": "bb606376-a4bc-447a-9437-537ad4e184ad"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:47.612739 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-59a87268-1063-4767-9fdc-45ca29202bde req-1f2166b7-6419-492c-ac9d-3d93e1d1725e service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:47.613480 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-59a87268-1063-4767-9fdc-45ca29202bde req-1f2166b7-6419-492c-ac9d-3d93e1d1725e service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:47.614074 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-59a87268-1063-4767-9fdc-45ca29202bde req-1f2166b7-6419-492c-ac9d-3d93e1d1725e service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:47.627893 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-59a87268-1063-4767-9fdc-45ca29202bde req-1f2166b7-6419-492c-ac9d-3d93e1d1725e service nova] Creating event network-changed:bb606376-a4bc-447a-9437-537ad4e184ad for instance ee044da9-1338-4d15-a87d-7fcc18f8354a on hv-cinder-85221 Aug 04 23:20:47.634055 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-59a87268-1063-4767-9fdc-45ca29202bde req-1f2166b7-6419-492c-ac9d-3d93e1d1725e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037300 Aug 04 23:20:47.635639 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 443/852] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:48.113987 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-52f02a7f-2172-42d2-a632-ca400f617059 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:48.114558 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-52f02a7f-2172-42d2-a632-ca400f617059 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:48.121450 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-52f02a7f-2172-42d2-a632-ca400f617059 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:48.121942 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-52f02a7f-2172-42d2-a632-ca400f617059 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:48.122618 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-52f02a7f-2172-42d2-a632-ca400f617059 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:48.123499 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-52f02a7f-2172-42d2-a632-ca400f617059 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:48.124674 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-52f02a7f-2172-42d2-a632-ca400f617059 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:48.125254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-52f02a7f-2172-42d2-a632-ca400f617059 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:48.344609 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-52f02a7f-2172-42d2-a632-ca400f617059 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:48.361610 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-52f02a7f-2172-42d2-a632-ca400f617059 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1363 microversion: 2.1 time: 0.253649 Aug 04 23:20:48.365714 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 410/853] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:48 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:49.386789 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-85e27df9-1421-4a3d-8e8c-bac906321b29 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:49.388175 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-85e27df9-1421-4a3d-8e8c-bac906321b29 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:49.396255 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-85e27df9-1421-4a3d-8e8c-bac906321b29 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:49.396781 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-85e27df9-1421-4a3d-8e8c-bac906321b29 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:49.397384 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-85e27df9-1421-4a3d-8e8c-bac906321b29 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:49.398283 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-85e27df9-1421-4a3d-8e8c-bac906321b29 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:49.398908 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-85e27df9-1421-4a3d-8e8c-bac906321b29 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:49.399482 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-85e27df9-1421-4a3d-8e8c-bac906321b29 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:49.653506 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-85e27df9-1421-4a3d-8e8c-bac906321b29 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:49.661642 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-85e27df9-1421-4a3d-8e8c-bac906321b29 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1363 microversion: 2.1 time: 0.279121 Aug 04 23:20:49.662215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 444/854] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:49 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:49.695359 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-1cbf60d1-1c58-4d56-90f6-8fe8b762f0fd req-7c481e94-10fe-466f-b2a9-b8d6066ef730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46a7e2be-71c5-4d64-b02a-a8d125d790e2", "tag": "c464267b-2d09-4900-8144-503866c46cf3"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:49.701678 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:20:49.706440 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-1cbf60d1-1c58-4d56-90f6-8fe8b762f0fd req-7c481e94-10fe-466f-b2a9-b8d6066ef730 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:49.706927 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-1cbf60d1-1c58-4d56-90f6-8fe8b762f0fd req-7c481e94-10fe-466f-b2a9-b8d6066ef730 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:49.707357 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-1cbf60d1-1c58-4d56-90f6-8fe8b762f0fd req-7c481e94-10fe-466f-b2a9-b8d6066ef730 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:49.722293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-1cbf60d1-1c58-4d56-90f6-8fe8b762f0fd req-7c481e94-10fe-466f-b2a9-b8d6066ef730 service nova] Creating event network-changed:c464267b-2d09-4900-8144-503866c46cf3 for instance 46a7e2be-71c5-4d64-b02a-a8d125d790e2 on hv-cinder-85221 Aug 04 23:20:49.727925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-1cbf60d1-1c58-4d56-90f6-8fe8b762f0fd req-7c481e94-10fe-466f-b2a9-b8d6066ef730 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036713 Aug 04 23:20:49.728859 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 411/855] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:50.684040 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2c4ac38c-7cdc-4d0a-a9a4-19eb2eca70fa tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:50.684894 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2c4ac38c-7cdc-4d0a-a9a4-19eb2eca70fa tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:50.691734 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c4ac38c-7cdc-4d0a-a9a4-19eb2eca70fa tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:50.692214 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c4ac38c-7cdc-4d0a-a9a4-19eb2eca70fa tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:50.692638 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c4ac38c-7cdc-4d0a-a9a4-19eb2eca70fa tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:50.693362 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c4ac38c-7cdc-4d0a-a9a4-19eb2eca70fa tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:50.693809 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c4ac38c-7cdc-4d0a-a9a4-19eb2eca70fa tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:50.694222 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c4ac38c-7cdc-4d0a-a9a4-19eb2eca70fa tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:50.949880 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2c4ac38c-7cdc-4d0a-a9a4-19eb2eca70fa tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:50.958641 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2c4ac38c-7cdc-4d0a-a9a4-19eb2eca70fa tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1363 microversion: 2.1 time: 0.278558 Aug 04 23:20:50.959218 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 445/856] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:50 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:20:51.981690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-23786bd5-09c9-456f-826e-95aa490b4da8 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:51.982627 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-23786bd5-09c9-456f-826e-95aa490b4da8 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:51.990140 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-23786bd5-09c9-456f-826e-95aa490b4da8 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:51.990986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-23786bd5-09c9-456f-826e-95aa490b4da8 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:51.991439 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-23786bd5-09c9-456f-826e-95aa490b4da8 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:51.992151 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-23786bd5-09c9-456f-826e-95aa490b4da8 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:51.992629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-23786bd5-09c9-456f-826e-95aa490b4da8 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:51.993057 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-23786bd5-09c9-456f-826e-95aa490b4da8 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:52.275212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-23786bd5-09c9-456f-826e-95aa490b4da8 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:52.284021 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-23786bd5-09c9-456f-826e-95aa490b4da8 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1363 microversion: 2.1 time: 0.307450 Aug 04 23:20:52.284596 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 412/857] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:51 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1363 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:53.306195 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-523dd33c-66de-4e3a-be75-cb12b62af28c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:53.306909 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-523dd33c-66de-4e3a-be75-cb12b62af28c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:53.316656 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-523dd33c-66de-4e3a-be75-cb12b62af28c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:53.317152 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-523dd33c-66de-4e3a-be75-cb12b62af28c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:53.317641 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-523dd33c-66de-4e3a-be75-cb12b62af28c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:53.318289 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-523dd33c-66de-4e3a-be75-cb12b62af28c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:53.318757 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-523dd33c-66de-4e3a-be75-cb12b62af28c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:53.319172 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-523dd33c-66de-4e3a-be75-cb12b62af28c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:53.543997 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-523dd33c-66de-4e3a-be75-cb12b62af28c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:53.556768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-523dd33c-66de-4e3a-be75-cb12b62af28c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1363 microversion: 2.1 time: 0.254449 Aug 04 23:20:53.557951 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 446/858] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:53 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:54.578247 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ff655a3d-2928-4050-a3dd-3e35d1e761c2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:54.578909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ff655a3d-2928-4050-a3dd-3e35d1e761c2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:54.585518 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff655a3d-2928-4050-a3dd-3e35d1e761c2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:54.586013 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff655a3d-2928-4050-a3dd-3e35d1e761c2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:54.586477 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff655a3d-2928-4050-a3dd-3e35d1e761c2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:54.587448 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff655a3d-2928-4050-a3dd-3e35d1e761c2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:54.587913 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff655a3d-2928-4050-a3dd-3e35d1e761c2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:54.588342 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff655a3d-2928-4050-a3dd-3e35d1e761c2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:54.605123 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=2 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:20:54.635618 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=10 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:20:54.733228 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ff655a3d-2928-4050-a3dd-3e35d1e761c2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:54.741696 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ff655a3d-2928-4050-a3dd-3e35d1e761c2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1363 microversion: 2.1 time: 0.167281 Aug 04 23:20:54.742253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 413/859] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:54 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:55.457518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-52a8301a-40ac-415d-a050-975103faf579 req-41565d31-5d53-415c-a024-f7267122863e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46a7e2be-71c5-4d64-b02a-a8d125d790e2", "name": "network-vif-plugged", "status": "completed", "tag": "c464267b-2d09-4900-8144-503866c46cf3"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:55.463847 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=2 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:20:55.474590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-52a8301a-40ac-415d-a050-975103faf579 req-41565d31-5d53-415c-a024-f7267122863e service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:55.475166 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-52a8301a-40ac-415d-a050-975103faf579 req-41565d31-5d53-415c-a024-f7267122863e service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:55.475871 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-52a8301a-40ac-415d-a050-975103faf579 req-41565d31-5d53-415c-a024-f7267122863e service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:55.492343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-52a8301a-40ac-415d-a050-975103faf579 req-41565d31-5d53-415c-a024-f7267122863e service nova] Creating event network-vif-plugged:c464267b-2d09-4900-8144-503866c46cf3 for instance 46a7e2be-71c5-4d64-b02a-a8d125d790e2 on hv-cinder-85221 Aug 04 23:20:55.498568 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-52a8301a-40ac-415d-a050-975103faf579 req-41565d31-5d53-415c-a024-f7267122863e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045365 Aug 04 23:20:55.499347 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 447/860] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:55.762246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-57657115-328f-4412-aee3-ba4de7120df9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:55.762883 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-57657115-328f-4412-aee3-ba4de7120df9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:55.769961 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57657115-328f-4412-aee3-ba4de7120df9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:55.770483 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57657115-328f-4412-aee3-ba4de7120df9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:55.770926 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57657115-328f-4412-aee3-ba4de7120df9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:55.771629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57657115-328f-4412-aee3-ba4de7120df9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:55.772088 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57657115-328f-4412-aee3-ba4de7120df9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:55.772511 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57657115-328f-4412-aee3-ba4de7120df9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:55.911459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-57657115-328f-4412-aee3-ba4de7120df9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:55.919374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-57657115-328f-4412-aee3-ba4de7120df9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1363 microversion: 2.1 time: 0.160907 Aug 04 23:20:55.919849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 414/861] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:55 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:20:56.944220 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1c83afaa-c620-4cd0-a574-c8b1aa642d37 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:56.944926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1c83afaa-c620-4cd0-a574-c8b1aa642d37 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:56.951570 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1c83afaa-c620-4cd0-a574-c8b1aa642d37 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:56.952606 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1c83afaa-c620-4cd0-a574-c8b1aa642d37 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:56.953154 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1c83afaa-c620-4cd0-a574-c8b1aa642d37 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:56.953858 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1c83afaa-c620-4cd0-a574-c8b1aa642d37 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:56.954313 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1c83afaa-c620-4cd0-a574-c8b1aa642d37 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:56.954763 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1c83afaa-c620-4cd0-a574-c8b1aa642d37 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:57.101358 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1c83afaa-c620-4cd0-a574-c8b1aa642d37 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:57.110947 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1c83afaa-c620-4cd0-a574-c8b1aa642d37 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1363 microversion: 2.1 time: 0.171143 Aug 04 23:20:57.111735 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 448/862] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:56 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:58.132411 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6d629d11-f6ed-4e93-8e15-df134496c034 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:58.133045 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6d629d11-f6ed-4e93-8e15-df134496c034 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:58.139557 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6d629d11-f6ed-4e93-8e15-df134496c034 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:58.140303 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6d629d11-f6ed-4e93-8e15-df134496c034 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:58.140485 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6d629d11-f6ed-4e93-8e15-df134496c034 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:58.141189 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6d629d11-f6ed-4e93-8e15-df134496c034 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:58.141645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6d629d11-f6ed-4e93-8e15-df134496c034 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:58.142108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6d629d11-f6ed-4e93-8e15-df134496c034 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:58.274846 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6d629d11-f6ed-4e93-8e15-df134496c034 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:20:58.283561 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6d629d11-f6ed-4e93-8e15-df134496c034 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1549 microversion: 2.1 time: 0.155870 Aug 04 23:20:58.284050 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 415/863] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:20:58 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:20:58.304726 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-dcd2b304-9dd3-4fe4-87f5-93b460b8a8f9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:20:58.305300 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-dcd2b304-9dd3-4fe4-87f5-93b460b8a8f9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:20:58.307698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:20:58.315791 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dcd2b304-9dd3-4fe4-87f5-93b460b8a8f9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:58.316280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dcd2b304-9dd3-4fe4-87f5-93b460b8a8f9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:58.316713 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dcd2b304-9dd3-4fe4-87f5-93b460b8a8f9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:58.317423 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dcd2b304-9dd3-4fe4-87f5-93b460b8a8f9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:58.317873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dcd2b304-9dd3-4fe4-87f5-93b460b8a8f9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:58.318292 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dcd2b304-9dd3-4fe4-87f5-93b460b8a8f9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:58.403193 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-dcd2b304-9dd3-4fe4-87f5-93b460b8a8f9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102261 Aug 04 23:20:58.403785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 449/864] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Aug 4 23:20:58 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:20:59.404260 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-826c1c63-e996-4a64-87c9-e80fd25e0237 req-3c267756-e942-455c-a183-aa0c198bbfee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46a7e2be-71c5-4d64-b02a-a8d125d790e2", "tag": "c464267b-2d09-4900-8144-503866c46cf3"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:20:59.415250 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-826c1c63-e996-4a64-87c9-e80fd25e0237 req-3c267756-e942-455c-a183-aa0c198bbfee service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:20:59.415723 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-826c1c63-e996-4a64-87c9-e80fd25e0237 req-3c267756-e942-455c-a183-aa0c198bbfee service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:20:59.416206 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-826c1c63-e996-4a64-87c9-e80fd25e0237 req-3c267756-e942-455c-a183-aa0c198bbfee service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:20:59.429100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-826c1c63-e996-4a64-87c9-e80fd25e0237 req-3c267756-e942-455c-a183-aa0c198bbfee service nova] Creating event network-changed:c464267b-2d09-4900-8144-503866c46cf3 for instance 46a7e2be-71c5-4d64-b02a-a8d125d790e2 on hv-cinder-85221 Aug 04 23:20:59.434404 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-826c1c63-e996-4a64-87c9-e80fd25e0237 req-3c267756-e942-455c-a183-aa0c198bbfee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033741 Aug 04 23:20:59.434994 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 416/865] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:21:07.403426 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-cb081ec6-4caf-451e-8eb4-3d355f5c8723 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:07.403985 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-cb081ec6-4caf-451e-8eb4-3d355f5c8723 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:07.410536 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cb081ec6-4caf-451e-8eb4-3d355f5c8723 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:07.411016 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cb081ec6-4caf-451e-8eb4-3d355f5c8723 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:07.411450 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cb081ec6-4caf-451e-8eb4-3d355f5c8723 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:07.412138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cb081ec6-4caf-451e-8eb4-3d355f5c8723 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:07.412586 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cb081ec6-4caf-451e-8eb4-3d355f5c8723 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:07.413002 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cb081ec6-4caf-451e-8eb4-3d355f5c8723 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:07.438063 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-cb081ec6-4caf-451e-8eb4-3d355f5c8723 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4/ips" status: 200 len: 151 microversion: 2.20 time: 0.039308 Aug 04 23:21:07.438668 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 450/866] 10.222.0.33 () {60 vars in 1289 bytes} [Thu Aug 4 23:21:07 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 23:21:09.735178 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=10 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:21:09.735841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=46 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:21:09.740224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d61014b5-a881-45e6-8bfc-c45d020b0104 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:21:09.740855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d61014b5-a881-45e6-8bfc-c45d020b0104 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:09.747685 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d61014b5-a881-45e6-8bfc-c45d020b0104 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:09.748172 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d61014b5-a881-45e6-8bfc-c45d020b0104 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:09.748636 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d61014b5-a881-45e6-8bfc-c45d020b0104 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:09.749338 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d61014b5-a881-45e6-8bfc-c45d020b0104 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:09.749790 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d61014b5-a881-45e6-8bfc-c45d020b0104 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:09.750215 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d61014b5-a881-45e6-8bfc-c45d020b0104 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:09.775812 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.objects.instance [None req-d61014b5-a881-45e6-8bfc-c45d020b0104 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lazy-loading 'flavor' on Instance uuid 1be84129-cec2-4633-9a4c-de19980d4dd4 {{(pid=129790) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:21:09.959438 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d61014b5-a881-45e6-8bfc-c45d020b0104 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "POST /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4/action" status: 202 len: 0 microversion: 2.20 time: 0.225899 Aug 04 23:21:09.960235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 417/867] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Aug 4 23:21:09 2022] POST /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 23:21:09.968859 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-39ae365e-cb1f-4502-880a-efb1e10fbb2f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:09.969502 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-39ae365e-cb1f-4502-880a-efb1e10fbb2f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:09.976117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39ae365e-cb1f-4502-880a-efb1e10fbb2f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:09.976571 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39ae365e-cb1f-4502-880a-efb1e10fbb2f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:09.977103 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39ae365e-cb1f-4502-880a-efb1e10fbb2f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:09.977798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39ae365e-cb1f-4502-880a-efb1e10fbb2f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:09.978546 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39ae365e-cb1f-4502-880a-efb1e10fbb2f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:09.978972 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39ae365e-cb1f-4502-880a-efb1e10fbb2f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:10.112959 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-39ae365e-cb1f-4502-880a-efb1e10fbb2f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:10.120991 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-39ae365e-cb1f-4502-880a-efb1e10fbb2f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:10.122512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-39ae365e-cb1f-4502-880a-efb1e10fbb2f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:10.123668 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-39ae365e-cb1f-4502-880a-efb1e10fbb2f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1723 microversion: 2.20 time: 0.158897 Aug 04 23:21:10.124209 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 451/868] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:09 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:11.146913 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3d6f3740-a93b-43b1-ae1c-e6ba53ba5bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:11.147610 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3d6f3740-a93b-43b1-ae1c-e6ba53ba5bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:11.154795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d6f3740-a93b-43b1-ae1c-e6ba53ba5bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:11.155121 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d6f3740-a93b-43b1-ae1c-e6ba53ba5bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:11.155556 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d6f3740-a93b-43b1-ae1c-e6ba53ba5bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:11.156259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d6f3740-a93b-43b1-ae1c-e6ba53ba5bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:11.156714 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d6f3740-a93b-43b1-ae1c-e6ba53ba5bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:11.157135 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d6f3740-a93b-43b1-ae1c-e6ba53ba5bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:11.294211 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3d6f3740-a93b-43b1-ae1c-e6ba53ba5bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:11.303589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3d6f3740-a93b-43b1-ae1c-e6ba53ba5bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:11.305068 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3d6f3740-a93b-43b1-ae1c-e6ba53ba5bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:11.306249 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3d6f3740-a93b-43b1-ae1c-e6ba53ba5bd2 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1723 microversion: 2.20 time: 0.164127 Aug 04 23:21:11.306871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 418/869] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:11 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:12.329204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2be9df58-79a2-40d5-9e64-f30a66dea1f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:12.329837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2be9df58-79a2-40d5-9e64-f30a66dea1f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:12.336229 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2be9df58-79a2-40d5-9e64-f30a66dea1f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:12.336706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2be9df58-79a2-40d5-9e64-f30a66dea1f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:12.337404 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2be9df58-79a2-40d5-9e64-f30a66dea1f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:12.338095 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2be9df58-79a2-40d5-9e64-f30a66dea1f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:12.338577 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2be9df58-79a2-40d5-9e64-f30a66dea1f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:12.338999 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2be9df58-79a2-40d5-9e64-f30a66dea1f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:12.341547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=77 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:21:12.480334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2be9df58-79a2-40d5-9e64-f30a66dea1f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:12.489625 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2be9df58-79a2-40d5-9e64-f30a66dea1f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:12.491178 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2be9df58-79a2-40d5-9e64-f30a66dea1f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:12.492379 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2be9df58-79a2-40d5-9e64-f30a66dea1f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1723 microversion: 2.20 time: 0.167151 Aug 04 23:21:12.492937 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 452/870] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:12 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:13.516858 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3c5cb143-2e14-4845-9a3e-62d9ed893967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:13.517445 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3c5cb143-2e14-4845-9a3e-62d9ed893967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:13.523805 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c5cb143-2e14-4845-9a3e-62d9ed893967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:13.524275 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c5cb143-2e14-4845-9a3e-62d9ed893967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:13.524705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c5cb143-2e14-4845-9a3e-62d9ed893967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:13.525388 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c5cb143-2e14-4845-9a3e-62d9ed893967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:13.525832 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c5cb143-2e14-4845-9a3e-62d9ed893967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:13.526245 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c5cb143-2e14-4845-9a3e-62d9ed893967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:13.664396 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3c5cb143-2e14-4845-9a3e-62d9ed893967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:13.673559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3c5cb143-2e14-4845-9a3e-62d9ed893967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:13.675091 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3c5cb143-2e14-4845-9a3e-62d9ed893967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:13.676274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3c5cb143-2e14-4845-9a3e-62d9ed893967 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1723 microversion: 2.20 time: 0.163980 Aug 04 23:21:13.676841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 419/871] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:13 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:14.699929 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-059173fb-84e5-417d-bec3-7c5f686c7d8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:14.700623 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-059173fb-84e5-417d-bec3-7c5f686c7d8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:14.707758 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-059173fb-84e5-417d-bec3-7c5f686c7d8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:14.708234 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-059173fb-84e5-417d-bec3-7c5f686c7d8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:14.708662 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-059173fb-84e5-417d-bec3-7c5f686c7d8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:14.709351 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-059173fb-84e5-417d-bec3-7c5f686c7d8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:14.709799 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-059173fb-84e5-417d-bec3-7c5f686c7d8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:14.710215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-059173fb-84e5-417d-bec3-7c5f686c7d8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:14.850125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-059173fb-84e5-417d-bec3-7c5f686c7d8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:14.859567 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-059173fb-84e5-417d-bec3-7c5f686c7d8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:14.861088 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-059173fb-84e5-417d-bec3-7c5f686c7d8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:14.862219 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-059173fb-84e5-417d-bec3-7c5f686c7d8b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1723 microversion: 2.20 time: 0.166261 Aug 04 23:21:14.862806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 453/872] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:14 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:15.886288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-cb24442f-6c9c-422f-9ef7-ddbe8d5064d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:15.886938 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-cb24442f-6c9c-422f-9ef7-ddbe8d5064d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:15.894033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cb24442f-6c9c-422f-9ef7-ddbe8d5064d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:15.894571 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cb24442f-6c9c-422f-9ef7-ddbe8d5064d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:15.895209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cb24442f-6c9c-422f-9ef7-ddbe8d5064d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:15.895730 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cb24442f-6c9c-422f-9ef7-ddbe8d5064d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:15.896185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cb24442f-6c9c-422f-9ef7-ddbe8d5064d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:15.897111 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cb24442f-6c9c-422f-9ef7-ddbe8d5064d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:16.038701 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-cb24442f-6c9c-422f-9ef7-ddbe8d5064d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:16.047445 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-cb24442f-6c9c-422f-9ef7-ddbe8d5064d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:16.048948 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-cb24442f-6c9c-422f-9ef7-ddbe8d5064d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:16.050157 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-cb24442f-6c9c-422f-9ef7-ddbe8d5064d9 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1723 microversion: 2.20 time: 0.167870 Aug 04 23:21:16.050757 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 420/873] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:15 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:17.073103 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a4cf990f-73fa-4a35-92f3-f7494bdfc4be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:17.073713 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a4cf990f-73fa-4a35-92f3-f7494bdfc4be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:17.080498 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a4cf990f-73fa-4a35-92f3-f7494bdfc4be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:17.080977 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a4cf990f-73fa-4a35-92f3-f7494bdfc4be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:17.081407 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a4cf990f-73fa-4a35-92f3-f7494bdfc4be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:17.082094 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a4cf990f-73fa-4a35-92f3-f7494bdfc4be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:17.082578 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a4cf990f-73fa-4a35-92f3-f7494bdfc4be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:17.082997 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a4cf990f-73fa-4a35-92f3-f7494bdfc4be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:17.214303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a4cf990f-73fa-4a35-92f3-f7494bdfc4be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:17.223440 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a4cf990f-73fa-4a35-92f3-f7494bdfc4be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:17.224925 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a4cf990f-73fa-4a35-92f3-f7494bdfc4be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:17.226353 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a4cf990f-73fa-4a35-92f3-f7494bdfc4be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1723 microversion: 2.20 time: 0.157166 Aug 04 23:21:17.226927 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 454/874] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:17 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:18.254340 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ff73a3c9-3416-411c-84e3-178ddd8546be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:18.254957 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ff73a3c9-3416-411c-84e3-178ddd8546be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:18.261349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff73a3c9-3416-411c-84e3-178ddd8546be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:18.261826 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff73a3c9-3416-411c-84e3-178ddd8546be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:18.262255 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff73a3c9-3416-411c-84e3-178ddd8546be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:18.262966 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff73a3c9-3416-411c-84e3-178ddd8546be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:18.263412 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff73a3c9-3416-411c-84e3-178ddd8546be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:18.263847 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff73a3c9-3416-411c-84e3-178ddd8546be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:18.397147 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ff73a3c9-3416-411c-84e3-178ddd8546be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:18.406320 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ff73a3c9-3416-411c-84e3-178ddd8546be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:18.407851 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ff73a3c9-3416-411c-84e3-178ddd8546be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:18.409037 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ff73a3c9-3416-411c-84e3-178ddd8546be tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1723 microversion: 2.20 time: 0.158651 Aug 04 23:21:18.409589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 421/875] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:18 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:19.434716 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0dd8b0df-10da-43df-b703-63064883809a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:19.435464 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0dd8b0df-10da-43df-b703-63064883809a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:19.442845 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0dd8b0df-10da-43df-b703-63064883809a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:19.443340 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0dd8b0df-10da-43df-b703-63064883809a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:19.443776 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0dd8b0df-10da-43df-b703-63064883809a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:19.444494 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0dd8b0df-10da-43df-b703-63064883809a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:19.444949 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0dd8b0df-10da-43df-b703-63064883809a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:19.445371 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0dd8b0df-10da-43df-b703-63064883809a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:19.595628 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0dd8b0df-10da-43df-b703-63064883809a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:19.604223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0dd8b0df-10da-43df-b703-63064883809a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:19.605721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0dd8b0df-10da-43df-b703-63064883809a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:19.606906 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0dd8b0df-10da-43df-b703-63064883809a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1723 microversion: 2.20 time: 0.176614 Aug 04 23:21:19.607459 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 455/876] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:19 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:20.630681 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-64641c36-9ca8-47bf-b117-5ffd1aa9494c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:20.631244 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-64641c36-9ca8-47bf-b117-5ffd1aa9494c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:20.637882 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64641c36-9ca8-47bf-b117-5ffd1aa9494c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:20.638351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64641c36-9ca8-47bf-b117-5ffd1aa9494c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:20.638841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64641c36-9ca8-47bf-b117-5ffd1aa9494c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:20.640169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64641c36-9ca8-47bf-b117-5ffd1aa9494c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:20.640625 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64641c36-9ca8-47bf-b117-5ffd1aa9494c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:20.641054 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64641c36-9ca8-47bf-b117-5ffd1aa9494c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:20.782993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-64641c36-9ca8-47bf-b117-5ffd1aa9494c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:20.791061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-64641c36-9ca8-47bf-b117-5ffd1aa9494c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:20.792566 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-64641c36-9ca8-47bf-b117-5ffd1aa9494c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:20.793725 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-64641c36-9ca8-47bf-b117-5ffd1aa9494c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1723 microversion: 2.20 time: 0.167141 Aug 04 23:21:20.794290 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 422/877] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:20 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:21.824042 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-110ff924-2d7a-463c-ae19-154c408043a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:21.825123 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-110ff924-2d7a-463c-ae19-154c408043a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:21.838376 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-110ff924-2d7a-463c-ae19-154c408043a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:21.839286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-110ff924-2d7a-463c-ae19-154c408043a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:21.840073 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-110ff924-2d7a-463c-ae19-154c408043a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:21.841355 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-110ff924-2d7a-463c-ae19-154c408043a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:21.842860 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-110ff924-2d7a-463c-ae19-154c408043a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:21.843660 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-110ff924-2d7a-463c-ae19-154c408043a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:21.991256 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-110ff924-2d7a-463c-ae19-154c408043a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:22.000681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-110ff924-2d7a-463c-ae19-154c408043a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:22.002194 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-110ff924-2d7a-463c-ae19-154c408043a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:22.003416 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-110ff924-2d7a-463c-ae19-154c408043a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1744 microversion: 2.20 time: 0.186772 Aug 04 23:21:22.003971 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 456/878] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:21 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1744 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:23.027996 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-10390778-f64b-4f1f-adb8-627b163f879a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:23.028604 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-10390778-f64b-4f1f-adb8-627b163f879a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:23.036020 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10390778-f64b-4f1f-adb8-627b163f879a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:23.036507 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10390778-f64b-4f1f-adb8-627b163f879a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:23.036938 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10390778-f64b-4f1f-adb8-627b163f879a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:23.037659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10390778-f64b-4f1f-adb8-627b163f879a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:23.038113 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10390778-f64b-4f1f-adb8-627b163f879a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:23.038585 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10390778-f64b-4f1f-adb8-627b163f879a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:23.178903 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-10390778-f64b-4f1f-adb8-627b163f879a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:23.188079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-10390778-f64b-4f1f-adb8-627b163f879a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:23.189586 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-10390778-f64b-4f1f-adb8-627b163f879a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:23.190767 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-10390778-f64b-4f1f-adb8-627b163f879a tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1744 microversion: 2.20 time: 0.166778 Aug 04 23:21:23.191317 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 423/879] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:23 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:23.391028 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:21:23.391628 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:21:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:21:24.215239 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d9e8a67e-b541-4659-a1c4-cfd2e51bfaa1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:24.215845 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d9e8a67e-b541-4659-a1c4-cfd2e51bfaa1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:24.222947 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d9e8a67e-b541-4659-a1c4-cfd2e51bfaa1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:24.223426 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d9e8a67e-b541-4659-a1c4-cfd2e51bfaa1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:24.223864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d9e8a67e-b541-4659-a1c4-cfd2e51bfaa1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:24.224562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d9e8a67e-b541-4659-a1c4-cfd2e51bfaa1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:24.225014 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d9e8a67e-b541-4659-a1c4-cfd2e51bfaa1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:24.225435 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d9e8a67e-b541-4659-a1c4-cfd2e51bfaa1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:24.366846 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d9e8a67e-b541-4659-a1c4-cfd2e51bfaa1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:24.376105 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d9e8a67e-b541-4659-a1c4-cfd2e51bfaa1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:24.377601 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d9e8a67e-b541-4659-a1c4-cfd2e51bfaa1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:24.378804 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d9e8a67e-b541-4659-a1c4-cfd2e51bfaa1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1744 microversion: 2.20 time: 0.168188 Aug 04 23:21:24.379361 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 457/880] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:24 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:21:25.402843 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e2443f23-73ee-4ae4-b2f7-effbffd7f52e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:25.403506 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e2443f23-73ee-4ae4-b2f7-effbffd7f52e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:25.414064 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2443f23-73ee-4ae4-b2f7-effbffd7f52e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:25.414603 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2443f23-73ee-4ae4-b2f7-effbffd7f52e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:25.415041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2443f23-73ee-4ae4-b2f7-effbffd7f52e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:25.415755 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2443f23-73ee-4ae4-b2f7-effbffd7f52e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:25.416212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2443f23-73ee-4ae4-b2f7-effbffd7f52e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:25.416636 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2443f23-73ee-4ae4-b2f7-effbffd7f52e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:25.556528 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e2443f23-73ee-4ae4-b2f7-effbffd7f52e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:25.565675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e2443f23-73ee-4ae4-b2f7-effbffd7f52e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:25.567219 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e2443f23-73ee-4ae4-b2f7-effbffd7f52e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:25.568428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e2443f23-73ee-4ae4-b2f7-effbffd7f52e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1744 microversion: 2.20 time: 0.170626 Aug 04 23:21:25.568981 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 424/881] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:25 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:25.648809 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-5966aebe-dbc8-4899-ab02-06e6e68570bf req-a2c2c94d-cf51-40ec-986c-6b55bec8805f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be84129-cec2-4633-9a4c-de19980d4dd4", "name": "network-vif-plugged", "status": "completed", "tag": "dfb89816-563a-4deb-9f3f-e2414e3b9eeb"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:21:25.660633 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-5966aebe-dbc8-4899-ab02-06e6e68570bf req-a2c2c94d-cf51-40ec-986c-6b55bec8805f service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:25.661121 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-5966aebe-dbc8-4899-ab02-06e6e68570bf req-a2c2c94d-cf51-40ec-986c-6b55bec8805f service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:25.661552 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-5966aebe-dbc8-4899-ab02-06e6e68570bf req-a2c2c94d-cf51-40ec-986c-6b55bec8805f service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:25.673959 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-5966aebe-dbc8-4899-ab02-06e6e68570bf req-a2c2c94d-cf51-40ec-986c-6b55bec8805f service nova] Creating event network-vif-plugged:dfb89816-563a-4deb-9f3f-e2414e3b9eeb for instance 1be84129-cec2-4633-9a4c-de19980d4dd4 on hv-cinder-85221 Aug 04 23:21:25.679827 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-5966aebe-dbc8-4899-ab02-06e6e68570bf req-a2c2c94d-cf51-40ec-986c-6b55bec8805f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035104 Aug 04 23:21:25.680487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 458/882] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:21:26.593023 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4e28bdf3-7414-4edd-b592-7bf0f0ad5dc8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:26.593714 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4e28bdf3-7414-4edd-b592-7bf0f0ad5dc8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:26.601399 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e28bdf3-7414-4edd-b592-7bf0f0ad5dc8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:26.601876 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e28bdf3-7414-4edd-b592-7bf0f0ad5dc8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:26.602310 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e28bdf3-7414-4edd-b592-7bf0f0ad5dc8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:26.603069 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e28bdf3-7414-4edd-b592-7bf0f0ad5dc8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:26.603524 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e28bdf3-7414-4edd-b592-7bf0f0ad5dc8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:26.603948 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e28bdf3-7414-4edd-b592-7bf0f0ad5dc8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:26.756752 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4e28bdf3-7414-4edd-b592-7bf0f0ad5dc8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:26.765220 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4e28bdf3-7414-4edd-b592-7bf0f0ad5dc8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:26.766756 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4e28bdf3-7414-4edd-b592-7bf0f0ad5dc8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:26.767945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4e28bdf3-7414-4edd-b592-7bf0f0ad5dc8 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1744 microversion: 2.20 time: 0.179856 Aug 04 23:21:26.768526 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 425/883] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:26 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1744 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:21:27.792016 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-17a9830c-8501-4439-93dd-1346e871bc29 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:27.792757 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-17a9830c-8501-4439-93dd-1346e871bc29 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:27.800452 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-17a9830c-8501-4439-93dd-1346e871bc29 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:27.800936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-17a9830c-8501-4439-93dd-1346e871bc29 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:27.801368 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-17a9830c-8501-4439-93dd-1346e871bc29 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:27.802070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-17a9830c-8501-4439-93dd-1346e871bc29 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:27.802550 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-17a9830c-8501-4439-93dd-1346e871bc29 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:27.802971 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-17a9830c-8501-4439-93dd-1346e871bc29 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:27.960059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-17a9830c-8501-4439-93dd-1346e871bc29 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:27.969689 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-17a9830c-8501-4439-93dd-1346e871bc29 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:27.971131 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-17a9830c-8501-4439-93dd-1346e871bc29 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:27.972305 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-17a9830c-8501-4439-93dd-1346e871bc29 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1744 microversion: 2.20 time: 0.184676 Aug 04 23:21:27.972864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 459/884] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:27 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1744 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:28.996555 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-647fe148-6844-4024-be39-2483f53fe5f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:28.997241 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-647fe148-6844-4024-be39-2483f53fe5f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:29.007690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-647fe148-6844-4024-be39-2483f53fe5f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:29.008617 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-647fe148-6844-4024-be39-2483f53fe5f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:29.009316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-647fe148-6844-4024-be39-2483f53fe5f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:29.010628 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-647fe148-6844-4024-be39-2483f53fe5f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:29.010876 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-647fe148-6844-4024-be39-2483f53fe5f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:29.011375 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-647fe148-6844-4024-be39-2483f53fe5f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:29.204951 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-647fe148-6844-4024-be39-2483f53fe5f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:29.216037 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-647fe148-6844-4024-be39-2483f53fe5f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:29.218876 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-647fe148-6844-4024-be39-2483f53fe5f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:29.220384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-647fe148-6844-4024-be39-2483f53fe5f4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1739 microversion: 2.20 time: 0.228293 Aug 04 23:21:29.234778 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 426/885] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:28 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:21:30.245255 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b7c39ca8-4b7d-43a1-a089-773ad4988482 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:30.246113 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b7c39ca8-4b7d-43a1-a089-773ad4988482 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:30.250950 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=22 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:21:30.256336 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b7c39ca8-4b7d-43a1-a089-773ad4988482 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:30.257221 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b7c39ca8-4b7d-43a1-a089-773ad4988482 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:30.257994 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b7c39ca8-4b7d-43a1-a089-773ad4988482 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:30.259065 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b7c39ca8-4b7d-43a1-a089-773ad4988482 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:30.259826 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b7c39ca8-4b7d-43a1-a089-773ad4988482 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:30.260535 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b7c39ca8-4b7d-43a1-a089-773ad4988482 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:30.470469 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b7c39ca8-4b7d-43a1-a089-773ad4988482 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:30.494145 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b7c39ca8-4b7d-43a1-a089-773ad4988482 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:30.496528 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b7c39ca8-4b7d-43a1-a089-773ad4988482 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:30.499457 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b7c39ca8-4b7d-43a1-a089-773ad4988482 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1739 microversion: 2.20 time: 0.257976 Aug 04 23:21:30.518858 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 460/886] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:30 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1739 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:21:31.539558 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a7b32599-97a6-4a56-819e-c40eba573e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:31.540728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a7b32599-97a6-4a56-819e-c40eba573e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:31.554257 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a7b32599-97a6-4a56-819e-c40eba573e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:31.555541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a7b32599-97a6-4a56-819e-c40eba573e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:31.555967 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a7b32599-97a6-4a56-819e-c40eba573e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:31.557274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a7b32599-97a6-4a56-819e-c40eba573e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:31.558097 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a7b32599-97a6-4a56-819e-c40eba573e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:31.559559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a7b32599-97a6-4a56-819e-c40eba573e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:31.762393 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a7b32599-97a6-4a56-819e-c40eba573e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:31.782077 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a7b32599-97a6-4a56-819e-c40eba573e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:31.785739 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a7b32599-97a6-4a56-819e-c40eba573e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:31.792682 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a7b32599-97a6-4a56-819e-c40eba573e90 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1739 microversion: 2.20 time: 0.258193 Aug 04 23:21:31.805243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 427/887] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:31 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1739 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:32.843001 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9f6ef007-b898-40fb-99c7-5b27e5a68dce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:32.845056 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9f6ef007-b898-40fb-99c7-5b27e5a68dce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:32.857609 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9f6ef007-b898-40fb-99c7-5b27e5a68dce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:32.858683 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9f6ef007-b898-40fb-99c7-5b27e5a68dce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:32.859749 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9f6ef007-b898-40fb-99c7-5b27e5a68dce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:32.861014 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9f6ef007-b898-40fb-99c7-5b27e5a68dce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:32.861841 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9f6ef007-b898-40fb-99c7-5b27e5a68dce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:32.862413 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9f6ef007-b898-40fb-99c7-5b27e5a68dce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:33.083781 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9f6ef007-b898-40fb-99c7-5b27e5a68dce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:33.095416 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9f6ef007-b898-40fb-99c7-5b27e5a68dce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:33.097208 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9f6ef007-b898-40fb-99c7-5b27e5a68dce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:33.099416 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9f6ef007-b898-40fb-99c7-5b27e5a68dce tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1739 microversion: 2.20 time: 0.264854 Aug 04 23:21:33.111204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 461/888] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:32 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1739 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:34.128994 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-31615cf0-a892-4cfa-adf3-ecfe83023ad3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:34.129896 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-31615cf0-a892-4cfa-adf3-ecfe83023ad3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:34.140609 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31615cf0-a892-4cfa-adf3-ecfe83023ad3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:34.141106 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31615cf0-a892-4cfa-adf3-ecfe83023ad3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:34.141540 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31615cf0-a892-4cfa-adf3-ecfe83023ad3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:34.142280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31615cf0-a892-4cfa-adf3-ecfe83023ad3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:34.142763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31615cf0-a892-4cfa-adf3-ecfe83023ad3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:34.143186 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31615cf0-a892-4cfa-adf3-ecfe83023ad3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:34.339274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-31615cf0-a892-4cfa-adf3-ecfe83023ad3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:34.352651 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-31615cf0-a892-4cfa-adf3-ecfe83023ad3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:34.354804 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-31615cf0-a892-4cfa-adf3-ecfe83023ad3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:34.356298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-31615cf0-a892-4cfa-adf3-ecfe83023ad3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1739 microversion: 2.20 time: 0.233549 Aug 04 23:21:34.356853 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 428/889] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:34 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:35.393113 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-227e815b-cc7d-40fe-8ccc-f924e68245ca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:35.393962 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-227e815b-cc7d-40fe-8ccc-f924e68245ca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:35.408831 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-227e815b-cc7d-40fe-8ccc-f924e68245ca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:35.410152 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-227e815b-cc7d-40fe-8ccc-f924e68245ca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:35.410777 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-227e815b-cc7d-40fe-8ccc-f924e68245ca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:35.411622 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-227e815b-cc7d-40fe-8ccc-f924e68245ca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:35.412552 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-227e815b-cc7d-40fe-8ccc-f924e68245ca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:35.413138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-227e815b-cc7d-40fe-8ccc-f924e68245ca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:35.620903 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-227e815b-cc7d-40fe-8ccc-f924e68245ca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:35.641482 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-227e815b-cc7d-40fe-8ccc-f924e68245ca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:35.643261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-227e815b-cc7d-40fe-8ccc-f924e68245ca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:35.644535 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-227e815b-cc7d-40fe-8ccc-f924e68245ca tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1739 microversion: 2.20 time: 0.261863 Aug 04 23:21:35.649729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 462/890] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:35 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1739 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:36.671132 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b0a9c003-ca5b-45c9-8a84-51bf1186374b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:36.672079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b0a9c003-ca5b-45c9-8a84-51bf1186374b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:36.679982 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0a9c003-ca5b-45c9-8a84-51bf1186374b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:36.680496 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0a9c003-ca5b-45c9-8a84-51bf1186374b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:36.680949 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0a9c003-ca5b-45c9-8a84-51bf1186374b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:36.681693 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0a9c003-ca5b-45c9-8a84-51bf1186374b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:36.682305 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0a9c003-ca5b-45c9-8a84-51bf1186374b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:36.682970 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0a9c003-ca5b-45c9-8a84-51bf1186374b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:36.892865 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b0a9c003-ca5b-45c9-8a84-51bf1186374b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:36.919402 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b0a9c003-ca5b-45c9-8a84-51bf1186374b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:36.925036 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b0a9c003-ca5b-45c9-8a84-51bf1186374b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:36.926186 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b0a9c003-ca5b-45c9-8a84-51bf1186374b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1739 microversion: 2.20 time: 0.261556 Aug 04 23:21:36.927316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 429/891] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:36 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1739 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:37.964617 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4133238f-56f8-41a4-9135-3feaea8c3323 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:37.965521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4133238f-56f8-41a4-9135-3feaea8c3323 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:37.975072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4133238f-56f8-41a4-9135-3feaea8c3323 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:37.975559 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4133238f-56f8-41a4-9135-3feaea8c3323 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:37.975983 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4133238f-56f8-41a4-9135-3feaea8c3323 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:37.976751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4133238f-56f8-41a4-9135-3feaea8c3323 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:37.977195 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4133238f-56f8-41a4-9135-3feaea8c3323 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:37.977608 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4133238f-56f8-41a4-9135-3feaea8c3323 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:38.174725 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4133238f-56f8-41a4-9135-3feaea8c3323 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:38.187731 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4133238f-56f8-41a4-9135-3feaea8c3323 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:38.190672 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4133238f-56f8-41a4-9135-3feaea8c3323 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:38.193284 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4133238f-56f8-41a4-9135-3feaea8c3323 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1739 microversion: 2.20 time: 0.237863 Aug 04 23:21:38.210943 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 463/892] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:37 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:39.222249 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a24b2b7e-548e-405c-8bcc-f6552f5a8e53 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:39.223176 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a24b2b7e-548e-405c-8bcc-f6552f5a8e53 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:39.229697 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a24b2b7e-548e-405c-8bcc-f6552f5a8e53 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:39.230196 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a24b2b7e-548e-405c-8bcc-f6552f5a8e53 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:39.230668 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a24b2b7e-548e-405c-8bcc-f6552f5a8e53 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:39.231398 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a24b2b7e-548e-405c-8bcc-f6552f5a8e53 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:39.231855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a24b2b7e-548e-405c-8bcc-f6552f5a8e53 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:39.232969 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a24b2b7e-548e-405c-8bcc-f6552f5a8e53 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:39.372312 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a24b2b7e-548e-405c-8bcc-f6552f5a8e53 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:39.381550 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a24b2b7e-548e-405c-8bcc-f6552f5a8e53 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:39.383129 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a24b2b7e-548e-405c-8bcc-f6552f5a8e53 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:39.384307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a24b2b7e-548e-405c-8bcc-f6552f5a8e53 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1739 microversion: 2.20 time: 0.166267 Aug 04 23:21:39.384874 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 430/893] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:39 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:21:40.407505 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-dd43a6d0-096d-4204-9a48-6a8b29cb3114 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:40.408287 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-dd43a6d0-096d-4204-9a48-6a8b29cb3114 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:40.415700 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd43a6d0-096d-4204-9a48-6a8b29cb3114 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:40.416299 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd43a6d0-096d-4204-9a48-6a8b29cb3114 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:40.416816 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd43a6d0-096d-4204-9a48-6a8b29cb3114 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:40.417631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd43a6d0-096d-4204-9a48-6a8b29cb3114 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:40.418169 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd43a6d0-096d-4204-9a48-6a8b29cb3114 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:40.418727 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd43a6d0-096d-4204-9a48-6a8b29cb3114 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:40.565004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-dd43a6d0-096d-4204-9a48-6a8b29cb3114 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:40.573759 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-dd43a6d0-096d-4204-9a48-6a8b29cb3114 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:40.575284 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-dd43a6d0-096d-4204-9a48-6a8b29cb3114 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:40.577140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-dd43a6d0-096d-4204-9a48-6a8b29cb3114 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1721 microversion: 2.20 time: 0.173357 Aug 04 23:21:40.577702 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 464/894] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:40 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:41.601370 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e77fb462-0a3d-4a6f-87d0-d55544006a66 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:41.602223 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e77fb462-0a3d-4a6f-87d0-d55544006a66 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:41.604858 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=29 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:21:41.611192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e77fb462-0a3d-4a6f-87d0-d55544006a66 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:41.611679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e77fb462-0a3d-4a6f-87d0-d55544006a66 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:41.612116 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e77fb462-0a3d-4a6f-87d0-d55544006a66 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:41.612837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e77fb462-0a3d-4a6f-87d0-d55544006a66 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:41.613288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e77fb462-0a3d-4a6f-87d0-d55544006a66 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:41.613709 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e77fb462-0a3d-4a6f-87d0-d55544006a66 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:41.616804 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:21:41.679686 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-92f76d46-1114-4934-aeb3-4837d289b4fe req-4d40385b-84cb-4e45-ab54-8344520f1a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be84129-cec2-4633-9a4c-de19980d4dd4", "name": "network-vif-unplugged", "status": "completed", "tag": "dfb89816-563a-4deb-9f3f-e2414e3b9eeb"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:21:41.698102 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-92f76d46-1114-4934-aeb3-4837d289b4fe req-4d40385b-84cb-4e45-ab54-8344520f1a5e service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:41.698632 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-92f76d46-1114-4934-aeb3-4837d289b4fe req-4d40385b-84cb-4e45-ab54-8344520f1a5e service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:41.699071 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-92f76d46-1114-4934-aeb3-4837d289b4fe req-4d40385b-84cb-4e45-ab54-8344520f1a5e service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:41.715808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-92f76d46-1114-4934-aeb3-4837d289b4fe req-4d40385b-84cb-4e45-ab54-8344520f1a5e service nova] Creating event network-vif-unplugged:dfb89816-563a-4deb-9f3f-e2414e3b9eeb for instance 1be84129-cec2-4633-9a4c-de19980d4dd4 on hv-cinder-85221 Aug 04 23:21:41.724380 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-92f76d46-1114-4934-aeb3-4837d289b4fe req-4d40385b-84cb-4e45-ab54-8344520f1a5e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048077 Aug 04 23:21:41.725537 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 465/895] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:21:41.788851 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e77fb462-0a3d-4a6f-87d0-d55544006a66 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:41.799714 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e77fb462-0a3d-4a6f-87d0-d55544006a66 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:41.801422 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e77fb462-0a3d-4a6f-87d0-d55544006a66 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:41.802949 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e77fb462-0a3d-4a6f-87d0-d55544006a66 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1721 microversion: 2.20 time: 0.205573 Aug 04 23:21:41.803621 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 431/896] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:41 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:21:42.829332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-22b166b3-64d2-41fb-96bb-51219482f5d1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:42.830128 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-22b166b3-64d2-41fb-96bb-51219482f5d1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:42.840320 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-22b166b3-64d2-41fb-96bb-51219482f5d1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:42.841219 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-22b166b3-64d2-41fb-96bb-51219482f5d1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:42.841976 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-22b166b3-64d2-41fb-96bb-51219482f5d1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:42.843809 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-22b166b3-64d2-41fb-96bb-51219482f5d1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:42.844605 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-22b166b3-64d2-41fb-96bb-51219482f5d1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:42.845412 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-22b166b3-64d2-41fb-96bb-51219482f5d1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:42.853284 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=76 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:21:43.009764 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-22b166b3-64d2-41fb-96bb-51219482f5d1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:43.019343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-22b166b3-64d2-41fb-96bb-51219482f5d1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:43.020837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-22b166b3-64d2-41fb-96bb-51219482f5d1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:43.022002 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-22b166b3-64d2-41fb-96bb-51219482f5d1 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1664 microversion: 2.20 time: 0.198316 Aug 04 23:21:43.022581 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 466/897] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:42 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1664 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:21:43.048037 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-358948ad-06fc-451d-9605-d203c5fb3abf tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48322253-b3c6-4547-b732-8a89b6e78aa5"}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:21:43.050348 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-358948ad-06fc-451d-9605-d203c5fb3abf tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:43.057050 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-358948ad-06fc-451d-9605-d203c5fb3abf tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:43.057533 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-358948ad-06fc-451d-9605-d203c5fb3abf tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:43.057965 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-358948ad-06fc-451d-9605-d203c5fb3abf tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:43.058703 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-358948ad-06fc-451d-9605-d203c5fb3abf tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:43.059155 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-358948ad-06fc-451d-9605-d203c5fb3abf tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:43.059665 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-358948ad-06fc-451d-9605-d203c5fb3abf tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:43.379218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-358948ad-06fc-451d-9605-d203c5fb3abf tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "POST /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.336103 Aug 04 23:21:43.379834 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 432/898] 10.222.0.33 () {62 vars in 1364 bytes} [Thu Aug 4 23:21:43 2022] POST /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4/os-volume_attachments => generated 188 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 23:21:43.522072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-dd8fde81-60dd-45ff-b8cf-40c0f6eb0337 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:43.522510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-dd8fde81-60dd-45ff-b8cf-40c0f6eb0337 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:43.530878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd8fde81-60dd-45ff-b8cf-40c0f6eb0337 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:43.531576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd8fde81-60dd-45ff-b8cf-40c0f6eb0337 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:43.532108 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd8fde81-60dd-45ff-b8cf-40c0f6eb0337 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:43.532900 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd8fde81-60dd-45ff-b8cf-40c0f6eb0337 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:43.533405 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd8fde81-60dd-45ff-b8cf-40c0f6eb0337 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:43.533882 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd8fde81-60dd-45ff-b8cf-40c0f6eb0337 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:43.817435 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-dd8fde81-60dd-45ff-b8cf-40c0f6eb0337 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4/os-volume_attachments/48322253-b3c6-4547-b732-8a89b6e78aa5" status: 202 len: 0 microversion: 2.20 time: 0.304763 Aug 04 23:21:43.818043 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 467/899] 10.222.0.33 () {60 vars in 1457 bytes} [Thu Aug 4 23:21:43 2022] DELETE /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4/os-volume_attachments/48322253-b3c6-4547-b732-8a89b6e78aa5 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 23:21:43.892934 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4690b049-c606-4b81-be38-c7e62951163d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:21:43.893525 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4690b049-c606-4b81-be38-c7e62951163d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:43.899929 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4690b049-c606-4b81-be38-c7e62951163d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:43.900420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4690b049-c606-4b81-be38-c7e62951163d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:43.900853 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4690b049-c606-4b81-be38-c7e62951163d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:43.901557 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4690b049-c606-4b81-be38-c7e62951163d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:43.902010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4690b049-c606-4b81-be38-c7e62951163d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:43.902454 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4690b049-c606-4b81-be38-c7e62951163d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:43.952152 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4690b049-c606-4b81-be38-c7e62951163d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129790) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 23:21:44.024978 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4690b049-c606-4b81-be38-c7e62951163d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "POST /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4/action" status: 202 len: 0 microversion: 2.20 time: 0.135936 Aug 04 23:21:44.025589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 433/900] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Aug 4 23:21:43 2022] POST /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 04 23:21:44.035138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f512e88d-820e-4a5e-940d-aea03cd770e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:44.036044 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f512e88d-820e-4a5e-940d-aea03cd770e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:44.044107 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f512e88d-820e-4a5e-940d-aea03cd770e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:44.045746 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f512e88d-820e-4a5e-940d-aea03cd770e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:44.046183 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f512e88d-820e-4a5e-940d-aea03cd770e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:44.047132 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f512e88d-820e-4a5e-940d-aea03cd770e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:44.047699 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f512e88d-820e-4a5e-940d-aea03cd770e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:44.048111 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f512e88d-820e-4a5e-940d-aea03cd770e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:44.255504 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f512e88d-820e-4a5e-940d-aea03cd770e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:44.267629 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f512e88d-820e-4a5e-940d-aea03cd770e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:44.269598 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f512e88d-820e-4a5e-940d-aea03cd770e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:44.271131 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f512e88d-820e-4a5e-940d-aea03cd770e3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1672 microversion: 2.20 time: 0.240652 Aug 04 23:21:44.272039 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 468/901] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:44 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1672 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:21:45.296912 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3c4c81e3-a9e4-452f-b6be-8267d42923d4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:45.297703 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3c4c81e3-a9e4-452f-b6be-8267d42923d4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:45.303725 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c4c81e3-a9e4-452f-b6be-8267d42923d4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:45.304292 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c4c81e3-a9e4-452f-b6be-8267d42923d4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:45.304732 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c4c81e3-a9e4-452f-b6be-8267d42923d4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:45.305470 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c4c81e3-a9e4-452f-b6be-8267d42923d4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:45.306035 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c4c81e3-a9e4-452f-b6be-8267d42923d4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:45.306665 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c4c81e3-a9e4-452f-b6be-8267d42923d4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:45.460528 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3c4c81e3-a9e4-452f-b6be-8267d42923d4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:45.474934 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3c4c81e3-a9e4-452f-b6be-8267d42923d4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:45.476768 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3c4c81e3-a9e4-452f-b6be-8267d42923d4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:45.478048 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3c4c81e3-a9e4-452f-b6be-8267d42923d4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1730 microversion: 2.20 time: 0.185776 Aug 04 23:21:45.478713 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 434/902] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:45 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:46.502078 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d63d6dd2-510c-40d4-a608-da804cba0fb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:46.503357 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d63d6dd2-510c-40d4-a608-da804cba0fb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:46.512600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d63d6dd2-510c-40d4-a608-da804cba0fb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:46.513136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d63d6dd2-510c-40d4-a608-da804cba0fb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:46.513817 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d63d6dd2-510c-40d4-a608-da804cba0fb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:46.514675 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d63d6dd2-510c-40d4-a608-da804cba0fb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:46.515144 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d63d6dd2-510c-40d4-a608-da804cba0fb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:46.515644 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d63d6dd2-510c-40d4-a608-da804cba0fb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:46.692485 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d63d6dd2-510c-40d4-a608-da804cba0fb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:46.701832 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d63d6dd2-510c-40d4-a608-da804cba0fb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:46.703765 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d63d6dd2-510c-40d4-a608-da804cba0fb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:46.705178 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d63d6dd2-510c-40d4-a608-da804cba0fb7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1730 microversion: 2.20 time: 0.207833 Aug 04 23:21:46.705785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 469/903] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:46 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1730 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:47.730121 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4bc0bed3-c2ed-4fd9-b918-e5281366c5a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:47.731356 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4bc0bed3-c2ed-4fd9-b918-e5281366c5a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:47.743361 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4bc0bed3-c2ed-4fd9-b918-e5281366c5a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:47.743863 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4bc0bed3-c2ed-4fd9-b918-e5281366c5a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:47.744319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4bc0bed3-c2ed-4fd9-b918-e5281366c5a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:47.745023 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4bc0bed3-c2ed-4fd9-b918-e5281366c5a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:47.745473 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4bc0bed3-c2ed-4fd9-b918-e5281366c5a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:47.745951 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4bc0bed3-c2ed-4fd9-b918-e5281366c5a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:47.899431 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4bc0bed3-c2ed-4fd9-b918-e5281366c5a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:47.908379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4bc0bed3-c2ed-4fd9-b918-e5281366c5a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:47.909906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4bc0bed3-c2ed-4fd9-b918-e5281366c5a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:47.911133 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4bc0bed3-c2ed-4fd9-b918-e5281366c5a3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1730 microversion: 2.20 time: 0.185406 Aug 04 23:21:47.911904 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 435/904] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:47 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:48.935263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2b56aff0-6dd5-46fe-8cab-c3fef4b4ab12 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:48.936851 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2b56aff0-6dd5-46fe-8cab-c3fef4b4ab12 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:48.944395 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2b56aff0-6dd5-46fe-8cab-c3fef4b4ab12 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:48.944931 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2b56aff0-6dd5-46fe-8cab-c3fef4b4ab12 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:48.945362 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2b56aff0-6dd5-46fe-8cab-c3fef4b4ab12 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:48.946056 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2b56aff0-6dd5-46fe-8cab-c3fef4b4ab12 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:48.946535 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2b56aff0-6dd5-46fe-8cab-c3fef4b4ab12 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:48.946950 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2b56aff0-6dd5-46fe-8cab-c3fef4b4ab12 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:49.105618 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2b56aff0-6dd5-46fe-8cab-c3fef4b4ab12 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:49.116222 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2b56aff0-6dd5-46fe-8cab-c3fef4b4ab12 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:49.117732 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2b56aff0-6dd5-46fe-8cab-c3fef4b4ab12 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:49.118938 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2b56aff0-6dd5-46fe-8cab-c3fef4b4ab12 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1730 microversion: 2.20 time: 0.187643 Aug 04 23:21:49.119552 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 470/905] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:48 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:50.164053 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c40c9b80-83ff-4812-853d-431ac2ec7328 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:50.165021 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c40c9b80-83ff-4812-853d-431ac2ec7328 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:50.177375 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c40c9b80-83ff-4812-853d-431ac2ec7328 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:50.178229 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c40c9b80-83ff-4812-853d-431ac2ec7328 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:50.179004 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c40c9b80-83ff-4812-853d-431ac2ec7328 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:50.180219 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c40c9b80-83ff-4812-853d-431ac2ec7328 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:50.181040 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c40c9b80-83ff-4812-853d-431ac2ec7328 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:50.181790 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c40c9b80-83ff-4812-853d-431ac2ec7328 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:50.408968 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c40c9b80-83ff-4812-853d-431ac2ec7328 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:50.424754 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c40c9b80-83ff-4812-853d-431ac2ec7328 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:50.428106 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c40c9b80-83ff-4812-853d-431ac2ec7328 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:50.430159 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c40c9b80-83ff-4812-853d-431ac2ec7328 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1730 microversion: 2.20 time: 0.273191 Aug 04 23:21:50.442131 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 436/906] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:50 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1730 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:51.470013 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-460cb793-ca4d-4a27-8d1a-2a4f50c47868 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:51.470684 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-460cb793-ca4d-4a27-8d1a-2a4f50c47868 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:51.477555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-460cb793-ca4d-4a27-8d1a-2a4f50c47868 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:51.478044 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-460cb793-ca4d-4a27-8d1a-2a4f50c47868 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:51.478525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-460cb793-ca4d-4a27-8d1a-2a4f50c47868 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:51.479248 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-460cb793-ca4d-4a27-8d1a-2a4f50c47868 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:51.479681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-460cb793-ca4d-4a27-8d1a-2a4f50c47868 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:51.480102 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-460cb793-ca4d-4a27-8d1a-2a4f50c47868 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:51.665793 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-460cb793-ca4d-4a27-8d1a-2a4f50c47868 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:51.676035 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-460cb793-ca4d-4a27-8d1a-2a4f50c47868 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:51.677794 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-460cb793-ca4d-4a27-8d1a-2a4f50c47868 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:51.679135 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-460cb793-ca4d-4a27-8d1a-2a4f50c47868 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1730 microversion: 2.20 time: 0.213837 Aug 04 23:21:51.680104 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 471/907] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:51 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1730 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:52.704101 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ff5d746e-56f9-4de2-8418-baaf06cae3f3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:52.705839 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ff5d746e-56f9-4de2-8418-baaf06cae3f3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:52.723676 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff5d746e-56f9-4de2-8418-baaf06cae3f3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:52.724245 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff5d746e-56f9-4de2-8418-baaf06cae3f3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:52.724798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff5d746e-56f9-4de2-8418-baaf06cae3f3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:52.725768 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff5d746e-56f9-4de2-8418-baaf06cae3f3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:52.726563 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff5d746e-56f9-4de2-8418-baaf06cae3f3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:52.727259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ff5d746e-56f9-4de2-8418-baaf06cae3f3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:52.900414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ff5d746e-56f9-4de2-8418-baaf06cae3f3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:52.912163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ff5d746e-56f9-4de2-8418-baaf06cae3f3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:52.913787 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ff5d746e-56f9-4de2-8418-baaf06cae3f3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:52.915100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ff5d746e-56f9-4de2-8418-baaf06cae3f3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1730 microversion: 2.20 time: 0.215637 Aug 04 23:21:52.915962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 437/908] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:52 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1730 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:53.941194 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a8120f02-3c8c-4b6b-aa0f-971cc77591a6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:53.946016 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a8120f02-3c8c-4b6b-aa0f-971cc77591a6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:53.949114 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8120f02-3c8c-4b6b-aa0f-971cc77591a6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:53.949701 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8120f02-3c8c-4b6b-aa0f-971cc77591a6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:53.950192 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8120f02-3c8c-4b6b-aa0f-971cc77591a6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:53.951518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8120f02-3c8c-4b6b-aa0f-971cc77591a6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:53.952128 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8120f02-3c8c-4b6b-aa0f-971cc77591a6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:53.952555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8120f02-3c8c-4b6b-aa0f-971cc77591a6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:54.112720 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a8120f02-3c8c-4b6b-aa0f-971cc77591a6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:54.121194 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a8120f02-3c8c-4b6b-aa0f-971cc77591a6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:54.123049 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a8120f02-3c8c-4b6b-aa0f-971cc77591a6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:54.124108 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a8120f02-3c8c-4b6b-aa0f-971cc77591a6 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1730 microversion: 2.20 time: 0.188045 Aug 04 23:21:54.124674 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 472/909] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:53 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:55.151851 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7d34a821-6879-4ed0-98a1-4fc4977892a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:55.152488 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7d34a821-6879-4ed0-98a1-4fc4977892a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:55.160844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d34a821-6879-4ed0-98a1-4fc4977892a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:55.161510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d34a821-6879-4ed0-98a1-4fc4977892a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:55.162019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d34a821-6879-4ed0-98a1-4fc4977892a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:55.162827 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d34a821-6879-4ed0-98a1-4fc4977892a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:55.163283 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d34a821-6879-4ed0-98a1-4fc4977892a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:55.163770 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d34a821-6879-4ed0-98a1-4fc4977892a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:55.374639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7d34a821-6879-4ed0-98a1-4fc4977892a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:55.383880 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7d34a821-6879-4ed0-98a1-4fc4977892a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:55.385470 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7d34a821-6879-4ed0-98a1-4fc4977892a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:55.386782 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7d34a821-6879-4ed0-98a1-4fc4977892a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1730 microversion: 2.20 time: 0.243371 Aug 04 23:21:55.387340 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 438/910] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:55 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1730 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:56.411360 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f86fc31f-3969-459b-80ba-4cdf19486bfe tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:56.411973 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f86fc31f-3969-459b-80ba-4cdf19486bfe tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:56.419817 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f86fc31f-3969-459b-80ba-4cdf19486bfe tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:56.420290 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f86fc31f-3969-459b-80ba-4cdf19486bfe tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:56.420739 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f86fc31f-3969-459b-80ba-4cdf19486bfe tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:56.421543 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f86fc31f-3969-459b-80ba-4cdf19486bfe tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:56.422005 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f86fc31f-3969-459b-80ba-4cdf19486bfe tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:56.422454 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f86fc31f-3969-459b-80ba-4cdf19486bfe tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:56.573632 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f86fc31f-3969-459b-80ba-4cdf19486bfe tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:56.583206 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f86fc31f-3969-459b-80ba-4cdf19486bfe tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:56.584737 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f86fc31f-3969-459b-80ba-4cdf19486bfe tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:56.585929 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f86fc31f-3969-459b-80ba-4cdf19486bfe tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1730 microversion: 2.20 time: 0.178483 Aug 04 23:21:56.587588 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 473/911] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:56 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 23:21:57.610640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4cdbc1cf-c4ad-421f-8a61-2647a2ef0ed0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:57.611274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4cdbc1cf-c4ad-421f-8a61-2647a2ef0ed0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:57.617575 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cdbc1cf-c4ad-421f-8a61-2647a2ef0ed0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:57.618052 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cdbc1cf-c4ad-421f-8a61-2647a2ef0ed0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:57.618520 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cdbc1cf-c4ad-421f-8a61-2647a2ef0ed0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:57.619214 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cdbc1cf-c4ad-421f-8a61-2647a2ef0ed0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:57.619661 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cdbc1cf-c4ad-421f-8a61-2647a2ef0ed0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:57.620093 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cdbc1cf-c4ad-421f-8a61-2647a2ef0ed0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:57.756075 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4cdbc1cf-c4ad-421f-8a61-2647a2ef0ed0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:57.765024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4cdbc1cf-c4ad-421f-8a61-2647a2ef0ed0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:57.766554 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4cdbc1cf-c4ad-421f-8a61-2647a2ef0ed0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:57.767778 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4cdbc1cf-c4ad-421f-8a61-2647a2ef0ed0 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1730 microversion: 2.20 time: 0.161632 Aug 04 23:21:57.768335 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 439/912] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:57 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:58.791229 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-27ab71d7-b137-4d62-a0cd-6dee476c0f76 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:58.791823 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-27ab71d7-b137-4d62-a0cd-6dee476c0f76 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:58.798342 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-27ab71d7-b137-4d62-a0cd-6dee476c0f76 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:58.798847 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-27ab71d7-b137-4d62-a0cd-6dee476c0f76 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:58.799280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-27ab71d7-b137-4d62-a0cd-6dee476c0f76 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:58.799967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-27ab71d7-b137-4d62-a0cd-6dee476c0f76 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:58.800419 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-27ab71d7-b137-4d62-a0cd-6dee476c0f76 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:58.800841 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-27ab71d7-b137-4d62-a0cd-6dee476c0f76 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:58.931313 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-27ab71d7-b137-4d62-a0cd-6dee476c0f76 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:58.939848 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-27ab71d7-b137-4d62-a0cd-6dee476c0f76 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:58.941340 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-27ab71d7-b137-4d62-a0cd-6dee476c0f76 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:21:58.942519 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-27ab71d7-b137-4d62-a0cd-6dee476c0f76 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1730 microversion: 2.20 time: 0.155164 Aug 04 23:21:58.943074 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 474/913] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:58 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:21:59.966814 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-59e27866-c460-4e6b-bd2e-f7a7c23ebc40 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:21:59.967438 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-59e27866-c460-4e6b-bd2e-f7a7c23ebc40 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:21:59.973792 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59e27866-c460-4e6b-bd2e-f7a7c23ebc40 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:59.974267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59e27866-c460-4e6b-bd2e-f7a7c23ebc40 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:59.974722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59e27866-c460-4e6b-bd2e-f7a7c23ebc40 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:21:59.975408 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59e27866-c460-4e6b-bd2e-f7a7c23ebc40 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:21:59.975848 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59e27866-c460-4e6b-bd2e-f7a7c23ebc40 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:21:59.976263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59e27866-c460-4e6b-bd2e-f7a7c23ebc40 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:00.110058 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-59e27866-c460-4e6b-bd2e-f7a7c23ebc40 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:00.118218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-59e27866-c460-4e6b-bd2e-f7a7c23ebc40 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:00.119759 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-59e27866-c460-4e6b-bd2e-f7a7c23ebc40 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:00.120929 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-59e27866-c460-4e6b-bd2e-f7a7c23ebc40 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1730 microversion: 2.20 time: 0.158731 Aug 04 23:22:00.121484 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 440/914] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:21:59 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:22:01.145249 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-98639f37-a592-44a2-b325-bb85d5b5a01b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:01.145911 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-98639f37-a592-44a2-b325-bb85d5b5a01b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:01.148102 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=30 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:22:01.153889 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98639f37-a592-44a2-b325-bb85d5b5a01b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:01.154403 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98639f37-a592-44a2-b325-bb85d5b5a01b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:01.154844 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98639f37-a592-44a2-b325-bb85d5b5a01b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:01.155555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98639f37-a592-44a2-b325-bb85d5b5a01b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:01.156011 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98639f37-a592-44a2-b325-bb85d5b5a01b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:01.156437 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98639f37-a592-44a2-b325-bb85d5b5a01b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:01.296607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-98639f37-a592-44a2-b325-bb85d5b5a01b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:01.304519 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-98639f37-a592-44a2-b325-bb85d5b5a01b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:01.306047 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-98639f37-a592-44a2-b325-bb85d5b5a01b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:01.307225 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-98639f37-a592-44a2-b325-bb85d5b5a01b tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1730 microversion: 2.20 time: 0.165992 Aug 04 23:22:01.307788 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 475/915] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:22:01 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:22:02.330908 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-10d02074-f14b-416d-89c3-fca96f65a02e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:02.331646 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-10d02074-f14b-416d-89c3-fca96f65a02e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:02.338524 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10d02074-f14b-416d-89c3-fca96f65a02e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:02.338999 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10d02074-f14b-416d-89c3-fca96f65a02e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:02.339429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10d02074-f14b-416d-89c3-fca96f65a02e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:02.340157 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10d02074-f14b-416d-89c3-fca96f65a02e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:02.340624 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10d02074-f14b-416d-89c3-fca96f65a02e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:02.341897 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10d02074-f14b-416d-89c3-fca96f65a02e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:02.480508 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-10d02074-f14b-416d-89c3-fca96f65a02e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:02.490090 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-10d02074-f14b-416d-89c3-fca96f65a02e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:02.491722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-10d02074-f14b-416d-89c3-fca96f65a02e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:02.492981 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-10d02074-f14b-416d-89c3-fca96f65a02e tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1730 microversion: 2.20 time: 0.165942 Aug 04 23:22:02.493609 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 441/916] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:22:02 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:22:03.515656 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8f1ac84e-636f-41ff-8c47-c79e4fd25edd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:03.516248 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8f1ac84e-636f-41ff-8c47-c79e4fd25edd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:03.522811 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8f1ac84e-636f-41ff-8c47-c79e4fd25edd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:03.523291 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8f1ac84e-636f-41ff-8c47-c79e4fd25edd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:03.523722 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8f1ac84e-636f-41ff-8c47-c79e4fd25edd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:03.524416 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8f1ac84e-636f-41ff-8c47-c79e4fd25edd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:03.524868 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8f1ac84e-636f-41ff-8c47-c79e4fd25edd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:03.525299 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8f1ac84e-636f-41ff-8c47-c79e4fd25edd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:03.811391 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-d0060172-c900-417a-b232-65e3f06f0316 req-677333a2-9ed1-49f5-9343-ece7e4f49cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be84129-cec2-4633-9a4c-de19980d4dd4", "name": "network-vif-plugged", "status": "completed", "tag": "dfb89816-563a-4deb-9f3f-e2414e3b9eeb"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:22:03.825643 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-d0060172-c900-417a-b232-65e3f06f0316 req-677333a2-9ed1-49f5-9343-ece7e4f49cf4 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:03.826132 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-d0060172-c900-417a-b232-65e3f06f0316 req-677333a2-9ed1-49f5-9343-ece7e4f49cf4 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:03.826589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-d0060172-c900-417a-b232-65e3f06f0316 req-677333a2-9ed1-49f5-9343-ece7e4f49cf4 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:03.839050 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-d0060172-c900-417a-b232-65e3f06f0316 req-677333a2-9ed1-49f5-9343-ece7e4f49cf4 service nova] Creating event network-vif-plugged:dfb89816-563a-4deb-9f3f-e2414e3b9eeb for instance 1be84129-cec2-4633-9a4c-de19980d4dd4 on hv-cinder-85221 Aug 04 23:22:03.844666 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-d0060172-c900-417a-b232-65e3f06f0316 req-677333a2-9ed1-49f5-9343-ece7e4f49cf4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038402 Aug 04 23:22:03.845890 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 442/917] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:22:03.912312 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8f1ac84e-636f-41ff-8c47-c79e4fd25edd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:03.921048 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8f1ac84e-636f-41ff-8c47-c79e4fd25edd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:03.922631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8f1ac84e-636f-41ff-8c47-c79e4fd25edd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:03.923826 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8f1ac84e-636f-41ff-8c47-c79e4fd25edd tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1730 microversion: 2.20 time: 0.412191 Aug 04 23:22:03.924388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 476/918] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:22:03 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1730 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:22:04.948976 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0d3be9b1-ace0-4886-b7e8-53f28c57e203 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:04.949672 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0d3be9b1-ace0-4886-b7e8-53f28c57e203 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:04.956529 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0d3be9b1-ace0-4886-b7e8-53f28c57e203 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:04.957008 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0d3be9b1-ace0-4886-b7e8-53f28c57e203 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:04.957447 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0d3be9b1-ace0-4886-b7e8-53f28c57e203 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:04.958142 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0d3be9b1-ace0-4886-b7e8-53f28c57e203 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:04.958624 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0d3be9b1-ace0-4886-b7e8-53f28c57e203 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:04.959055 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0d3be9b1-ace0-4886-b7e8-53f28c57e203 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:05.086046 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0d3be9b1-ace0-4886-b7e8-53f28c57e203 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:05.094565 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0d3be9b1-ace0-4886-b7e8-53f28c57e203 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:05.096128 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0d3be9b1-ace0-4886-b7e8-53f28c57e203 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:05.097316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0d3be9b1-ace0-4886-b7e8-53f28c57e203 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1730 microversion: 2.20 time: 0.153056 Aug 04 23:22:05.097873 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 443/919] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:22:04 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:22:06.120941 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-bbc99fac-f2ec-4eb3-8ef2-f0f14a699817 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:06.121497 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-bbc99fac-f2ec-4eb3-8ef2-f0f14a699817 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:06.128900 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bbc99fac-f2ec-4eb3-8ef2-f0f14a699817 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:06.129382 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bbc99fac-f2ec-4eb3-8ef2-f0f14a699817 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:06.129921 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bbc99fac-f2ec-4eb3-8ef2-f0f14a699817 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:06.130641 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bbc99fac-f2ec-4eb3-8ef2-f0f14a699817 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:06.131125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bbc99fac-f2ec-4eb3-8ef2-f0f14a699817 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:06.135747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bbc99fac-f2ec-4eb3-8ef2-f0f14a699817 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:06.270377 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-bbc99fac-f2ec-4eb3-8ef2-f0f14a699817 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:06.279845 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-bbc99fac-f2ec-4eb3-8ef2-f0f14a699817 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:06.281365 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-bbc99fac-f2ec-4eb3-8ef2-f0f14a699817 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:06.282985 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-bbc99fac-f2ec-4eb3-8ef2-f0f14a699817 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1730 microversion: 2.20 time: 0.165672 Aug 04 23:22:06.283261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 477/920] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:22:06 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:22:07.306028 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5ed403cf-e96a-44f4-9223-9653df6aec33 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:07.306667 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5ed403cf-e96a-44f4-9223-9653df6aec33 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:07.313649 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5ed403cf-e96a-44f4-9223-9653df6aec33 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:07.314135 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5ed403cf-e96a-44f4-9223-9653df6aec33 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:07.314604 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5ed403cf-e96a-44f4-9223-9653df6aec33 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:07.315298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5ed403cf-e96a-44f4-9223-9653df6aec33 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:07.315752 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5ed403cf-e96a-44f4-9223-9653df6aec33 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:07.316180 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5ed403cf-e96a-44f4-9223-9653df6aec33 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:07.448264 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5ed403cf-e96a-44f4-9223-9653df6aec33 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:07.451153 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:22:07.458895 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5ed403cf-e96a-44f4-9223-9653df6aec33 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:07.460407 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5ed403cf-e96a-44f4-9223-9653df6aec33 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:07.461837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5ed403cf-e96a-44f4-9223-9653df6aec33 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1717 microversion: 2.20 time: 0.159754 Aug 04 23:22:07.462408 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 444/921] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:22:07 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:22:07.844215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-08765113-8ea1-4cd2-b4c6-4225026a715a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:07.844718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-08765113-8ea1-4cd2-b4c6-4225026a715a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:07.851271 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-08765113-8ea1-4cd2-b4c6-4225026a715a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:07.851749 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-08765113-8ea1-4cd2-b4c6-4225026a715a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:07.852179 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-08765113-8ea1-4cd2-b4c6-4225026a715a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:07.852874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-08765113-8ea1-4cd2-b4c6-4225026a715a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:07.853326 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-08765113-8ea1-4cd2-b4c6-4225026a715a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:07.853744 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-08765113-8ea1-4cd2-b4c6-4225026a715a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:07.878051 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-08765113-8ea1-4cd2-b4c6-4225026a715a tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3/ips" status: 200 len: 150 microversion: 2.1 time: 0.038359 Aug 04 23:22:07.878671 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 478/922] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Aug 4 23:22:07 2022] GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:22:09.212019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7ac27deb-a0b1-4e4f-801a-0e92871188b2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7504fd1b-c82c-4c90-9022-e032a3a985c0"}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:22:09.214342 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7ac27deb-a0b1-4e4f-801a-0e92871188b2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:09.223404 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ac27deb-a0b1-4e4f-801a-0e92871188b2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:09.223886 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ac27deb-a0b1-4e4f-801a-0e92871188b2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:09.224316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ac27deb-a0b1-4e4f-801a-0e92871188b2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:09.225005 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ac27deb-a0b1-4e4f-801a-0e92871188b2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:09.225451 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ac27deb-a0b1-4e4f-801a-0e92871188b2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:09.225873 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ac27deb-a0b1-4e4f-801a-0e92871188b2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:09.481342 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7ac27deb-a0b1-4e4f-801a-0e92871188b2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "POST /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272993 Aug 04 23:22:09.482698 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 445/923] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Aug 4 23:22:09 2022] POST /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:22:17.152159 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f38c13c8-c6bf-4e30-a62e-da72c35abb7f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:17.152780 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f38c13c8-c6bf-4e30-a62e-da72c35abb7f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:17.160629 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f38c13c8-c6bf-4e30-a62e-da72c35abb7f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:17.160834 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f38c13c8-c6bf-4e30-a62e-da72c35abb7f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:17.161213 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f38c13c8-c6bf-4e30-a62e-da72c35abb7f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:17.161950 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f38c13c8-c6bf-4e30-a62e-da72c35abb7f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:17.162431 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f38c13c8-c6bf-4e30-a62e-da72c35abb7f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:17.163050 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f38c13c8-c6bf-4e30-a62e-da72c35abb7f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:17.165986 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:22:17.248017 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.objects.instance [None req-f38c13c8-c6bf-4e30-a62e-da72c35abb7f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lazy-loading 'services' on Instance uuid 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 {{(pid=129791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:22:17.323165 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f38c13c8-c6bf-4e30-a62e-da72c35abb7f tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "DELETE /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3/os-volume_attachments/7504fd1b-c82c-4c90-9022-e032a3a985c0" status: 202 len: 0 microversion: 2.1 time: 0.174496 Aug 04 23:22:17.323832 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 479/924] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Aug 4 23:22:17 2022] DELETE /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3/os-volume_attachments/7504fd1b-c82c-4c90-9022-e032a3a985c0 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:22:17.333500 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-62fdf0e6-435a-4000-826a-9f0fc06e6ec9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:17.336298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-62fdf0e6-435a-4000-826a-9f0fc06e6ec9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:17.338964 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:22:17.345448 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-62fdf0e6-435a-4000-826a-9f0fc06e6ec9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:17.345754 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-62fdf0e6-435a-4000-826a-9f0fc06e6ec9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:17.346192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-62fdf0e6-435a-4000-826a-9f0fc06e6ec9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:17.346928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-62fdf0e6-435a-4000-826a-9f0fc06e6ec9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:17.347384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-62fdf0e6-435a-4000-826a-9f0fc06e6ec9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:17.347844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-62fdf0e6-435a-4000-826a-9f0fc06e6ec9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:17.380488 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-62fdf0e6-435a-4000-826a-9f0fc06e6ec9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051271 Aug 04 23:22:17.381045 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 446/925] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:22:17 2022] GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:22:18.393618 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8c9ba005-27fd-41bd-b4fe-f5ce63d13cce tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:18.396004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8c9ba005-27fd-41bd-b4fe-f5ce63d13cce tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:18.402297 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8c9ba005-27fd-41bd-b4fe-f5ce63d13cce tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:18.402801 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8c9ba005-27fd-41bd-b4fe-f5ce63d13cce tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:18.403229 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8c9ba005-27fd-41bd-b4fe-f5ce63d13cce tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:18.404441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8c9ba005-27fd-41bd-b4fe-f5ce63d13cce tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:18.404888 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8c9ba005-27fd-41bd-b4fe-f5ce63d13cce tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:18.405301 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8c9ba005-27fd-41bd-b4fe-f5ce63d13cce tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:18.435265 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8c9ba005-27fd-41bd-b4fe-f5ce63d13cce tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046150 Aug 04 23:22:18.435854 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 480/926] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:22:18 2022] GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 23:22:18.502298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3244e13c-a2d4-4ab0-bd53-b69096a232c4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:18.502915 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3244e13c-a2d4-4ab0-bd53-b69096a232c4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:18.509822 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3244e13c-a2d4-4ab0-bd53-b69096a232c4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:18.510315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3244e13c-a2d4-4ab0-bd53-b69096a232c4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:18.510811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3244e13c-a2d4-4ab0-bd53-b69096a232c4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:18.511566 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3244e13c-a2d4-4ab0-bd53-b69096a232c4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:18.512027 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3244e13c-a2d4-4ab0-bd53-b69096a232c4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:18.512456 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3244e13c-a2d4-4ab0-bd53-b69096a232c4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:18.543937 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3244e13c-a2d4-4ab0-bd53-b69096a232c4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Going to try to terminate instance {{(pid=129790) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 23:22:18.629762 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3244e13c-a2d4-4ab0-bd53-b69096a232c4 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "DELETE /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3" status: 204 len: 0 microversion: 2.1 time: 0.130928 Aug 04 23:22:18.630291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 447/927] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:22:18 2022] DELETE /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 23:22:18.639110 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-35e8b308-c76f-4563-906f-77b83d611346 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:18.639756 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-35e8b308-c76f-4563-906f-77b83d611346 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:18.645875 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35e8b308-c76f-4563-906f-77b83d611346 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:18.646296 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35e8b308-c76f-4563-906f-77b83d611346 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:18.646779 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35e8b308-c76f-4563-906f-77b83d611346 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:18.647479 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35e8b308-c76f-4563-906f-77b83d611346 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:18.647921 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35e8b308-c76f-4563-906f-77b83d611346 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:18.648348 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35e8b308-c76f-4563-906f-77b83d611346 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:18.783165 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-35e8b308-c76f-4563-906f-77b83d611346 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:18.790671 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-35e8b308-c76f-4563-906f-77b83d611346 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3" status: 200 len: 1681 microversion: 2.1 time: 0.155895 Aug 04 23:22:18.791236 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 481/928] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:18 2022] GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:22:19.812284 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f996c39c-47c7-4c2c-ba92-b8c91e9427f8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:19.813295 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f996c39c-47c7-4c2c-ba92-b8c91e9427f8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:19.819608 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f996c39c-47c7-4c2c-ba92-b8c91e9427f8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:19.820085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f996c39c-47c7-4c2c-ba92-b8c91e9427f8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:19.820514 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f996c39c-47c7-4c2c-ba92-b8c91e9427f8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:19.821209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f996c39c-47c7-4c2c-ba92-b8c91e9427f8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:19.821658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f996c39c-47c7-4c2c-ba92-b8c91e9427f8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:19.822078 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f996c39c-47c7-4c2c-ba92-b8c91e9427f8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:19.964560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f996c39c-47c7-4c2c-ba92-b8c91e9427f8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:19.972738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f996c39c-47c7-4c2c-ba92-b8c91e9427f8 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3" status: 200 len: 1681 microversion: 2.1 time: 0.165610 Aug 04 23:22:19.973303 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 448/929] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:19 2022] GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:22:20.993168 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6e5b45a5-cf44-472a-8f41-7a58794449a7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:20.993763 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6e5b45a5-cf44-472a-8f41-7a58794449a7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:21.001201 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e5b45a5-cf44-472a-8f41-7a58794449a7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:21.001680 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e5b45a5-cf44-472a-8f41-7a58794449a7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:21.002106 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e5b45a5-cf44-472a-8f41-7a58794449a7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:21.002832 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e5b45a5-cf44-472a-8f41-7a58794449a7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:21.004067 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e5b45a5-cf44-472a-8f41-7a58794449a7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:21.004067 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e5b45a5-cf44-472a-8f41-7a58794449a7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:21.145655 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6e5b45a5-cf44-472a-8f41-7a58794449a7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ceb35afcc046218bdce1ab4983d9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0422afbb853d4ef2924edf221499971c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:21.151923 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6e5b45a5-cf44-472a-8f41-7a58794449a7 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3" status: 200 len: 1681 microversion: 2.1 time: 0.162590 Aug 04 23:22:21.152749 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 482/930] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:20 2022] GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:22:21.400268 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-eaa71ff5-c763-483b-86a7-70fd16e0aa38 req-4661d8a6-d84a-4af7-aeeb-db3c2838acc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3", "name": "network-vif-deleted", "tag": "69a97291-effb-47b6-bee6-f324bb5f636f"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:22:21.411398 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-eaa71ff5-c763-483b-86a7-70fd16e0aa38 req-4661d8a6-d84a-4af7-aeeb-db3c2838acc4 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:21.411889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-eaa71ff5-c763-483b-86a7-70fd16e0aa38 req-4661d8a6-d84a-4af7-aeeb-db3c2838acc4 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:21.412312 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-eaa71ff5-c763-483b-86a7-70fd16e0aa38 req-4661d8a6-d84a-4af7-aeeb-db3c2838acc4 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:21.424437 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-eaa71ff5-c763-483b-86a7-70fd16e0aa38 req-4661d8a6-d84a-4af7-aeeb-db3c2838acc4 service nova] Creating event network-vif-deleted:69a97291-effb-47b6-bee6-f324bb5f636f for instance 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 on hv-cinder-85221 Aug 04 23:22:21.429396 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-eaa71ff5-c763-483b-86a7-70fd16e0aa38 req-4661d8a6-d84a-4af7-aeeb-db3c2838acc4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032756 Aug 04 23:22:21.429991 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 449/931] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:22:22.173371 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a2c97196-1b8f-4e2b-ac8f-31e6607433a2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:22.173983 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a2c97196-1b8f-4e2b-ac8f-31e6607433a2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:22.180916 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a2c97196-1b8f-4e2b-ac8f-31e6607433a2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:22.181450 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a2c97196-1b8f-4e2b-ac8f-31e6607433a2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:22.181882 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a2c97196-1b8f-4e2b-ac8f-31e6607433a2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:22.182609 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a2c97196-1b8f-4e2b-ac8f-31e6607433a2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:22.183063 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a2c97196-1b8f-4e2b-ac8f-31e6607433a2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:22.183489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a2c97196-1b8f-4e2b-ac8f-31e6607433a2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:22.198503 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-a2c97196-1b8f-4e2b-ac8f-31e6607433a2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] HTTP exception thrown: Instance 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 could not be found. Aug 04 23:22:22.200164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a2c97196-1b8f-4e2b-ac8f-31e6607433a2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Request method failure captured: Aug 04 23:22:22.200164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 HTTP/1.1 Aug 04 23:22:22.200164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:22:22.200164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:22:22.200164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:22:22.200164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 0 Aug 04 23:22:22.200164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:22:22.200164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:22:22.200164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:22:22.200164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:22:22.200164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FJxolWXoCq7pteacc3wSoOFRBafzn5l-VFi74XBW7wvTawbOokhRmWW1PKP-C_VKEwuqozn26yg856JLZkvKXgHW09fl1p22BiGh5nneUxE7kKr1M8fWXZ4OILMJgqixZXLBIGcxsElt638y0EWPGUaTW1AOdHEnKwXTKYRir1dpV4 Aug 04 23:22:22.200164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:22:22.200164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:22:22.200164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:22:22.200164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:22:22.200164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:22:22.200164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:22:22.200164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:22:22.200164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:22.200164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:22:22.200164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:22:22.202263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0422afbb853d4ef2924edf221499971c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0422afbb853d4ef2924edf221499971c"}]}] Aug 04 23:22:22.202263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:22.202263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:22:22.202263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:22.202263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:22:22.202263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:22:22.202263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:22:22.202263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: b2ceb35afcc046218bdce1ab4983d9f9 Aug 04 23:22:22.202263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:22:22.202263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: > Aug 04 23:22:22.202263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Instance 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 could not be found. Aug 04 23:22:22.202263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'id': '72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3'} Aug 04 23:22:22.203767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:22:22.203767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:22.203767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:22:22.203767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:22:22.203767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:22:22.203767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:22:22.203767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:22:22.203767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:22:22.203767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:22:22.203767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:22:22.203767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 could not be found. Aug 04 23:22:22.203767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:22.203767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:22:22.203767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:22.203767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:22.203767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:22:22.203767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:22:22.203767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:22:22.203767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:22:22.203767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:22:22.205510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:22:22.205510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:22:22.205510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:22:22.205510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:22:22.205510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:22:22.205510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:22:22.205510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:22:22.205510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 could not be found. Aug 04 23:22:22.205510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:22.205510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:22:22.205510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:22.205510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:22.205510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:22:22.205510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:22:22.205510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:22:22.205510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:22:22.205510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 could not be found. Aug 04 23:22:22.205510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:22.207691 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a2c97196-1b8f-4e2b-ac8f-31e6607433a2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Returning 404 to user: Instance 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 could not be found. {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:22:22.207691 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a2c97196-1b8f-4e2b-ac8f-31e6607433a2 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3" status: 404 len: 111 microversion: 2.1 time: 0.032846 Aug 04 23:22:22.207691 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 483/932] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:22 2022] GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:22:22.213180 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0e2564b2-f5f2-44ee-b1b0-5f34104f62d9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '.version_select at 0x7f6d25db1550>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:22.239065 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0e2564b2-f5f2-44ee-b1b0-5f34104f62d9 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1000550659" status: 202 len: 0 microversion: 2.1 time: 0.030547 Aug 04 23:22:22.239642 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 450/933] 10.222.0.33 () {58 vars in 1221 bytes} [Thu Aug 4 23:22:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1000550659 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:22:24.011489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-80e809bb-6779-4e8f-bf68-87b203e69992 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:24.011984 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-80e809bb-6779-4e8f-bf68-87b203e69992 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:24.018730 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80e809bb-6779-4e8f-bf68-87b203e69992 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:24.019204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80e809bb-6779-4e8f-bf68-87b203e69992 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:24.019635 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80e809bb-6779-4e8f-bf68-87b203e69992 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:24.020310 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80e809bb-6779-4e8f-bf68-87b203e69992 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:24.020752 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80e809bb-6779-4e8f-bf68-87b203e69992 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:24.021166 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80e809bb-6779-4e8f-bf68-87b203e69992 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:24.036616 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-80e809bb-6779-4e8f-bf68-87b203e69992 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] HTTP exception thrown: Instance 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 could not be found. Aug 04 23:22:24.038138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-80e809bb-6779-4e8f-bf68-87b203e69992 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Request method failure captured: Aug 04 23:22:24.038138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: DELETE /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 HTTP/1.1 Aug 04 23:22:24.038138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:22:24.038138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:22:24.038138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:22:24.038138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 0 Aug 04 23:22:24.038138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:22:24.038138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:22:24.038138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:22:24.038138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:22:24.038138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FJxolWXoCq7pteacc3wSoOFRBafzn5l-VFi74XBW7wvTawbOokhRmWW1PKP-C_VKEwuqozn26yg856JLZkvKXgHW09fl1p22BiGh5nneUxE7kKr1M8fWXZ4OILMJgqixZXLBIGcxsElt638y0EWPGUaTW1AOdHEnKwXTKYRir1dpV4 Aug 04 23:22:24.038138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:22:24.038138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:22:24.038138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:22:24.038138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:22:24.038138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:22:24.038138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:22:24.038138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:22:24.038138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:24.038138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:22:24.038138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:22:24.040036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0422afbb853d4ef2924edf221499971c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0422afbb853d4ef2924edf221499971c"}]}] Aug 04 23:22:24.040036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:24.040036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:22:24.040036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:24.040036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:22:24.040036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:22:24.040036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:22:24.040036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: b2ceb35afcc046218bdce1ab4983d9f9 Aug 04 23:22:24.040036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:22:24.040036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: > Aug 04 23:22:24.040036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Instance 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 could not be found. Aug 04 23:22:24.040036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'id': '72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3'} Aug 04 23:22:24.041091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:22:24.041091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:24.041091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:22:24.041091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:22:24.041091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:22:24.041091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:22:24.041091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:22:24.041091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:22:24.041091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:22:24.041091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:22:24.041091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 could not be found. Aug 04 23:22:24.041091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:24.041091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:22:24.041091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:24.041091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:24.041091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:22:24.041091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:22:24.041091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:22:24.041091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:22:24.041091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:22:24.042863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:22:24.042863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 23:22:24.042863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 23:22:24.042863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 23:22:24.042863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 23:22:24.042863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:22:24.042863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:22:24.042863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:22:24.042863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:22:24.042863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 could not be found. Aug 04 23:22:24.042863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:24.042863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:22:24.042863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:24.042863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:24.042863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:22:24.042863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:22:24.042863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:22:24.042863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:22:24.042863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 could not be found. Aug 04 23:22:24.042863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:24.044487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-80e809bb-6779-4e8f-bf68-87b203e69992 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Returning 404 to user: Instance 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 could not be found. {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:22:24.044487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-80e809bb-6779-4e8f-bf68-87b203e69992 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "DELETE /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3" status: 404 len: 111 microversion: 2.1 time: 0.031945 Aug 04 23:22:24.044487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 484/934] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:22:24 2022] DELETE /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:22:24.048369 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b6b7194e-3f69-4327-87e4-0891da3180ce tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:24.049100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b6b7194e-3f69-4327-87e4-0891da3180ce tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:24.056183 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b6b7194e-3f69-4327-87e4-0891da3180ce tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:24.056658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b6b7194e-3f69-4327-87e4-0891da3180ce tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:24.057091 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b6b7194e-3f69-4327-87e4-0891da3180ce tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:24.057782 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b6b7194e-3f69-4327-87e4-0891da3180ce tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:24.058229 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b6b7194e-3f69-4327-87e4-0891da3180ce tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:24.058693 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b6b7194e-3f69-4327-87e4-0891da3180ce tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:24.072219 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-b6b7194e-3f69-4327-87e4-0891da3180ce tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] HTTP exception thrown: Instance 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 could not be found. Aug 04 23:22:24.074010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b6b7194e-3f69-4327-87e4-0891da3180ce tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Request method failure captured: Aug 04 23:22:24.074010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 HTTP/1.1 Aug 04 23:22:24.074010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:22:24.074010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:22:24.074010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:22:24.074010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:22:24.074010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:22:24.074010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:22:24.074010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:22:24.074010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:22:24.074010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FJxolWXoCq7pteacc3wSoOFRBafzn5l-VFi74XBW7wvTawbOokhRmWW1PKP-C_VKEwuqozn26yg856JLZkvKXgHW09fl1p22BiGh5nneUxE7kKr1M8fWXZ4OILMJgqixZXLBIGcxsElt638y0EWPGUaTW1AOdHEnKwXTKYRir1dpV4 Aug 04 23:22:24.074010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:22:24.074010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:22:24.074010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:22:24.074010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:22:24.074010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:22:24.074010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:22:24.074010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:22:24.074010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:24.074010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:22:24.074010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:22:24.075539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0422afbb853d4ef2924edf221499971c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0422afbb853d4ef2924edf221499971c"}]}] Aug 04 23:22:24.075539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:24.075539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:22:24.075539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:24.075539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:22:24.075539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:22:24.075539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:22:24.075539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: b2ceb35afcc046218bdce1ab4983d9f9 Aug 04 23:22:24.075539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:22:24.075539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:22:24.075539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Instance 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 could not be found. Aug 04 23:22:24.075539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': '72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3'} Aug 04 23:22:24.077738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:22:24.077738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:24.077738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:22:24.077738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:22:24.077738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:22:24.077738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:22:24.077738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:22:24.077738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:22:24.077738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:22:24.077738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:22:24.077738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 could not be found. Aug 04 23:22:24.077738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:22:24.077738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:22:24.077738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:22:24.077738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:24.077738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:22:24.077738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:22:24.077738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:22:24.077738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:22:24.077738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:22:24.079351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:22:24.079351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:22:24.079351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:22:24.079351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:22:24.079351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:22:24.079351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:22:24.079351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:22:24.079351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 could not be found. Aug 04 23:22:24.079351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:22:24.079351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:22:24.079351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:22:24.079351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:24.079351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:22:24.079351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:22:24.079351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:22:24.079351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:22:24.079351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 could not be found. Aug 04 23:22:24.079351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:22:24.080774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b6b7194e-3f69-4327-87e4-0891da3180ce tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Returning 404 to user: Instance 72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:22:24.080774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b6b7194e-3f69-4327-87e4-0891da3180ce tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3" status: 404 len: 111 microversion: 2.1 time: 0.031033 Aug 04 23:22:24.080774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 451/935] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:24 2022] GET /compute/v2.1/servers/72b4b8a1-ce68-479f-aaa3-0b2f9472f6f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 23:22:25.218982 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e8bfefc5-b286-48cd-aef9-37cb4e224296 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:25.219578 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e8bfefc5-b286-48cd-aef9-37cb4e224296 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:25.226138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e8bfefc5-b286-48cd-aef9-37cb4e224296 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:25.226677 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e8bfefc5-b286-48cd-aef9-37cb4e224296 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:25.227105 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e8bfefc5-b286-48cd-aef9-37cb4e224296 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:25.227808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e8bfefc5-b286-48cd-aef9-37cb4e224296 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:25.228258 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e8bfefc5-b286-48cd-aef9-37cb4e224296 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:25.228669 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e8bfefc5-b286-48cd-aef9-37cb4e224296 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:25.244914 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-e8bfefc5-b286-48cd-aef9-37cb4e224296 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] HTTP exception thrown: Instance cd92a5bc-ef36-4c4a-a41a-d76abd2b35da could not be found. Aug 04 23:22:25.246547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e8bfefc5-b286-48cd-aef9-37cb4e224296 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Request method failure captured: Aug 04 23:22:25.246547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: DELETE /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da HTTP/1.1 Aug 04 23:22:25.246547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:22:25.246547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:22:25.246547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:22:25.246547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 0 Aug 04 23:22:25.246547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:22:25.246547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:22:25.246547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:22:25.246547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:22:25.246547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FJxolWXoCq7pteacc3wSoOFRBafzn5l-VFi74XBW7wvTawbOokhRmWW1PKP-C_VKEwuqozn26yg856JLZkvKXgHW09fl1p22BiGh5nneUxE7kKr1M8fWXZ4OILMJgqixZXLBIGcxsElt638y0EWPGUaTW1AOdHEnKwXTKYRir1dpV4 Aug 04 23:22:25.246547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:22:25.246547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:22:25.246547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:22:25.246547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:22:25.246547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:22:25.246547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:22:25.246547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:22:25.246547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:25.246547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:22:25.246547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:22:25.248173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0422afbb853d4ef2924edf221499971c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0422afbb853d4ef2924edf221499971c"}]}] Aug 04 23:22:25.248173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:25.248173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:22:25.248173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:25.248173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:22:25.248173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:22:25.248173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:22:25.248173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: b2ceb35afcc046218bdce1ab4983d9f9 Aug 04 23:22:25.248173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:22:25.248173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: > Aug 04 23:22:25.248173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Instance cd92a5bc-ef36-4c4a-a41a-d76abd2b35da could not be found. Aug 04 23:22:25.248173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'id': 'cd92a5bc-ef36-4c4a-a41a-d76abd2b35da'} Aug 04 23:22:25.249092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:22:25.249092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:25.249092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:22:25.249092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:22:25.249092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:22:25.249092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:22:25.249092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:22:25.249092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:22:25.249092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:22:25.249092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:22:25.249092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd92a5bc-ef36-4c4a-a41a-d76abd2b35da could not be found. Aug 04 23:22:25.249092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:25.249092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:22:25.249092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:25.249092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:25.249092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:22:25.249092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:22:25.249092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:22:25.249092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:22:25.249092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:22:25.250343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:22:25.250343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 23:22:25.250343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 23:22:25.250343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 23:22:25.250343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 23:22:25.250343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:22:25.250343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:22:25.250343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:22:25.250343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:22:25.250343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd92a5bc-ef36-4c4a-a41a-d76abd2b35da could not be found. Aug 04 23:22:25.250343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:25.250343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:22:25.250343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:25.250343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:25.250343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:22:25.250343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:22:25.250343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:22:25.250343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:22:25.250343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd92a5bc-ef36-4c4a-a41a-d76abd2b35da could not be found. Aug 04 23:22:25.250343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:25.251613 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e8bfefc5-b286-48cd-aef9-37cb4e224296 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Returning 404 to user: Instance cd92a5bc-ef36-4c4a-a41a-d76abd2b35da could not be found. {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:22:25.251613 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e8bfefc5-b286-48cd-aef9-37cb4e224296 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da" status: 404 len: 111 microversion: 2.1 time: 0.034310 Aug 04 23:22:25.251613 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 485/936] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:22:25 2022] DELETE /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:22:25.257589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6c5bc32e-24f5-433d-a3d4-e12874a43087 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:25.258268 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6c5bc32e-24f5-433d-a3d4-e12874a43087 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: cd92a5bc-ef36-4c4a-a41a-d76abd2b35da] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:25.265103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6c5bc32e-24f5-433d-a3d4-e12874a43087 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:25.265591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6c5bc32e-24f5-433d-a3d4-e12874a43087 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:25.266025 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6c5bc32e-24f5-433d-a3d4-e12874a43087 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:25.266768 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6c5bc32e-24f5-433d-a3d4-e12874a43087 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:25.267222 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6c5bc32e-24f5-433d-a3d4-e12874a43087 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:25.267667 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6c5bc32e-24f5-433d-a3d4-e12874a43087 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:25.284171 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-6c5bc32e-24f5-433d-a3d4-e12874a43087 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] HTTP exception thrown: Instance cd92a5bc-ef36-4c4a-a41a-d76abd2b35da could not be found. Aug 04 23:22:25.285711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6c5bc32e-24f5-433d-a3d4-e12874a43087 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Request method failure captured: Aug 04 23:22:25.285711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da HTTP/1.1 Aug 04 23:22:25.285711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:22:25.285711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:22:25.285711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:22:25.285711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:22:25.285711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:22:25.285711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:22:25.285711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:22:25.285711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:22:25.285711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FJxolWXoCq7pteacc3wSoOFRBafzn5l-VFi74XBW7wvTawbOokhRmWW1PKP-C_VKEwuqozn26yg856JLZkvKXgHW09fl1p22BiGh5nneUxE7kKr1M8fWXZ4OILMJgqixZXLBIGcxsElt638y0EWPGUaTW1AOdHEnKwXTKYRir1dpV4 Aug 04 23:22:25.285711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:22:25.285711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:22:25.285711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:22:25.285711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:22:25.285711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:22:25.285711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:22:25.285711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:22:25.285711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:25.285711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:22:25.285711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:22:25.288362 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0422afbb853d4ef2924edf221499971c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0422afbb853d4ef2924edf221499971c"}]}] Aug 04 23:22:25.288362 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:25.288362 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:22:25.288362 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:25.288362 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:22:25.288362 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:22:25.288362 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:22:25.288362 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: b2ceb35afcc046218bdce1ab4983d9f9 Aug 04 23:22:25.288362 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:22:25.288362 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:22:25.288362 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Instance cd92a5bc-ef36-4c4a-a41a-d76abd2b35da could not be found. Aug 04 23:22:25.288362 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': 'cd92a5bc-ef36-4c4a-a41a-d76abd2b35da'} Aug 04 23:22:25.289955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:22:25.289955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:25.289955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:22:25.289955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:22:25.289955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:22:25.289955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:22:25.289955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:22:25.289955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:22:25.289955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:22:25.289955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:22:25.289955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd92a5bc-ef36-4c4a-a41a-d76abd2b35da could not be found. Aug 04 23:22:25.289955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:22:25.289955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:22:25.289955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:22:25.289955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:25.289955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:22:25.289955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:22:25.289955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:22:25.289955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:22:25.289955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:22:25.292664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:22:25.292664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:22:25.292664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:22:25.292664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:22:25.292664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:22:25.292664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:22:25.292664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:22:25.292664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd92a5bc-ef36-4c4a-a41a-d76abd2b35da could not be found. Aug 04 23:22:25.292664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:22:25.292664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:22:25.292664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:22:25.292664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:25.292664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:22:25.292664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:22:25.292664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:22:25.292664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:22:25.292664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd92a5bc-ef36-4c4a-a41a-d76abd2b35da could not be found. Aug 04 23:22:25.292664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:22:25.295847 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6c5bc32e-24f5-433d-a3d4-e12874a43087 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Returning 404 to user: Instance cd92a5bc-ef36-4c4a-a41a-d76abd2b35da could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:22:25.295847 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6c5bc32e-24f5-433d-a3d4-e12874a43087 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da" status: 404 len: 111 microversion: 2.1 time: 0.033531 Aug 04 23:22:25.295847 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 452/937] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:25 2022] GET /compute/v2.1/servers/cd92a5bc-ef36-4c4a-a41a-d76abd2b35da => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:22:25.299613 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-997aefaf-bb12-4745-bee8-f56e7ddc9253 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:25.300109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-997aefaf-bb12-4745-bee8-f56e7ddc9253 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:25.306206 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-997aefaf-bb12-4745-bee8-f56e7ddc9253 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:25.306715 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-997aefaf-bb12-4745-bee8-f56e7ddc9253 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:25.307514 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-997aefaf-bb12-4745-bee8-f56e7ddc9253 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:25.308237 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-997aefaf-bb12-4745-bee8-f56e7ddc9253 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:25.308690 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-997aefaf-bb12-4745-bee8-f56e7ddc9253 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:25.309111 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-997aefaf-bb12-4745-bee8-f56e7ddc9253 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:25.324105 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-997aefaf-bb12-4745-bee8-f56e7ddc9253 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] HTTP exception thrown: Instance fcc205d5-c1d3-4f3d-a37f-af9769b7067f could not be found. Aug 04 23:22:25.325714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-997aefaf-bb12-4745-bee8-f56e7ddc9253 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Request method failure captured: Aug 04 23:22:25.325714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: DELETE /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f HTTP/1.1 Aug 04 23:22:25.325714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:22:25.325714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:22:25.325714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:22:25.325714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 0 Aug 04 23:22:25.325714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:22:25.325714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:22:25.325714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:22:25.325714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:22:25.325714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FJxolWXoCq7pteacc3wSoOFRBafzn5l-VFi74XBW7wvTawbOokhRmWW1PKP-C_VKEwuqozn26yg856JLZkvKXgHW09fl1p22BiGh5nneUxE7kKr1M8fWXZ4OILMJgqixZXLBIGcxsElt638y0EWPGUaTW1AOdHEnKwXTKYRir1dpV4 Aug 04 23:22:25.325714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:22:25.325714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:22:25.325714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:22:25.325714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:22:25.325714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:22:25.325714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:22:25.325714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:22:25.325714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:25.325714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:22:25.325714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:22:25.327549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0422afbb853d4ef2924edf221499971c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0422afbb853d4ef2924edf221499971c"}]}] Aug 04 23:22:25.327549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:25.327549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:22:25.327549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:25.327549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:22:25.327549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:22:25.327549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:22:25.327549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: b2ceb35afcc046218bdce1ab4983d9f9 Aug 04 23:22:25.327549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:22:25.327549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: > Aug 04 23:22:25.327549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Instance fcc205d5-c1d3-4f3d-a37f-af9769b7067f could not be found. Aug 04 23:22:25.327549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'id': 'fcc205d5-c1d3-4f3d-a37f-af9769b7067f'} Aug 04 23:22:25.328323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:22:25.328323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:25.328323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:22:25.328323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:22:25.328323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:22:25.328323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:22:25.328323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:22:25.328323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:22:25.328323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:22:25.328323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:22:25.328323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcc205d5-c1d3-4f3d-a37f-af9769b7067f could not be found. Aug 04 23:22:25.328323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:25.328323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:22:25.328323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:25.328323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:25.328323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:22:25.328323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:22:25.328323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:22:25.328323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:22:25.328323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:22:25.329666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:22:25.329666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 23:22:25.329666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 23:22:25.329666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 23:22:25.329666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 23:22:25.329666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:22:25.329666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:22:25.329666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:22:25.329666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:22:25.329666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcc205d5-c1d3-4f3d-a37f-af9769b7067f could not be found. Aug 04 23:22:25.329666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:25.329666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:22:25.329666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:25.329666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:25.329666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:22:25.329666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:22:25.329666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:22:25.329666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:22:25.329666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcc205d5-c1d3-4f3d-a37f-af9769b7067f could not be found. Aug 04 23:22:25.329666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:25.330913 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-997aefaf-bb12-4745-bee8-f56e7ddc9253 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Returning 404 to user: Instance fcc205d5-c1d3-4f3d-a37f-af9769b7067f could not be found. {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:22:25.330913 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-997aefaf-bb12-4745-bee8-f56e7ddc9253 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 404 len: 111 microversion: 2.1 time: 0.033619 Aug 04 23:22:25.330913 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 486/938] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:22:25 2022] DELETE /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:22:25.336056 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-329c9c93-2665-4236-8236-43bfee4a6340 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:25.336673 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-329c9c93-2665-4236-8236-43bfee4a6340 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: fcc205d5-c1d3-4f3d-a37f-af9769b7067f] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:25.344340 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-329c9c93-2665-4236-8236-43bfee4a6340 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:25.344822 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-329c9c93-2665-4236-8236-43bfee4a6340 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:25.345556 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-329c9c93-2665-4236-8236-43bfee4a6340 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:25.345945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-329c9c93-2665-4236-8236-43bfee4a6340 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:25.346426 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-329c9c93-2665-4236-8236-43bfee4a6340 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:25.346852 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-329c9c93-2665-4236-8236-43bfee4a6340 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:25.361699 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-329c9c93-2665-4236-8236-43bfee4a6340 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] HTTP exception thrown: Instance fcc205d5-c1d3-4f3d-a37f-af9769b7067f could not be found. Aug 04 23:22:25.363267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-329c9c93-2665-4236-8236-43bfee4a6340 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Request method failure captured: Aug 04 23:22:25.363267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f HTTP/1.1 Aug 04 23:22:25.363267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:22:25.363267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:22:25.363267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:22:25.363267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:22:25.363267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:22:25.363267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:22:25.363267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:22:25.363267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:22:25.363267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FJxolWXoCq7pteacc3wSoOFRBafzn5l-VFi74XBW7wvTawbOokhRmWW1PKP-C_VKEwuqozn26yg856JLZkvKXgHW09fl1p22BiGh5nneUxE7kKr1M8fWXZ4OILMJgqixZXLBIGcxsElt638y0EWPGUaTW1AOdHEnKwXTKYRir1dpV4 Aug 04 23:22:25.363267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:22:25.363267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:22:25.363267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:22:25.363267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:22:25.363267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:22:25.363267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:22:25.363267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:22:25.363267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:25.363267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:22:25.363267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:22:25.364825 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0422afbb853d4ef2924edf221499971c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0422afbb853d4ef2924edf221499971c"}]}] Aug 04 23:22:25.364825 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:25.364825 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:22:25.364825 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:25.364825 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:22:25.364825 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:22:25.364825 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:22:25.364825 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: b2ceb35afcc046218bdce1ab4983d9f9 Aug 04 23:22:25.364825 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:22:25.364825 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:22:25.364825 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Instance fcc205d5-c1d3-4f3d-a37f-af9769b7067f could not be found. Aug 04 23:22:25.364825 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': 'fcc205d5-c1d3-4f3d-a37f-af9769b7067f'} Aug 04 23:22:25.365802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:22:25.365802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:25.365802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:22:25.365802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:22:25.365802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:22:25.365802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:22:25.365802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:22:25.365802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:22:25.365802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:22:25.365802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:22:25.365802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcc205d5-c1d3-4f3d-a37f-af9769b7067f could not be found. Aug 04 23:22:25.365802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:22:25.365802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:22:25.365802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:22:25.365802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:25.365802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:22:25.365802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:22:25.365802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:22:25.365802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:22:25.365802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:22:25.367395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:22:25.367395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:22:25.367395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:22:25.367395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:22:25.367395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:22:25.367395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:22:25.367395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:22:25.367395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcc205d5-c1d3-4f3d-a37f-af9769b7067f could not be found. Aug 04 23:22:25.367395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:22:25.367395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:22:25.367395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:22:25.367395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:25.367395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:22:25.367395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:22:25.367395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:22:25.367395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:22:25.367395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcc205d5-c1d3-4f3d-a37f-af9769b7067f could not be found. Aug 04 23:22:25.367395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:22:25.368845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-329c9c93-2665-4236-8236-43bfee4a6340 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Returning 404 to user: Instance fcc205d5-c1d3-4f3d-a37f-af9769b7067f could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:22:25.368845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-329c9c93-2665-4236-8236-43bfee4a6340 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f" status: 404 len: 111 microversion: 2.1 time: 0.032660 Aug 04 23:22:25.368845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 453/939] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:25 2022] GET /compute/v2.1/servers/fcc205d5-c1d3-4f3d-a37f-af9769b7067f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:22:26.504805 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-61663d67-3ba6-4e1e-8bb0-135713f7c6d0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:26.505307 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-61663d67-3ba6-4e1e-8bb0-135713f7c6d0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:26.512497 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-61663d67-3ba6-4e1e-8bb0-135713f7c6d0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:26.512974 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-61663d67-3ba6-4e1e-8bb0-135713f7c6d0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:26.513405 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-61663d67-3ba6-4e1e-8bb0-135713f7c6d0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:26.514096 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-61663d67-3ba6-4e1e-8bb0-135713f7c6d0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:26.514576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-61663d67-3ba6-4e1e-8bb0-135713f7c6d0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:26.514996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-61663d67-3ba6-4e1e-8bb0-135713f7c6d0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:26.528400 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-61663d67-3ba6-4e1e-8bb0-135713f7c6d0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] HTTP exception thrown: Instance 852287f5-010e-4d74-a6ef-a4bf2f47c477 could not be found. Aug 04 23:22:26.530887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-61663d67-3ba6-4e1e-8bb0-135713f7c6d0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Request method failure captured: Aug 04 23:22:26.530887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: DELETE /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 HTTP/1.1 Aug 04 23:22:26.530887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:22:26.530887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:22:26.530887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:22:26.530887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 0 Aug 04 23:22:26.530887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:22:26.530887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:22:26.530887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:22:26.530887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:22:26.530887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FJxolWXoCq7pteacc3wSoOFRBafzn5l-VFi74XBW7wvTawbOokhRmWW1PKP-C_VKEwuqozn26yg856JLZkvKXgHW09fl1p22BiGh5nneUxE7kKr1M8fWXZ4OILMJgqixZXLBIGcxsElt638y0EWPGUaTW1AOdHEnKwXTKYRir1dpV4 Aug 04 23:22:26.530887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:22:26.530887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:22:26.530887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:22:26.530887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:22:26.530887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:22:26.530887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:22:26.530887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:22:26.530887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:26.530887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:22:26.530887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:22:26.532441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0422afbb853d4ef2924edf221499971c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0422afbb853d4ef2924edf221499971c"}]}] Aug 04 23:22:26.532441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:26.532441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:22:26.532441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:26.532441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:22:26.532441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:22:26.532441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:22:26.532441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: b2ceb35afcc046218bdce1ab4983d9f9 Aug 04 23:22:26.532441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:22:26.532441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: > Aug 04 23:22:26.532441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Instance 852287f5-010e-4d74-a6ef-a4bf2f47c477 could not be found. Aug 04 23:22:26.532441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'id': '852287f5-010e-4d74-a6ef-a4bf2f47c477'} Aug 04 23:22:26.533512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:22:26.533512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:26.533512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:22:26.533512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:22:26.533512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:22:26.533512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:22:26.533512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:22:26.533512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:22:26.533512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:22:26.533512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:22:26.533512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852287f5-010e-4d74-a6ef-a4bf2f47c477 could not be found. Aug 04 23:22:26.533512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:26.533512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:22:26.533512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:26.533512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:26.533512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:22:26.533512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:22:26.533512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:22:26.533512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:22:26.533512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:22:26.534992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:22:26.534992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 23:22:26.534992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 23:22:26.534992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 23:22:26.534992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 23:22:26.534992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:22:26.534992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:22:26.534992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:22:26.534992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:22:26.534992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852287f5-010e-4d74-a6ef-a4bf2f47c477 could not be found. Aug 04 23:22:26.534992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:26.534992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:22:26.534992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:26.534992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:26.534992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:22:26.534992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:22:26.534992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:22:26.534992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:22:26.534992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852287f5-010e-4d74-a6ef-a4bf2f47c477 could not be found. Aug 04 23:22:26.534992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:26.536790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-61663d67-3ba6-4e1e-8bb0-135713f7c6d0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Returning 404 to user: Instance 852287f5-010e-4d74-a6ef-a4bf2f47c477 could not be found. {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:22:26.536790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-61663d67-3ba6-4e1e-8bb0-135713f7c6d0 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "DELETE /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 404 len: 111 microversion: 2.1 time: 0.031301 Aug 04 23:22:26.536790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 487/940] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:22:26 2022] DELETE /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:22:26.540635 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ae3454c5-bcdb-41a7-a02f-ead7f2bef486 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:26.541250 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ae3454c5-bcdb-41a7-a02f-ead7f2bef486 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] [instance: 852287f5-010e-4d74-a6ef-a4bf2f47c477] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:26.548243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ae3454c5-bcdb-41a7-a02f-ead7f2bef486 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:26.548725 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ae3454c5-bcdb-41a7-a02f-ead7f2bef486 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:26.549156 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ae3454c5-bcdb-41a7-a02f-ead7f2bef486 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:26.549844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ae3454c5-bcdb-41a7-a02f-ead7f2bef486 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:26.550298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ae3454c5-bcdb-41a7-a02f-ead7f2bef486 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:26.550742 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ae3454c5-bcdb-41a7-a02f-ead7f2bef486 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:26.564661 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-ae3454c5-bcdb-41a7-a02f-ead7f2bef486 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] HTTP exception thrown: Instance 852287f5-010e-4d74-a6ef-a4bf2f47c477 could not be found. Aug 04 23:22:26.566166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ae3454c5-bcdb-41a7-a02f-ead7f2bef486 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Request method failure captured: Aug 04 23:22:26.566166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 HTTP/1.1 Aug 04 23:22:26.566166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:22:26.566166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:22:26.566166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:22:26.566166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:22:26.566166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:22:26.566166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:22:26.566166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:22:26.566166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:22:26.566166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FJxolWXoCq7pteacc3wSoOFRBafzn5l-VFi74XBW7wvTawbOokhRmWW1PKP-C_VKEwuqozn26yg856JLZkvKXgHW09fl1p22BiGh5nneUxE7kKr1M8fWXZ4OILMJgqixZXLBIGcxsElt638y0EWPGUaTW1AOdHEnKwXTKYRir1dpV4 Aug 04 23:22:26.566166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:22:26.566166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:22:26.566166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:22:26.566166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:22:26.566166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:22:26.566166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:22:26.566166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:22:26.566166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:26.566166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:22:26.566166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:22:26.567708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0422afbb853d4ef2924edf221499971c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0422afbb853d4ef2924edf221499971c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0422afbb853d4ef2924edf221499971c"}]}] Aug 04 23:22:26.567708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:26.567708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: 0422afbb853d4ef2924edf221499971c Aug 04 23:22:26.567708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1726099587 Aug 04 23:22:26.567708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:22:26.567708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:22:26.567708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:22:26.567708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: b2ceb35afcc046218bdce1ab4983d9f9 Aug 04 23:22:26.567708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-AttachVolumeNegativeTest-1726099587-project Aug 04 23:22:26.567708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:22:26.567708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Instance 852287f5-010e-4d74-a6ef-a4bf2f47c477 could not be found. Aug 04 23:22:26.567708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': '852287f5-010e-4d74-a6ef-a4bf2f47c477'} Aug 04 23:22:26.568599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:22:26.568599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:26.568599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:22:26.568599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:22:26.568599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:22:26.568599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:22:26.568599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:22:26.568599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:22:26.568599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:22:26.568599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:22:26.568599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852287f5-010e-4d74-a6ef-a4bf2f47c477 could not be found. Aug 04 23:22:26.568599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:22:26.568599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:22:26.568599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:22:26.568599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:26.568599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:22:26.568599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:22:26.568599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:22:26.568599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:22:26.568599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:22:26.570108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:22:26.570108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:22:26.570108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:22:26.570108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:22:26.570108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:22:26.570108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:22:26.570108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:22:26.570108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852287f5-010e-4d74-a6ef-a4bf2f47c477 could not be found. Aug 04 23:22:26.570108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:22:26.570108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:22:26.570108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:22:26.570108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:26.570108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:22:26.570108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:22:26.570108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:22:26.570108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:22:26.570108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852287f5-010e-4d74-a6ef-a4bf2f47c477 could not be found. Aug 04 23:22:26.570108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:22:26.571559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ae3454c5-bcdb-41a7-a02f-ead7f2bef486 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] Returning 404 to user: Instance 852287f5-010e-4d74-a6ef-a4bf2f47c477 could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:22:26.571559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ae3454c5-bcdb-41a7-a02f-ead7f2bef486 tempest-AttachVolumeNegativeTest-1726099587 tempest-AttachVolumeNegativeTest-1726099587-project] 10.222.0.33 "GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477" status: 404 len: 111 microversion: 2.1 time: 0.030750 Aug 04 23:22:26.571559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 454/941] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:26 2022] GET /compute/v2.1/servers/852287f5-010e-4d74-a6ef-a4bf2f47c477 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:22:29.350918 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ef756898-a4f7-41eb-87c7-4e443ff49583 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:29.351725 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ef756898-a4f7-41eb-87c7-4e443ff49583 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:29.359324 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef756898-a4f7-41eb-87c7-4e443ff49583 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:29.359723 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef756898-a4f7-41eb-87c7-4e443ff49583 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:29.360199 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef756898-a4f7-41eb-87c7-4e443ff49583 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:29.360900 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef756898-a4f7-41eb-87c7-4e443ff49583 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:29.361937 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef756898-a4f7-41eb-87c7-4e443ff49583 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:29.361937 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef756898-a4f7-41eb-87c7-4e443ff49583 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:29.390453 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ef756898-a4f7-41eb-87c7-4e443ff49583 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2/ips" status: 200 len: 146 microversion: 2.1 time: 0.043541 Aug 04 23:22:29.391045 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 488/942] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Aug 4 23:22:29 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:22:31.623696 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2bfa01ec-e676-4a98-8a7c-8464c331f255 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b54e6360-e8ea-497d-8fe5-c866683862b9"}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:22:31.626664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2bfa01ec-e676-4a98-8a7c-8464c331f255 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:31.633980 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2bfa01ec-e676-4a98-8a7c-8464c331f255 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:31.634635 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2bfa01ec-e676-4a98-8a7c-8464c331f255 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:31.635082 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2bfa01ec-e676-4a98-8a7c-8464c331f255 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:31.635957 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2bfa01ec-e676-4a98-8a7c-8464c331f255 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:31.636416 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2bfa01ec-e676-4a98-8a7c-8464c331f255 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:31.636838 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2bfa01ec-e676-4a98-8a7c-8464c331f255 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:31.868124 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6f5b670a-826b-473b-9b44-49eadbe7223d tempest-VolumesGetTestJSON-1015966029 tempest-VolumesGetTestJSON-1015966029-project] Action: 'create', calling method: .version_select at 0x7f6d25d0ec10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-672968542", "metadata": {"Type": "work"}}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:22:31.955125 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2bfa01ec-e676-4a98-8a7c-8464c331f255 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "POST /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335347 Aug 04 23:22:31.955728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 455/943] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Aug 4 23:22:31 2022] POST /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:22:32.233741 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6f5b670a-826b-473b-9b44-49eadbe7223d tempest-VolumesGetTestJSON-1015966029 tempest-VolumesGetTestJSON-1015966029-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.567820 Aug 04 23:22:32.234473 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 489/944] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Aug 4 23:22:31 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 570 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 04 23:22:32.248483 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-29c28bbf-c7b6-4822-9f71-ea810a4bbfbc tempest-VolumesGetTestJSON-1015966029 tempest-VolumesGetTestJSON-1015966029-project] Calling method '.version_select at 0x7f6d25ca3ee0>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:32.304392 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-29c28bbf-c7b6-4822-9f71-ea810a4bbfbc tempest-VolumesGetTestJSON-1015966029 tempest-VolumesGetTestJSON-1015966029-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/9c1a454d-73dc-4f4f-8ede-78d5020fc209" status: 200 len: 352 microversion: 2.1 time: 0.060525 Aug 04 23:22:32.305311 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 456/945] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Aug 4 23:22:32 2022] GET /compute/v2.1/os-volumes/9c1a454d-73dc-4f4f-8ede-78d5020fc209 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:22:33.319418 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3223575f-3b0e-4e71-95a5-47674600ce31 tempest-VolumesGetTestJSON-1015966029 tempest-VolumesGetTestJSON-1015966029-project] Calling method '.version_select at 0x7f6d25cff8b0>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:33.367308 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3223575f-3b0e-4e71-95a5-47674600ce31 tempest-VolumesGetTestJSON-1015966029 tempest-VolumesGetTestJSON-1015966029-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/9c1a454d-73dc-4f4f-8ede-78d5020fc209" status: 200 len: 353 microversion: 2.1 time: 0.052598 Aug 04 23:22:33.367962 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 490/946] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Aug 4 23:22:33 2022] GET /compute/v2.1/os-volumes/9c1a454d-73dc-4f4f-8ede-78d5020fc209 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:22:33.381482 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-081efd77-998a-4c0f-bfcf-67bedef22999 tempest-VolumesGetTestJSON-1015966029 tempest-VolumesGetTestJSON-1015966029-project] Calling method '.version_select at 0x7f6d25ec75e0>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:33.428650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-081efd77-998a-4c0f-bfcf-67bedef22999 tempest-VolumesGetTestJSON-1015966029 tempest-VolumesGetTestJSON-1015966029-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/9c1a454d-73dc-4f4f-8ede-78d5020fc209" status: 200 len: 353 microversion: 2.1 time: 0.051279 Aug 04 23:22:33.429212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 457/947] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Aug 4 23:22:33 2022] GET /compute/v2.1/os-volumes/9c1a454d-73dc-4f4f-8ede-78d5020fc209 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:22:33.447090 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c4ff4266-d20d-4eb5-ad29-ba004e2f83a8 tempest-VolumesGetTestJSON-1015966029 tempest-VolumesGetTestJSON-1015966029-project] Calling method '.version_select at 0x7f6d25ce9670>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:33.509882 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c4ff4266-d20d-4eb5-ad29-ba004e2f83a8 tempest-VolumesGetTestJSON-1015966029 tempest-VolumesGetTestJSON-1015966029-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/9c1a454d-73dc-4f4f-8ede-78d5020fc209" status: 202 len: 0 microversion: 2.1 time: 0.066620 Aug 04 23:22:33.510459 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 491/948] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Aug 4 23:22:33 2022] DELETE /compute/v2.1/os-volumes/9c1a454d-73dc-4f4f-8ede-78d5020fc209 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:22:33.518976 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-356a0a4c-59db-4004-a8ac-562f48a46f35 tempest-VolumesGetTestJSON-1015966029 tempest-VolumesGetTestJSON-1015966029-project] Calling method '.version_select at 0x7f6d25d86160>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:33.566486 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-356a0a4c-59db-4004-a8ac-562f48a46f35 tempest-VolumesGetTestJSON-1015966029 tempest-VolumesGetTestJSON-1015966029-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/9c1a454d-73dc-4f4f-8ede-78d5020fc209" status: 200 len: 352 microversion: 2.1 time: 0.051198 Aug 04 23:22:33.567049 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 458/949] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Aug 4 23:22:33 2022] GET /compute/v2.1/os-volumes/9c1a454d-73dc-4f4f-8ede-78d5020fc209 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:22:34.581582 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fc27cb0a-61d3-4025-aaab-aaf2536f4004 tempest-VolumesGetTestJSON-1015966029 tempest-VolumesGetTestJSON-1015966029-project] Calling method '.version_select at 0x7f6d25e624c0>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:34.610069 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-fc27cb0a-61d3-4025-aaab-aaf2536f4004 tempest-VolumesGetTestJSON-1015966029 tempest-VolumesGetTestJSON-1015966029-project] HTTP exception thrown: Volume 9c1a454d-73dc-4f4f-8ede-78d5020fc209 could not be found. Aug 04 23:22:34.612126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fc27cb0a-61d3-4025-aaab-aaf2536f4004 tempest-VolumesGetTestJSON-1015966029 tempest-VolumesGetTestJSON-1015966029-project] Request method failure captured: Aug 04 23:22:34.612126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: GET /compute/v2.1/os-volumes/9c1a454d-73dc-4f4f-8ede-78d5020fc209 HTTP/1.1 Aug 04 23:22:34.612126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:22:34.612126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:22:34.612126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:22:34.612126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 0 Aug 04 23:22:34.612126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:22:34.612126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:22:34.612126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:22:34.612126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:22:34.612126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FS33KOPvxFpL1ECt0tA-jSaw0j55wRUXj50HL-8yXeiH7pqdscDZ6ISovw8Fc4SH9oEgGWP9yzTu5Y_eOurRMGO-v98YUlv4o960t4gBsy2-cGPM4ZYr2qvZKYE6sNBy9MeCkdYurFLLFCBvg09IIJo6whzPlwqkHa60AZD8sEV3uU Aug 04 23:22:34.612126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:22:34.612126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:22:34.612126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:22:34.612126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:22:34.612126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:22:34.612126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:22:34.612126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: 09ffbf8015a94b588de2719a9fba2836 Aug 04 23:22:34.612126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-VolumesGetTestJSON-1015966029 Aug 04 23:22:34.612126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:22:34.612126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:22:34.613790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09ffbf8015a94b588de2719a9fba2836"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_09ffbf8015a94b588de2719a9fba2836"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09ffbf8015a94b588de2719a9fba2836"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/09ffbf8015a94b588de2719a9fba2836"}]}] Aug 04 23:22:34.613790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-VolumesGetTestJSON-1015966029 Aug 04 23:22:34.613790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: 09ffbf8015a94b588de2719a9fba2836 Aug 04 23:22:34.613790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-VolumesGetTestJSON-1015966029 Aug 04 23:22:34.613790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-VolumesGetTestJSON-1015966029-project Aug 04 23:22:34.613790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:22:34.613790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:22:34.613790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: 369de2b1d7414d79b0d816a8c55a449b Aug 04 23:22:34.613790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-VolumesGetTestJSON-1015966029-project Aug 04 23:22:34.613790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: Aug 04 23:22:34.613790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Volume 9c1a454d-73dc-4f4f-8ede-78d5020fc209 could not be found. Aug 04 23:22:34.613790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'id': '9c1a454d-73dc-4f4f-8ede-78d5020fc209'} Aug 04 23:22:34.613790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:22:34.615693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:34.615693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 23:22:34.615693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 23:22:34.615693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 23:22:34.615693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 23:22:34.615693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 23:22:34.615693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 23:22:34.615693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 23:22:34.615693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 23:22:34.615693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 23:22:34.615693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 23:22:34.615693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:22:34.615693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:22:34.615693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:22:34.615693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:22:34.615693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9c1a454d-73dc-4f4f-8ede-78d5020fc209 could not be found. (HTTP 404) (Request-ID: req-4c412047-3008-425a-bd91-f37f6986a5e2) Aug 04 23:22:34.615693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:34.615693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:22:34.615693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:34.617240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:34.617240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 23:22:34.617240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 23:22:34.617240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 23:22:34.617240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 23:22:34.617240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 23:22:34.617240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 23:22:34.617240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 23:22:34.617240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 23:22:34.617240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 23:22:34.617240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 23:22:34.617240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 23:22:34.617240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 23:22:34.617240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 23:22:34.617240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 23:22:34.617240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 23:22:34.617240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 23:22:34.617240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 23:22:34.617240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 23:22:34.618615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:22:34.618615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:22:34.618615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:22:34.618615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:22:34.618615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9c1a454d-73dc-4f4f-8ede-78d5020fc209 could not be found. Aug 04 23:22:34.618615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:34.618615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:22:34.618615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:34.618615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:34.618615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:22:34.618615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:22:34.618615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:22:34.618615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:22:34.618615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 23:22:34.618615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 23:22:34.618615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:22:34.618615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:22:34.618615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 23:22:34.618615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:22:34.620489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9c1a454d-73dc-4f4f-8ede-78d5020fc209 could not be found. Aug 04 23:22:34.620489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:34.620489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:22:34.620489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:34.620489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:22:34.620489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:22:34.620489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:22:34.620489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:22:34.620489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:22:34.620489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9c1a454d-73dc-4f4f-8ede-78d5020fc209 could not be found. Aug 04 23:22:34.620489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:22:34.620489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fc27cb0a-61d3-4025-aaab-aaf2536f4004 tempest-VolumesGetTestJSON-1015966029 tempest-VolumesGetTestJSON-1015966029-project] Returning 404 to user: Volume 9c1a454d-73dc-4f4f-8ede-78d5020fc209 could not be found. {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:22:34.620489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-fc27cb0a-61d3-4025-aaab-aaf2536f4004 tempest-VolumesGetTestJSON-1015966029 tempest-VolumesGetTestJSON-1015966029-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/9c1a454d-73dc-4f4f-8ede-78d5020fc209" status: 404 len: 109 microversion: 2.1 time: 0.037298 Aug 04 23:22:34.620489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 492/950] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Aug 4 23:22:34 2022] GET /compute/v2.1/os-volumes/9c1a454d-73dc-4f4f-8ede-78d5020fc209 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:22:39.513508 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f1f09a67-55d7-4b4b-be55-8444a412edf7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:22:39.520902 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f1f09a67-55d7-4b4b-be55-8444a412edf7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:39.521387 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f1f09a67-55d7-4b4b-be55-8444a412edf7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:39.521815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f1f09a67-55d7-4b4b-be55-8444a412edf7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:39.550569 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:22:39.588816 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f1f09a67-55d7-4b4b-be55-8444a412edf7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Going to try to stop instance {{(pid=129790) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 23:22:39.637240 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f1f09a67-55d7-4b4b-be55-8444a412edf7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "POST /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2/action" status: 202 len: 0 microversion: 2.1 time: 0.127696 Aug 04 23:22:39.638350 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 459/951] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Aug 4 23:22:39 2022] POST /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:22:39.644726 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=27 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:22:39.645845 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=40,nova_cell1:INSERT=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:22:39.652284 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-455cb506-a7a9-4aa2-96a9-549c7962059a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:39.652899 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-455cb506-a7a9-4aa2-96a9-549c7962059a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:39.664871 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-455cb506-a7a9-4aa2-96a9-549c7962059a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:39.665364 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-455cb506-a7a9-4aa2-96a9-549c7962059a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:39.665798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-455cb506-a7a9-4aa2-96a9-549c7962059a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:39.666609 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-455cb506-a7a9-4aa2-96a9-549c7962059a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:39.667060 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-455cb506-a7a9-4aa2-96a9-549c7962059a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:39.667798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-455cb506-a7a9-4aa2-96a9-549c7962059a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:39.806784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-455cb506-a7a9-4aa2-96a9-549c7962059a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:39.815668 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-455cb506-a7a9-4aa2-96a9-549c7962059a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1724 microversion: 2.1 time: 0.173007 Aug 04 23:22:39.816242 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 493/952] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:39 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:22:40.850327 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9a14e8b5-1bde-4bce-b858-470bb916c91a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:40.851049 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9a14e8b5-1bde-4bce-b858-470bb916c91a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:40.857728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a14e8b5-1bde-4bce-b858-470bb916c91a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:40.858205 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a14e8b5-1bde-4bce-b858-470bb916c91a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:40.858664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a14e8b5-1bde-4bce-b858-470bb916c91a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:40.859508 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a14e8b5-1bde-4bce-b858-470bb916c91a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:40.859961 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a14e8b5-1bde-4bce-b858-470bb916c91a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:40.860384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a14e8b5-1bde-4bce-b858-470bb916c91a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:40.994821 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9a14e8b5-1bde-4bce-b858-470bb916c91a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:41.002994 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9a14e8b5-1bde-4bce-b858-470bb916c91a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1724 microversion: 2.1 time: 0.157317 Aug 04 23:22:41.003551 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 460/953] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:40 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:22:42.025012 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b2963753-9f8c-4d65-a0e7-ed98d70b05c6 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:42.025564 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b2963753-9f8c-4d65-a0e7-ed98d70b05c6 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:42.032341 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b2963753-9f8c-4d65-a0e7-ed98d70b05c6 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:42.032826 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b2963753-9f8c-4d65-a0e7-ed98d70b05c6 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:42.033264 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b2963753-9f8c-4d65-a0e7-ed98d70b05c6 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:42.033973 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b2963753-9f8c-4d65-a0e7-ed98d70b05c6 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:42.034453 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b2963753-9f8c-4d65-a0e7-ed98d70b05c6 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:42.034879 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b2963753-9f8c-4d65-a0e7-ed98d70b05c6 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:42.178934 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b2963753-9f8c-4d65-a0e7-ed98d70b05c6 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:42.186898 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b2963753-9f8c-4d65-a0e7-ed98d70b05c6 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1724 microversion: 2.1 time: 0.165869 Aug 04 23:22:42.188147 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 494/954] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:42 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:22:43.208824 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-27581754-f318-44ce-98a0-821ef760fad6 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:43.209434 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-27581754-f318-44ce-98a0-821ef760fad6 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:43.216628 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-27581754-f318-44ce-98a0-821ef760fad6 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:43.217136 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-27581754-f318-44ce-98a0-821ef760fad6 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:43.217571 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-27581754-f318-44ce-98a0-821ef760fad6 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:43.218264 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-27581754-f318-44ce-98a0-821ef760fad6 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:43.221714 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-27581754-f318-44ce-98a0-821ef760fad6 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:43.222970 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-27581754-f318-44ce-98a0-821ef760fad6 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:43.358118 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-27581754-f318-44ce-98a0-821ef760fad6 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:43.366182 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-27581754-f318-44ce-98a0-821ef760fad6 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1724 microversion: 2.1 time: 0.161223 Aug 04 23:22:43.366912 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 461/955] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:43 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:22:44.387990 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7bd7d27c-a321-4085-ba54-03bd1819c4bd tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:44.388517 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7bd7d27c-a321-4085-ba54-03bd1819c4bd tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:44.395103 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7bd7d27c-a321-4085-ba54-03bd1819c4bd tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:44.395586 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7bd7d27c-a321-4085-ba54-03bd1819c4bd tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:44.396013 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7bd7d27c-a321-4085-ba54-03bd1819c4bd tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:44.396711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7bd7d27c-a321-4085-ba54-03bd1819c4bd tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:44.397158 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7bd7d27c-a321-4085-ba54-03bd1819c4bd tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:44.397570 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7bd7d27c-a321-4085-ba54-03bd1819c4bd tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:44.530115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7bd7d27c-a321-4085-ba54-03bd1819c4bd tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:44.538025 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7bd7d27c-a321-4085-ba54-03bd1819c4bd tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1724 microversion: 2.1 time: 0.153999 Aug 04 23:22:44.538604 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 495/956] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:44 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:22:45.558641 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9c6db5d4-0e12-49af-b6b3-b3d99fc40c4b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:45.559288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9c6db5d4-0e12-49af-b6b3-b3d99fc40c4b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:45.566446 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9c6db5d4-0e12-49af-b6b3-b3d99fc40c4b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:45.566937 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9c6db5d4-0e12-49af-b6b3-b3d99fc40c4b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:45.567377 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9c6db5d4-0e12-49af-b6b3-b3d99fc40c4b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:45.568073 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9c6db5d4-0e12-49af-b6b3-b3d99fc40c4b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:45.568531 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9c6db5d4-0e12-49af-b6b3-b3d99fc40c4b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:45.568967 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9c6db5d4-0e12-49af-b6b3-b3d99fc40c4b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:45.863591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9c6db5d4-0e12-49af-b6b3-b3d99fc40c4b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:45.871542 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9c6db5d4-0e12-49af-b6b3-b3d99fc40c4b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1724 microversion: 2.1 time: 0.316845 Aug 04 23:22:45.872105 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 462/957] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:45 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:22:46.893452 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-153583ca-fc4b-4c43-9acf-f27d950c09ec tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:46.894061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-153583ca-fc4b-4c43-9acf-f27d950c09ec tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:46.900565 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-153583ca-fc4b-4c43-9acf-f27d950c09ec tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:46.901044 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-153583ca-fc4b-4c43-9acf-f27d950c09ec tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:46.901469 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-153583ca-fc4b-4c43-9acf-f27d950c09ec tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:46.902160 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-153583ca-fc4b-4c43-9acf-f27d950c09ec tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:46.902638 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-153583ca-fc4b-4c43-9acf-f27d950c09ec tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:46.903057 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-153583ca-fc4b-4c43-9acf-f27d950c09ec tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:47.098720 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-153583ca-fc4b-4c43-9acf-f27d950c09ec tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:47.106704 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-153583ca-fc4b-4c43-9acf-f27d950c09ec tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1724 microversion: 2.1 time: 0.217643 Aug 04 23:22:47.107270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 496/958] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:46 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:22:48.128802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9fbb469d-b9d2-4e85-b212-dd1dbaf2343a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:48.129656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9fbb469d-b9d2-4e85-b212-dd1dbaf2343a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:48.132429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:22:48.137933 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9fbb469d-b9d2-4e85-b212-dd1dbaf2343a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:48.138605 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9fbb469d-b9d2-4e85-b212-dd1dbaf2343a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:48.139148 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9fbb469d-b9d2-4e85-b212-dd1dbaf2343a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:48.139864 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9fbb469d-b9d2-4e85-b212-dd1dbaf2343a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:48.141089 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9fbb469d-b9d2-4e85-b212-dd1dbaf2343a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:48.141394 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9fbb469d-b9d2-4e85-b212-dd1dbaf2343a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:48.272224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9fbb469d-b9d2-4e85-b212-dd1dbaf2343a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:48.280188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9fbb469d-b9d2-4e85-b212-dd1dbaf2343a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1724 microversion: 2.1 time: 0.156410 Aug 04 23:22:48.280847 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 463/959] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:48 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:22:49.301717 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-447fddab-07fc-4990-bf72-2c920403e8ea tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:49.302323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-447fddab-07fc-4990-bf72-2c920403e8ea tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:49.308874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-447fddab-07fc-4990-bf72-2c920403e8ea tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:49.309357 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-447fddab-07fc-4990-bf72-2c920403e8ea tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:49.309784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-447fddab-07fc-4990-bf72-2c920403e8ea tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:49.310490 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-447fddab-07fc-4990-bf72-2c920403e8ea tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:49.310942 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-447fddab-07fc-4990-bf72-2c920403e8ea tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:49.311366 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-447fddab-07fc-4990-bf72-2c920403e8ea tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:49.445371 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-447fddab-07fc-4990-bf72-2c920403e8ea tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:49.454307 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-447fddab-07fc-4990-bf72-2c920403e8ea tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1724 microversion: 2.1 time: 0.156363 Aug 04 23:22:49.454902 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 497/960] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:49 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:22:50.475455 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b60ff67a-314a-4410-930f-16a16ba22668 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:50.475986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b60ff67a-314a-4410-930f-16a16ba22668 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:50.482474 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b60ff67a-314a-4410-930f-16a16ba22668 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:50.482958 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b60ff67a-314a-4410-930f-16a16ba22668 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:50.483395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b60ff67a-314a-4410-930f-16a16ba22668 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:50.484787 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b60ff67a-314a-4410-930f-16a16ba22668 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:50.485336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b60ff67a-314a-4410-930f-16a16ba22668 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:50.485767 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b60ff67a-314a-4410-930f-16a16ba22668 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:50.615436 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b60ff67a-314a-4410-930f-16a16ba22668 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:50.623311 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b60ff67a-314a-4410-930f-16a16ba22668 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1724 microversion: 2.1 time: 0.151781 Aug 04 23:22:50.623884 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 464/961] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:50 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:22:51.646071 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-74742c79-d37b-4e44-a469-eb1c8503d6ce tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:51.646629 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-74742c79-d37b-4e44-a469-eb1c8503d6ce tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:51.653120 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-74742c79-d37b-4e44-a469-eb1c8503d6ce tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:51.653602 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-74742c79-d37b-4e44-a469-eb1c8503d6ce tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:51.654031 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-74742c79-d37b-4e44-a469-eb1c8503d6ce tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:51.654760 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-74742c79-d37b-4e44-a469-eb1c8503d6ce tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:51.655208 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-74742c79-d37b-4e44-a469-eb1c8503d6ce tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:51.655901 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-74742c79-d37b-4e44-a469-eb1c8503d6ce tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:51.789064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-74742c79-d37b-4e44-a469-eb1c8503d6ce tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:51.797358 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-74742c79-d37b-4e44-a469-eb1c8503d6ce tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1724 microversion: 2.1 time: 0.155195 Aug 04 23:22:51.797912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 498/962] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:51 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:22:52.819251 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-24a51768-de7c-4ffe-b417-b2339945734f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:52.819895 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-24a51768-de7c-4ffe-b417-b2339945734f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:52.826274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24a51768-de7c-4ffe-b417-b2339945734f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:52.826787 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24a51768-de7c-4ffe-b417-b2339945734f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:52.827217 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24a51768-de7c-4ffe-b417-b2339945734f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:52.829063 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24a51768-de7c-4ffe-b417-b2339945734f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:52.829549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24a51768-de7c-4ffe-b417-b2339945734f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:52.829976 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24a51768-de7c-4ffe-b417-b2339945734f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:52.971988 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-24a51768-de7c-4ffe-b417-b2339945734f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:52.980275 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-24a51768-de7c-4ffe-b417-b2339945734f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1724 microversion: 2.1 time: 0.165310 Aug 04 23:22:52.980835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 465/963] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:52 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:22:54.003868 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4f40f453-590e-4741-865b-fe3bf10d8791 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:54.004511 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4f40f453-590e-4741-865b-fe3bf10d8791 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:54.010540 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f40f453-590e-4741-865b-fe3bf10d8791 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:54.011026 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f40f453-590e-4741-865b-fe3bf10d8791 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:54.011462 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f40f453-590e-4741-865b-fe3bf10d8791 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:54.012163 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f40f453-590e-4741-865b-fe3bf10d8791 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:54.012614 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f40f453-590e-4741-865b-fe3bf10d8791 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:54.013075 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f40f453-590e-4741-865b-fe3bf10d8791 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:54.142868 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4f40f453-590e-4741-865b-fe3bf10d8791 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:54.151575 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4f40f453-590e-4741-865b-fe3bf10d8791 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1724 microversion: 2.1 time: 0.152451 Aug 04 23:22:54.152154 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 499/964] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:53 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:22:55.173005 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8b66009a-8af1-4a76-aaf4-2b0e2e46ef9c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:55.173606 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8b66009a-8af1-4a76-aaf4-2b0e2e46ef9c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:55.180166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b66009a-8af1-4a76-aaf4-2b0e2e46ef9c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:55.180649 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b66009a-8af1-4a76-aaf4-2b0e2e46ef9c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:55.181083 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b66009a-8af1-4a76-aaf4-2b0e2e46ef9c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:55.181765 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b66009a-8af1-4a76-aaf4-2b0e2e46ef9c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:55.182232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b66009a-8af1-4a76-aaf4-2b0e2e46ef9c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:55.182665 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b66009a-8af1-4a76-aaf4-2b0e2e46ef9c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:55.324629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8b66009a-8af1-4a76-aaf4-2b0e2e46ef9c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:55.332774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8b66009a-8af1-4a76-aaf4-2b0e2e46ef9c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1724 microversion: 2.1 time: 0.164139 Aug 04 23:22:55.333334 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 466/965] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:55 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:22:56.354286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8a0de9de-1e23-4aff-a265-9b1ecf92ad6e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:56.354928 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8a0de9de-1e23-4aff-a265-9b1ecf92ad6e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:56.361480 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8a0de9de-1e23-4aff-a265-9b1ecf92ad6e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:56.361962 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8a0de9de-1e23-4aff-a265-9b1ecf92ad6e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:56.362427 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8a0de9de-1e23-4aff-a265-9b1ecf92ad6e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:56.363120 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8a0de9de-1e23-4aff-a265-9b1ecf92ad6e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:56.363575 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8a0de9de-1e23-4aff-a265-9b1ecf92ad6e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:56.363999 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8a0de9de-1e23-4aff-a265-9b1ecf92ad6e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:56.495559 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8a0de9de-1e23-4aff-a265-9b1ecf92ad6e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:56.504332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8a0de9de-1e23-4aff-a265-9b1ecf92ad6e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1724 microversion: 2.1 time: 0.153843 Aug 04 23:22:56.504901 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 500/966] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:56 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:22:57.525945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ba841714-591e-45ef-b207-23ff22b79d3d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:57.526591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ba841714-591e-45ef-b207-23ff22b79d3d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:57.535753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba841714-591e-45ef-b207-23ff22b79d3d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:57.536238 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba841714-591e-45ef-b207-23ff22b79d3d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:57.536726 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba841714-591e-45ef-b207-23ff22b79d3d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:57.537424 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba841714-591e-45ef-b207-23ff22b79d3d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:57.537865 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba841714-591e-45ef-b207-23ff22b79d3d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:57.538281 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba841714-591e-45ef-b207-23ff22b79d3d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:57.675691 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ba841714-591e-45ef-b207-23ff22b79d3d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:57.685262 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ba841714-591e-45ef-b207-23ff22b79d3d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1724 microversion: 2.1 time: 0.163495 Aug 04 23:22:57.685819 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 467/967] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:57 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:22:58.549467 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0a89d29a-7c7b-44b3-b2aa-9180c1d80dc0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1343453145", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1320467911", "security_groups": [{"name": "tempest-secgroup-smoke-1894323483"}], "block_device_mapping_v2": [{"uuid": "7f0f74b9-0bb9-4dea-95d6-4f26c9a0e4a8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eab51316-848b-42a4-a608-f9226c6150e3"}]}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:22:58.664365 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.network.neutron [None req-0a89d29a-7c7b-44b3-b2aa-9180c1d80dc0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] validate_networks() for [('eab51316-848b-42a4-a608-f9226c6150e3', None, None, None, None, None)] {{(pid=129791) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 23:22:58.708850 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-34cf5676-c8d8-4043-ba0c-eb0ada03f522 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:58.709401 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-34cf5676-c8d8-4043-ba0c-eb0ada03f522 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:58.716257 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34cf5676-c8d8-4043-ba0c-eb0ada03f522 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:58.716747 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34cf5676-c8d8-4043-ba0c-eb0ada03f522 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:58.717192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34cf5676-c8d8-4043-ba0c-eb0ada03f522 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:58.717973 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34cf5676-c8d8-4043-ba0c-eb0ada03f522 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:58.718990 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34cf5676-c8d8-4043-ba0c-eb0ada03f522 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:58.719421 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34cf5676-c8d8-4043-ba0c-eb0ada03f522 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:58.915897 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-34cf5676-c8d8-4043-ba0c-eb0ada03f522 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:58.924633 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-34cf5676-c8d8-4043-ba0c-eb0ada03f522 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1724 microversion: 2.1 time: 0.219702 Aug 04 23:22:58.925208 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 468/968] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:58 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:22:59.111199 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-0a89d29a-7c7b-44b3-b2aa-9180c1d80dc0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Flavor limits 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 23:22:59.111676 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-0a89d29a-7c7b-44b3-b2aa-9180c1d80dc0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Image limits 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 23:22:59.112152 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-0a89d29a-7c7b-44b3-b2aa-9180c1d80dc0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Flavor pref 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 23:22:59.112558 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-0a89d29a-7c7b-44b3-b2aa-9180c1d80dc0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Image pref 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 23:22:59.112967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-0a89d29a-7c7b-44b3-b2aa-9180c1d80dc0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 23:22:59.121663 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0a89d29a-7c7b-44b3-b2aa-9180c1d80dc0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:59.122148 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0a89d29a-7c7b-44b3-b2aa-9180c1d80dc0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:59.122617 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0a89d29a-7c7b-44b3-b2aa-9180c1d80dc0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:59.123354 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0a89d29a-7c7b-44b3-b2aa-9180c1d80dc0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:59.123870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0a89d29a-7c7b-44b3-b2aa-9180c1d80dc0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:59.124894 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0a89d29a-7c7b-44b3-b2aa-9180c1d80dc0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:59.142900 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-0a89d29a-7c7b-44b3-b2aa-9180c1d80dc0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Getting quotas for project 7954e7a03fce4b64b498e68370483def. Resources: {'ram', 'instances', 'cores'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:22:59.147038 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-0a89d29a-7c7b-44b3-b2aa-9180c1d80dc0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Getting quotas for user 95c10802aacf46be91e86b33dff95abc and project 7954e7a03fce4b64b498e68370483def. Resources: {'ram', 'instances', 'cores'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:22:59.206652 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0a89d29a-7c7b-44b3-b2aa-9180c1d80dc0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Going to run 1 instances... {{(pid=129791) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 23:22:59.208724 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0a89d29a-7c7b-44b3-b2aa-9180c1d80dc0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f0f74b9-0bb9-4dea-95d6-4f26c9a0e4a8',volume_size=None,volume_type=None)] {{(pid=129791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 23:22:59.352532 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0a89d29a-7c7b-44b3-b2aa-9180c1d80dc0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.808152 Aug 04 23:22:59.360496 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 501/969] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Aug 4 23:22:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 23:22:59.366011 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-eec6ad2d-232a-4925-859d-e6650abc9f93 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:59.366677 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-eec6ad2d-232a-4925-859d-e6650abc9f93 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:59.462098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-eec6ad2d-232a-4925-859d-e6650abc9f93 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:22:59.471751 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-eec6ad2d-232a-4925-859d-e6650abc9f93 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1095 microversion: 2.1 time: 0.109585 Aug 04 23:22:59.472830 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 469/970] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:59 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1095 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:22:59.948163 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e1e24869-d6ac-49e0-8062-d4cb3af641bc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:22:59.949466 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e1e24869-d6ac-49e0-8062-d4cb3af641bc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:22:59.957973 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1e24869-d6ac-49e0-8062-d4cb3af641bc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:59.958512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1e24869-d6ac-49e0-8062-d4cb3af641bc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:59.958949 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1e24869-d6ac-49e0-8062-d4cb3af641bc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:22:59.959716 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1e24869-d6ac-49e0-8062-d4cb3af641bc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:22:59.960515 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1e24869-d6ac-49e0-8062-d4cb3af641bc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:22:59.961217 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1e24869-d6ac-49e0-8062-d4cb3af641bc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:00.120894 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e1e24869-d6ac-49e0-8062-d4cb3af641bc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:00.129691 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e1e24869-d6ac-49e0-8062-d4cb3af641bc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1724 microversion: 2.1 time: 0.186603 Aug 04 23:23:00.130310 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 502/971] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:22:59 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:23:00.492463 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1117ea4c-6aca-412a-8a32-b9b527d1be47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:00.493161 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1117ea4c-6aca-412a-8a32-b9b527d1be47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:00.501723 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1117ea4c-6aca-412a-8a32-b9b527d1be47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:00.502217 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1117ea4c-6aca-412a-8a32-b9b527d1be47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:00.502679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1117ea4c-6aca-412a-8a32-b9b527d1be47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:00.503384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1117ea4c-6aca-412a-8a32-b9b527d1be47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:00.503840 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1117ea4c-6aca-412a-8a32-b9b527d1be47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:00.504263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1117ea4c-6aca-412a-8a32-b9b527d1be47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:00.571482 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1117ea4c-6aca-412a-8a32-b9b527d1be47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:00.581187 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1117ea4c-6aca-412a-8a32-b9b527d1be47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1211 microversion: 2.1 time: 0.092992 Aug 04 23:23:00.582004 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 470/972] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:00 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:23:01.153807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-decfc5eb-05be-4b82-b9ce-3b5c82088b82 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:01.154582 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-decfc5eb-05be-4b82-b9ce-3b5c82088b82 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:01.161802 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-decfc5eb-05be-4b82-b9ce-3b5c82088b82 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:01.162753 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-decfc5eb-05be-4b82-b9ce-3b5c82088b82 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:01.163423 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-decfc5eb-05be-4b82-b9ce-3b5c82088b82 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:01.164254 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-decfc5eb-05be-4b82-b9ce-3b5c82088b82 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:01.164813 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-decfc5eb-05be-4b82-b9ce-3b5c82088b82 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:01.165458 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-decfc5eb-05be-4b82-b9ce-3b5c82088b82 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:01.357196 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-decfc5eb-05be-4b82-b9ce-3b5c82088b82 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:01.367137 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-decfc5eb-05be-4b82-b9ce-3b5c82088b82 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1701 microversion: 2.1 time: 0.217496 Aug 04 23:23:01.367705 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 503/973] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:01 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1701 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:23:01.388296 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7c79fc74-ebd4-48b5-adbc-09db95d9b207 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:23:01.394675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7c79fc74-ebd4-48b5-adbc-09db95d9b207 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:01.395165 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7c79fc74-ebd4-48b5-adbc-09db95d9b207 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:01.395601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7c79fc74-ebd4-48b5-adbc-09db95d9b207 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:01.419142 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7c79fc74-ebd4-48b5-adbc-09db95d9b207 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Going to try to start instance {{(pid=129790) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 23:23:01.472550 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7c79fc74-ebd4-48b5-adbc-09db95d9b207 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "POST /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2/action" status: 202 len: 0 microversion: 2.1 time: 0.087922 Aug 04 23:23:01.473945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 471/974] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Aug 4 23:23:01 2022] POST /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:23:01.481644 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3ff6e165-6b64-4bfd-bff8-89c34d8dc6c4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:01.482891 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3ff6e165-6b64-4bfd-bff8-89c34d8dc6c4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:01.492814 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ff6e165-6b64-4bfd-bff8-89c34d8dc6c4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:01.493494 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ff6e165-6b64-4bfd-bff8-89c34d8dc6c4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:01.494046 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ff6e165-6b64-4bfd-bff8-89c34d8dc6c4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:01.495094 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ff6e165-6b64-4bfd-bff8-89c34d8dc6c4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:01.495671 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ff6e165-6b64-4bfd-bff8-89c34d8dc6c4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:01.496310 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ff6e165-6b64-4bfd-bff8-89c34d8dc6c4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:01.603714 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-edd0ff72-65f3-4e17-8a03-2ced24cf2cf4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:01.605142 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-edd0ff72-65f3-4e17-8a03-2ced24cf2cf4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:01.616120 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edd0ff72-65f3-4e17-8a03-2ced24cf2cf4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:01.616885 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edd0ff72-65f3-4e17-8a03-2ced24cf2cf4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:01.617497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edd0ff72-65f3-4e17-8a03-2ced24cf2cf4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:01.618388 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edd0ff72-65f3-4e17-8a03-2ced24cf2cf4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:01.618994 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edd0ff72-65f3-4e17-8a03-2ced24cf2cf4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:01.619570 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edd0ff72-65f3-4e17-8a03-2ced24cf2cf4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:01.642940 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3ff6e165-6b64-4bfd-bff8-89c34d8dc6c4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:01.651935 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3ff6e165-6b64-4bfd-bff8-89c34d8dc6c4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1710 microversion: 2.1 time: 0.173882 Aug 04 23:23:01.652609 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 504/975] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:01 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1710 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:23:01.783247 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-edd0ff72-65f3-4e17-8a03-2ced24cf2cf4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:01.790897 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-edd0ff72-65f3-4e17-8a03-2ced24cf2cf4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1267 microversion: 2.1 time: 0.191535 Aug 04 23:23:01.791465 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 472/976] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:01 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:23:02.078699 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-bd74b8a0-2a67-443a-88b3-b08a81022c35 req-788e70d1-8e33-4899-bce2-3e601377702d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d", "tag": "17de7e5d-00f0-4cfb-bf74-3a9d56f6471d"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:23:02.090317 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-bd74b8a0-2a67-443a-88b3-b08a81022c35 req-788e70d1-8e33-4899-bce2-3e601377702d service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:02.090815 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-bd74b8a0-2a67-443a-88b3-b08a81022c35 req-788e70d1-8e33-4899-bce2-3e601377702d service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:02.091247 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-bd74b8a0-2a67-443a-88b3-b08a81022c35 req-788e70d1-8e33-4899-bce2-3e601377702d service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:02.103328 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-bd74b8a0-2a67-443a-88b3-b08a81022c35 req-788e70d1-8e33-4899-bce2-3e601377702d service nova] Creating event network-changed:17de7e5d-00f0-4cfb-bf74-3a9d56f6471d for instance 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d on hv-cinder-85221 Aug 04 23:23:02.108455 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-bd74b8a0-2a67-443a-88b3-b08a81022c35 req-788e70d1-8e33-4899-bce2-3e601377702d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034244 Aug 04 23:23:02.109576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 505/977] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:23:02.678937 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-54ad3345-1ef4-4b24-ae58-e6e397beecb2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:02.679678 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-54ad3345-1ef4-4b24-ae58-e6e397beecb2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:02.687919 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54ad3345-1ef4-4b24-ae58-e6e397beecb2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:02.688644 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54ad3345-1ef4-4b24-ae58-e6e397beecb2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:02.689382 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54ad3345-1ef4-4b24-ae58-e6e397beecb2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:02.690248 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54ad3345-1ef4-4b24-ae58-e6e397beecb2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:02.690936 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54ad3345-1ef4-4b24-ae58-e6e397beecb2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:02.691441 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54ad3345-1ef4-4b24-ae58-e6e397beecb2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:02.815073 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e6686bda-2607-4dda-a264-3f4599907837 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:02.815658 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e6686bda-2607-4dda-a264-3f4599907837 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:02.823654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6686bda-2607-4dda-a264-3f4599907837 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:02.824436 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6686bda-2607-4dda-a264-3f4599907837 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:02.825136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6686bda-2607-4dda-a264-3f4599907837 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:02.825987 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6686bda-2607-4dda-a264-3f4599907837 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:02.826582 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6686bda-2607-4dda-a264-3f4599907837 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:02.827791 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6686bda-2607-4dda-a264-3f4599907837 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:02.840158 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-54ad3345-1ef4-4b24-ae58-e6e397beecb2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:02.855748 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-54ad3345-1ef4-4b24-ae58-e6e397beecb2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1710 microversion: 2.1 time: 0.181261 Aug 04 23:23:02.856499 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 473/978] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:02 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1710 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:23:02.980174 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e6686bda-2607-4dda-a264-3f4599907837 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:02.988578 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e6686bda-2607-4dda-a264-3f4599907837 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1267 microversion: 2.1 time: 0.179168 Aug 04 23:23:02.989152 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 506/979] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:02 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:23:03.877864 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8b3dc1a9-42e2-4985-be51-4e7e94584027 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:03.878503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8b3dc1a9-42e2-4985-be51-4e7e94584027 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:03.884980 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b3dc1a9-42e2-4985-be51-4e7e94584027 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:03.885464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b3dc1a9-42e2-4985-be51-4e7e94584027 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:03.885899 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b3dc1a9-42e2-4985-be51-4e7e94584027 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:03.886620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b3dc1a9-42e2-4985-be51-4e7e94584027 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:03.887073 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b3dc1a9-42e2-4985-be51-4e7e94584027 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:03.887495 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b3dc1a9-42e2-4985-be51-4e7e94584027 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:04.010555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-329b8bc3-784f-45bc-ae26-0f669458ab68 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:04.011265 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-329b8bc3-784f-45bc-ae26-0f669458ab68 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:04.023020 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-329b8bc3-784f-45bc-ae26-0f669458ab68 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:04.023641 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-329b8bc3-784f-45bc-ae26-0f669458ab68 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:04.024108 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-329b8bc3-784f-45bc-ae26-0f669458ab68 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:04.025154 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-329b8bc3-784f-45bc-ae26-0f669458ab68 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:04.025644 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-329b8bc3-784f-45bc-ae26-0f669458ab68 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:04.026073 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-329b8bc3-784f-45bc-ae26-0f669458ab68 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:04.033641 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8b3dc1a9-42e2-4985-be51-4e7e94584027 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:04.036218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:23:04.045170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8b3dc1a9-42e2-4985-be51-4e7e94584027 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1710 microversion: 2.1 time: 0.171627 Aug 04 23:23:04.045784 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 474/980] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:03 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1710 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:23:04.163925 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-329b8bc3-784f-45bc-ae26-0f669458ab68 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:04.172274 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-329b8bc3-784f-45bc-ae26-0f669458ab68 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1267 microversion: 2.1 time: 0.165637 Aug 04 23:23:04.172828 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 507/981] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:04 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:23:05.067549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4e45fb67-d880-4825-9ed0-51cb808aff53 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:05.068242 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4e45fb67-d880-4825-9ed0-51cb808aff53 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:05.075400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e45fb67-d880-4825-9ed0-51cb808aff53 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:05.075885 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e45fb67-d880-4825-9ed0-51cb808aff53 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:05.076424 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e45fb67-d880-4825-9ed0-51cb808aff53 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:05.077842 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e45fb67-d880-4825-9ed0-51cb808aff53 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:05.078390 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e45fb67-d880-4825-9ed0-51cb808aff53 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:05.078852 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e45fb67-d880-4825-9ed0-51cb808aff53 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:05.193593 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-70f4bcbc-2021-4e74-8355-105e0e9d5d02 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:05.194200 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-70f4bcbc-2021-4e74-8355-105e0e9d5d02 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:05.201126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-70f4bcbc-2021-4e74-8355-105e0e9d5d02 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:05.201599 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-70f4bcbc-2021-4e74-8355-105e0e9d5d02 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:05.202807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-70f4bcbc-2021-4e74-8355-105e0e9d5d02 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:05.203753 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-70f4bcbc-2021-4e74-8355-105e0e9d5d02 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:05.204250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-70f4bcbc-2021-4e74-8355-105e0e9d5d02 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:05.204714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-70f4bcbc-2021-4e74-8355-105e0e9d5d02 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:05.213685 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4e45fb67-d880-4825-9ed0-51cb808aff53 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:05.222644 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4e45fb67-d880-4825-9ed0-51cb808aff53 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1714 microversion: 2.1 time: 0.159204 Aug 04 23:23:05.223300 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 475/982] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:05 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1714 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:23:05.341233 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-70f4bcbc-2021-4e74-8355-105e0e9d5d02 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:05.349214 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-70f4bcbc-2021-4e74-8355-105e0e9d5d02 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1267 microversion: 2.1 time: 0.159480 Aug 04 23:23:05.349702 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 508/983] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:05 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:23:06.370816 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ab3c4b1d-491f-4400-b0d0-b9227d61b548 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:06.371535 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ab3c4b1d-491f-4400-b0d0-b9227d61b548 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:06.378074 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab3c4b1d-491f-4400-b0d0-b9227d61b548 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:06.378598 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab3c4b1d-491f-4400-b0d0-b9227d61b548 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:06.379039 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab3c4b1d-491f-4400-b0d0-b9227d61b548 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:06.379731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab3c4b1d-491f-4400-b0d0-b9227d61b548 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:06.380181 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab3c4b1d-491f-4400-b0d0-b9227d61b548 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:06.380603 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab3c4b1d-491f-4400-b0d0-b9227d61b548 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:06.515267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ab3c4b1d-491f-4400-b0d0-b9227d61b548 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:06.523737 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ab3c4b1d-491f-4400-b0d0-b9227d61b548 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1267 microversion: 2.1 time: 0.156947 Aug 04 23:23:06.524298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 476/984] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:06 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:23:07.544768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2aaeff93-59ad-4698-b4e2-c4f390320560 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:07.545326 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2aaeff93-59ad-4698-b4e2-c4f390320560 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:07.552611 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2aaeff93-59ad-4698-b4e2-c4f390320560 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:07.553094 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2aaeff93-59ad-4698-b4e2-c4f390320560 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:07.553528 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2aaeff93-59ad-4698-b4e2-c4f390320560 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:07.554222 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2aaeff93-59ad-4698-b4e2-c4f390320560 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:07.554716 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2aaeff93-59ad-4698-b4e2-c4f390320560 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:07.555141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2aaeff93-59ad-4698-b4e2-c4f390320560 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:07.691652 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2aaeff93-59ad-4698-b4e2-c4f390320560 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:07.699149 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2aaeff93-59ad-4698-b4e2-c4f390320560 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1267 microversion: 2.1 time: 0.158369 Aug 04 23:23:07.699715 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 509/985] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:07 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:23:08.721597 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2b763807-d050-4f77-8c8a-cd725cab7ee5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:08.722209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2b763807-d050-4f77-8c8a-cd725cab7ee5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:08.728819 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2b763807-d050-4f77-8c8a-cd725cab7ee5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:08.729307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2b763807-d050-4f77-8c8a-cd725cab7ee5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:08.729747 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2b763807-d050-4f77-8c8a-cd725cab7ee5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:08.730471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2b763807-d050-4f77-8c8a-cd725cab7ee5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:08.730926 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2b763807-d050-4f77-8c8a-cd725cab7ee5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:08.731351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2b763807-d050-4f77-8c8a-cd725cab7ee5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:08.864405 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2b763807-d050-4f77-8c8a-cd725cab7ee5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:08.871905 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2b763807-d050-4f77-8c8a-cd725cab7ee5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1267 microversion: 2.1 time: 0.155051 Aug 04 23:23:08.872458 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 477/986] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:08 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:23:09.894273 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-861b0aa2-12cd-4c56-8b52-d41b2cdd167d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:09.894922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-861b0aa2-12cd-4c56-8b52-d41b2cdd167d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:09.898424 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=2 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:23:09.899076 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=6 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:23:09.899697 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:23:09.904187 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-861b0aa2-12cd-4c56-8b52-d41b2cdd167d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:09.904668 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-861b0aa2-12cd-4c56-8b52-d41b2cdd167d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:09.905094 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-861b0aa2-12cd-4c56-8b52-d41b2cdd167d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:09.905785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-861b0aa2-12cd-4c56-8b52-d41b2cdd167d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:09.906232 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-861b0aa2-12cd-4c56-8b52-d41b2cdd167d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:09.906680 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-861b0aa2-12cd-4c56-8b52-d41b2cdd167d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:09.910200 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=95 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:23:10.039452 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-861b0aa2-12cd-4c56-8b52-d41b2cdd167d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:10.047598 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-861b0aa2-12cd-4c56-8b52-d41b2cdd167d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1267 microversion: 2.1 time: 0.157837 Aug 04 23:23:10.048156 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 510/987] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:09 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:23:11.068453 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6ca565cc-c2f6-4619-ae3c-e0435958cb84 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:11.069069 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6ca565cc-c2f6-4619-ae3c-e0435958cb84 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:11.070887 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=2 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:23:11.076570 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ca565cc-c2f6-4619-ae3c-e0435958cb84 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:11.077787 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ca565cc-c2f6-4619-ae3c-e0435958cb84 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:11.078463 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ca565cc-c2f6-4619-ae3c-e0435958cb84 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:11.079155 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ca565cc-c2f6-4619-ae3c-e0435958cb84 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:11.079609 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ca565cc-c2f6-4619-ae3c-e0435958cb84 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:11.080029 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ca565cc-c2f6-4619-ae3c-e0435958cb84 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:11.218629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6ca565cc-c2f6-4619-ae3c-e0435958cb84 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:11.226107 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6ca565cc-c2f6-4619-ae3c-e0435958cb84 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1267 microversion: 2.1 time: 0.161538 Aug 04 23:23:11.226700 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 478/988] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:11 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:23:12.247682 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e7079f7f-e166-41e4-8cfe-4e2d6277f9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:12.248325 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e7079f7f-e166-41e4-8cfe-4e2d6277f9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:12.256333 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e7079f7f-e166-41e4-8cfe-4e2d6277f9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:12.256808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e7079f7f-e166-41e4-8cfe-4e2d6277f9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:12.257234 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e7079f7f-e166-41e4-8cfe-4e2d6277f9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:12.257929 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e7079f7f-e166-41e4-8cfe-4e2d6277f9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:12.258394 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e7079f7f-e166-41e4-8cfe-4e2d6277f9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:12.258809 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e7079f7f-e166-41e4-8cfe-4e2d6277f9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:12.391331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e7079f7f-e166-41e4-8cfe-4e2d6277f9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:12.398808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e7079f7f-e166-41e4-8cfe-4e2d6277f9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1267 microversion: 2.1 time: 0.155323 Aug 04 23:23:12.399372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 511/989] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:12 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:23:13.420232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-62e42770-1eeb-439d-804b-4f4119b56246 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:13.421831 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-62e42770-1eeb-439d-804b-4f4119b56246 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:13.428311 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-62e42770-1eeb-439d-804b-4f4119b56246 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:13.428787 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-62e42770-1eeb-439d-804b-4f4119b56246 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:13.429215 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-62e42770-1eeb-439d-804b-4f4119b56246 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:13.429925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-62e42770-1eeb-439d-804b-4f4119b56246 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:13.430388 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-62e42770-1eeb-439d-804b-4f4119b56246 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:13.430817 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-62e42770-1eeb-439d-804b-4f4119b56246 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:13.568449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-62e42770-1eeb-439d-804b-4f4119b56246 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:13.575912 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-62e42770-1eeb-439d-804b-4f4119b56246 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1267 microversion: 2.1 time: 0.159543 Aug 04 23:23:13.576472 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 479/990] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:13 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:23:14.597510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d227ca33-475b-42a7-b241-0c7f164fe4cd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:14.598115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d227ca33-475b-42a7-b241-0c7f164fe4cd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:14.604475 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d227ca33-475b-42a7-b241-0c7f164fe4cd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:14.604945 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d227ca33-475b-42a7-b241-0c7f164fe4cd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:14.605365 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d227ca33-475b-42a7-b241-0c7f164fe4cd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:14.606045 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d227ca33-475b-42a7-b241-0c7f164fe4cd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:14.606513 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d227ca33-475b-42a7-b241-0c7f164fe4cd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:14.606929 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d227ca33-475b-42a7-b241-0c7f164fe4cd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:14.741247 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d227ca33-475b-42a7-b241-0c7f164fe4cd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:14.748854 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d227ca33-475b-42a7-b241-0c7f164fe4cd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1267 microversion: 2.1 time: 0.156210 Aug 04 23:23:14.749427 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 512/991] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:14 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:23:15.769331 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-58da9917-a41a-49df-add5-d0e8c7204ba8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:15.769871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-58da9917-a41a-49df-add5-d0e8c7204ba8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:15.776283 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-58da9917-a41a-49df-add5-d0e8c7204ba8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:15.776771 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-58da9917-a41a-49df-add5-d0e8c7204ba8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:15.777202 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-58da9917-a41a-49df-add5-d0e8c7204ba8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:15.777889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-58da9917-a41a-49df-add5-d0e8c7204ba8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:15.778339 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-58da9917-a41a-49df-add5-d0e8c7204ba8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:15.778795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-58da9917-a41a-49df-add5-d0e8c7204ba8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:15.919773 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-58da9917-a41a-49df-add5-d0e8c7204ba8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:15.927890 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-58da9917-a41a-49df-add5-d0e8c7204ba8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1267 microversion: 2.1 time: 0.162536 Aug 04 23:23:15.928465 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 480/992] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:15 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:23:16.951361 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8e683438-7528-40ec-bb41-50c2dfb5e2da tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:16.952848 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8e683438-7528-40ec-bb41-50c2dfb5e2da tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:16.963109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e683438-7528-40ec-bb41-50c2dfb5e2da tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:16.963706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e683438-7528-40ec-bb41-50c2dfb5e2da tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:16.964179 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e683438-7528-40ec-bb41-50c2dfb5e2da tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:16.964876 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e683438-7528-40ec-bb41-50c2dfb5e2da tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:16.965329 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e683438-7528-40ec-bb41-50c2dfb5e2da tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:16.965754 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e683438-7528-40ec-bb41-50c2dfb5e2da tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:17.099828 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8e683438-7528-40ec-bb41-50c2dfb5e2da tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:17.107277 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8e683438-7528-40ec-bb41-50c2dfb5e2da tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1267 microversion: 2.1 time: 0.161206 Aug 04 23:23:17.107846 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 513/993] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:16 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:23:18.129539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-80e3492e-d0f5-4bc4-8ca4-38d7ba2e926f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:18.130250 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-80e3492e-d0f5-4bc4-8ca4-38d7ba2e926f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:18.136973 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-80e3492e-d0f5-4bc4-8ca4-38d7ba2e926f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:18.137459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-80e3492e-d0f5-4bc4-8ca4-38d7ba2e926f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:18.137898 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-80e3492e-d0f5-4bc4-8ca4-38d7ba2e926f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:18.138777 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-80e3492e-d0f5-4bc4-8ca4-38d7ba2e926f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:18.139983 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-80e3492e-d0f5-4bc4-8ca4-38d7ba2e926f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:18.140521 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-80e3492e-d0f5-4bc4-8ca4-38d7ba2e926f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:18.281429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-80e3492e-d0f5-4bc4-8ca4-38d7ba2e926f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:18.289034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-80e3492e-d0f5-4bc4-8ca4-38d7ba2e926f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1267 microversion: 2.1 time: 0.164161 Aug 04 23:23:18.289602 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 481/994] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:18 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:23:18.412316 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-7341fff1-e769-44d6-83dc-55473631d6fc req-2bcdeb61-7c63-41a8-a06b-e341fa7f3eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d", "name": "network-vif-plugged", "status": "completed", "tag": "17de7e5d-00f0-4cfb-bf74-3a9d56f6471d"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:23:18.423174 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-7341fff1-e769-44d6-83dc-55473631d6fc req-2bcdeb61-7c63-41a8-a06b-e341fa7f3eff service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:18.423649 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-7341fff1-e769-44d6-83dc-55473631d6fc req-2bcdeb61-7c63-41a8-a06b-e341fa7f3eff service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:18.424076 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-7341fff1-e769-44d6-83dc-55473631d6fc req-2bcdeb61-7c63-41a8-a06b-e341fa7f3eff service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:18.435274 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-7341fff1-e769-44d6-83dc-55473631d6fc req-2bcdeb61-7c63-41a8-a06b-e341fa7f3eff service nova] Creating event network-vif-plugged:17de7e5d-00f0-4cfb-bf74-3a9d56f6471d for instance 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d on hv-cinder-85221 Aug 04 23:23:18.441021 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-7341fff1-e769-44d6-83dc-55473631d6fc req-2bcdeb61-7c63-41a8-a06b-e341fa7f3eff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032422 Aug 04 23:23:18.441608 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 514/995] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:23:19.312171 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-510727d4-d339-4233-a5ae-e0ed1104cf2d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:19.312800 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-510727d4-d339-4233-a5ae-e0ed1104cf2d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:19.315267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=40 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:23:19.321034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-510727d4-d339-4233-a5ae-e0ed1104cf2d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:19.321525 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-510727d4-d339-4233-a5ae-e0ed1104cf2d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:19.322060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-510727d4-d339-4233-a5ae-e0ed1104cf2d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:19.322808 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-510727d4-d339-4233-a5ae-e0ed1104cf2d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:19.323266 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-510727d4-d339-4233-a5ae-e0ed1104cf2d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:19.323741 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-510727d4-d339-4233-a5ae-e0ed1104cf2d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:19.466071 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-510727d4-d339-4233-a5ae-e0ed1104cf2d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:19.474331 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-510727d4-d339-4233-a5ae-e0ed1104cf2d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1267 microversion: 2.1 time: 0.166868 Aug 04 23:23:19.475767 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 482/996] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:19 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:23:20.502274 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-cef6a763-b19a-4d59-8ce6-126a4cef3edb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:20.502997 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-cef6a763-b19a-4d59-8ce6-126a4cef3edb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:20.509213 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cef6a763-b19a-4d59-8ce6-126a4cef3edb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:20.509693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cef6a763-b19a-4d59-8ce6-126a4cef3edb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:20.510122 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cef6a763-b19a-4d59-8ce6-126a4cef3edb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:20.510829 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cef6a763-b19a-4d59-8ce6-126a4cef3edb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:20.511278 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cef6a763-b19a-4d59-8ce6-126a4cef3edb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:20.511712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cef6a763-b19a-4d59-8ce6-126a4cef3edb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:20.646946 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cef6a763-b19a-4d59-8ce6-126a4cef3edb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:20.654861 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-cef6a763-b19a-4d59-8ce6-126a4cef3edb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1267 microversion: 2.1 time: 0.161303 Aug 04 23:23:20.655746 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 515/997] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:20 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:23:21.676580 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6c311db1-f8e7-4c04-bd87-024fddc68e79 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:21.677351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6c311db1-f8e7-4c04-bd87-024fddc68e79 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:21.683917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6c311db1-f8e7-4c04-bd87-024fddc68e79 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:21.684394 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6c311db1-f8e7-4c04-bd87-024fddc68e79 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:21.685009 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6c311db1-f8e7-4c04-bd87-024fddc68e79 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:21.685712 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6c311db1-f8e7-4c04-bd87-024fddc68e79 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:21.686162 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6c311db1-f8e7-4c04-bd87-024fddc68e79 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:21.686811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6c311db1-f8e7-4c04-bd87-024fddc68e79 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:21.854629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6c311db1-f8e7-4c04-bd87-024fddc68e79 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:21.863097 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6c311db1-f8e7-4c04-bd87-024fddc68e79 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1453 microversion: 2.1 time: 0.191115 Aug 04 23:23:21.863668 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 483/998] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:21 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1453 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:23:21.883464 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-33efd4fb-d4fb-425d-8dbb-0ac596049a26 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:21.884076 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-33efd4fb-d4fb-425d-8dbb-0ac596049a26 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:21.891149 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33efd4fb-d4fb-425d-8dbb-0ac596049a26 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:21.891632 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33efd4fb-d4fb-425d-8dbb-0ac596049a26 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:21.892071 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33efd4fb-d4fb-425d-8dbb-0ac596049a26 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:21.892760 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33efd4fb-d4fb-425d-8dbb-0ac596049a26 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:21.893220 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33efd4fb-d4fb-425d-8dbb-0ac596049a26 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:21.893646 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33efd4fb-d4fb-425d-8dbb-0ac596049a26 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:22.027808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-33efd4fb-d4fb-425d-8dbb-0ac596049a26 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:22.036091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-33efd4fb-d4fb-425d-8dbb-0ac596049a26 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1453 microversion: 2.1 time: 0.156451 Aug 04 23:23:22.036648 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 516/999] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:23:21 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:23:23.996593 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-574bc4f0-b9f6-4e68-bf5c-ca71116fbd2d req-8dd636e7-7ffd-43a9-b84d-fb690023a4ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d", "tag": "17de7e5d-00f0-4cfb-bf74-3a9d56f6471d"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:23:24.006915 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-574bc4f0-b9f6-4e68-bf5c-ca71116fbd2d req-8dd636e7-7ffd-43a9-b84d-fb690023a4ce service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:24.007676 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-574bc4f0-b9f6-4e68-bf5c-ca71116fbd2d req-8dd636e7-7ffd-43a9-b84d-fb690023a4ce service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:24.008112 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-574bc4f0-b9f6-4e68-bf5c-ca71116fbd2d req-8dd636e7-7ffd-43a9-b84d-fb690023a4ce service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:24.020352 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-574bc4f0-b9f6-4e68-bf5c-ca71116fbd2d req-8dd636e7-7ffd-43a9-b84d-fb690023a4ce service nova] Creating event network-changed:17de7e5d-00f0-4cfb-bf74-3a9d56f6471d for instance 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d on hv-cinder-85221 Aug 04 23:23:24.025304 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-574bc4f0-b9f6-4e68-bf5c-ca71116fbd2d req-8dd636e7-7ffd-43a9-b84d-fb690023a4ce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032445 Aug 04 23:23:24.025890 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 484/1000] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:23:34.907549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-507c704b-8a13-4440-ac29-6f414c41a99c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:34.910293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-507c704b-8a13-4440-ac29-6f414c41a99c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:34.912452 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=13 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:23:34.913097 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=37 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:23:34.918578 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-507c704b-8a13-4440-ac29-6f414c41a99c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:34.919058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-507c704b-8a13-4440-ac29-6f414c41a99c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:34.919486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-507c704b-8a13-4440-ac29-6f414c41a99c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:34.920178 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-507c704b-8a13-4440-ac29-6f414c41a99c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:34.920622 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-507c704b-8a13-4440-ac29-6f414c41a99c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:34.921039 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-507c704b-8a13-4440-ac29-6f414c41a99c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:34.950245 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-507c704b-8a13-4440-ac29-6f414c41a99c tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046719 Aug 04 23:23:34.950827 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 517/1001] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Aug 4 23:23:34 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:23:35.010104 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=5 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:23:35.010882 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=57 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:23:35.014973 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6500dfc0-8fd6-4550-814b-44c1e4439cd5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:35.015582 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6500dfc0-8fd6-4550-814b-44c1e4439cd5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:35.023185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6500dfc0-8fd6-4550-814b-44c1e4439cd5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:35.023659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6500dfc0-8fd6-4550-814b-44c1e4439cd5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:35.024089 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6500dfc0-8fd6-4550-814b-44c1e4439cd5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:35.024773 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6500dfc0-8fd6-4550-814b-44c1e4439cd5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:35.025217 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6500dfc0-8fd6-4550-814b-44c1e4439cd5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:35.025634 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6500dfc0-8fd6-4550-814b-44c1e4439cd5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:35.050404 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6500dfc0-8fd6-4550-814b-44c1e4439cd5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Going to try to terminate instance {{(pid=129790) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 23:23:35.125134 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6500dfc0-8fd6-4550-814b-44c1e4439cd5 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 204 len: 0 microversion: 2.20 time: 0.116307 Aug 04 23:23:35.125752 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 485/1002] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Aug 4 23:23:35 2022] DELETE /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 23:23:35.134038 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-96953321-c4e4-46ec-b07c-25f7580fdc0f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:35.134674 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-96953321-c4e4-46ec-b07c-25f7580fdc0f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:35.140572 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96953321-c4e4-46ec-b07c-25f7580fdc0f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:35.141052 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96953321-c4e4-46ec-b07c-25f7580fdc0f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:35.141486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96953321-c4e4-46ec-b07c-25f7580fdc0f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:35.142177 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96953321-c4e4-46ec-b07c-25f7580fdc0f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:35.142708 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96953321-c4e4-46ec-b07c-25f7580fdc0f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:35.143133 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96953321-c4e4-46ec-b07c-25f7580fdc0f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:35.274949 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-96953321-c4e4-46ec-b07c-25f7580fdc0f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:35.283023 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-96953321-c4e4-46ec-b07c-25f7580fdc0f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:35.285350 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-96953321-c4e4-46ec-b07c-25f7580fdc0f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:35.286565 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-96953321-c4e4-46ec-b07c-25f7580fdc0f tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1723 microversion: 2.20 time: 0.156349 Aug 04 23:23:35.287113 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 518/1003] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:23:35 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:23:36.311273 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-57467c6d-8f94-42a3-8611-fdd1ec9a5f71 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:36.311966 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-57467c6d-8f94-42a3-8611-fdd1ec9a5f71 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:36.319620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57467c6d-8f94-42a3-8611-fdd1ec9a5f71 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:36.320095 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57467c6d-8f94-42a3-8611-fdd1ec9a5f71 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:36.320523 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57467c6d-8f94-42a3-8611-fdd1ec9a5f71 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:36.321206 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57467c6d-8f94-42a3-8611-fdd1ec9a5f71 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:36.321651 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57467c6d-8f94-42a3-8611-fdd1ec9a5f71 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:36.322071 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57467c6d-8f94-42a3-8611-fdd1ec9a5f71 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:36.466389 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-57467c6d-8f94-42a3-8611-fdd1ec9a5f71 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:36.474375 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-57467c6d-8f94-42a3-8611-fdd1ec9a5f71 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:36.475898 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-57467c6d-8f94-42a3-8611-fdd1ec9a5f71 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:36.477063 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-57467c6d-8f94-42a3-8611-fdd1ec9a5f71 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1723 microversion: 2.20 time: 0.170084 Aug 04 23:23:36.477626 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 486/1004] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:23:36 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:23:37.502550 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-460db16b-48ef-4f89-a351-459137b0c3b7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:37.504210 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-460db16b-48ef-4f89-a351-459137b0c3b7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:37.514908 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-460db16b-48ef-4f89-a351-459137b0c3b7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:37.515893 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-460db16b-48ef-4f89-a351-459137b0c3b7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:37.516643 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-460db16b-48ef-4f89-a351-459137b0c3b7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:37.517562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-460db16b-48ef-4f89-a351-459137b0c3b7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:37.518016 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-460db16b-48ef-4f89-a351-459137b0c3b7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:37.518642 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-460db16b-48ef-4f89-a351-459137b0c3b7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:37.681476 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-460db16b-48ef-4f89-a351-459137b0c3b7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:37.694807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-460db16b-48ef-4f89-a351-459137b0c3b7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:37.696373 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-460db16b-48ef-4f89-a351-459137b0c3b7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:37.697790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-460db16b-48ef-4f89-a351-459137b0c3b7 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1723 microversion: 2.20 time: 0.201101 Aug 04 23:23:37.698939 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 519/1005] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:23:37 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:23:38.544474 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-cd507fd7-d589-47cd-ad3c-84b846dc664e req-88bfb2f9-9bec-4ebd-a343-c1066faa46d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be84129-cec2-4633-9a4c-de19980d4dd4", "name": "network-vif-deleted", "tag": "dfb89816-563a-4deb-9f3f-e2414e3b9eeb"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:23:38.558080 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-cd507fd7-d589-47cd-ad3c-84b846dc664e req-88bfb2f9-9bec-4ebd-a343-c1066faa46d8 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:38.558877 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-cd507fd7-d589-47cd-ad3c-84b846dc664e req-88bfb2f9-9bec-4ebd-a343-c1066faa46d8 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:38.559664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-cd507fd7-d589-47cd-ad3c-84b846dc664e req-88bfb2f9-9bec-4ebd-a343-c1066faa46d8 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:38.573705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-cd507fd7-d589-47cd-ad3c-84b846dc664e req-88bfb2f9-9bec-4ebd-a343-c1066faa46d8 service nova] Creating event network-vif-deleted:dfb89816-563a-4deb-9f3f-e2414e3b9eeb for instance 1be84129-cec2-4633-9a4c-de19980d4dd4 on hv-cinder-85221 Aug 04 23:23:38.582178 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-cd507fd7-d589-47cd-ad3c-84b846dc664e req-88bfb2f9-9bec-4ebd-a343-c1066faa46d8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281952 Aug 04 23:23:38.582819 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 487/1006] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:23:38.722351 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-adfb8dbf-6658-49a4-9cce-607825a4c489 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:38.722974 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-adfb8dbf-6658-49a4-9cce-607825a4c489 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:38.729595 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adfb8dbf-6658-49a4-9cce-607825a4c489 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:38.730081 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adfb8dbf-6658-49a4-9cce-607825a4c489 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:38.730535 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adfb8dbf-6658-49a4-9cce-607825a4c489 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:38.731225 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adfb8dbf-6658-49a4-9cce-607825a4c489 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:38.731664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adfb8dbf-6658-49a4-9cce-607825a4c489 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:38.732079 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adfb8dbf-6658-49a4-9cce-607825a4c489 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:38.765104 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adfb8dbf-6658-49a4-9cce-607825a4c489 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:38.765574 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adfb8dbf-6658-49a4-9cce-607825a4c489 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:38.766004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adfb8dbf-6658-49a4-9cce-607825a4c489 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:38.766470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.objects.instance [None req-adfb8dbf-6658-49a4-9cce-607825a4c489 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lazy-loading 'fault' on Instance uuid 1be84129-cec2-4633-9a4c-de19980d4dd4 {{(pid=129791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:23:38.817307 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-adfb8dbf-6658-49a4-9cce-607825a4c489 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:38.826040 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-adfb8dbf-6658-49a4-9cce-607825a4c489 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:38.832264 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-adfb8dbf-6658-49a4-9cce-607825a4c489 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c01696724a7c4291ae29cc10da276ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b185a89edfd42a19bfbeff8d9c66e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:23:38.833519 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-adfb8dbf-6658-49a4-9cce-607825a4c489 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 200 len: 1371 microversion: 2.20 time: 0.115690 Aug 04 23:23:38.834643 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 520/1007] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:23:38 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 1371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 23:23:39.860657 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-68647968-cd49-40a1-887a-ca7515e6f5a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:39.861900 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-68647968-cd49-40a1-887a-ca7515e6f5a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:39.868507 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-68647968-cd49-40a1-887a-ca7515e6f5a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:39.868997 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-68647968-cd49-40a1-887a-ca7515e6f5a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:39.869428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-68647968-cd49-40a1-887a-ca7515e6f5a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:39.870123 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-68647968-cd49-40a1-887a-ca7515e6f5a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:39.870608 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-68647968-cd49-40a1-887a-ca7515e6f5a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:39.871039 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-68647968-cd49-40a1-887a-ca7515e6f5a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:39.886030 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-68647968-cd49-40a1-887a-ca7515e6f5a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] HTTP exception thrown: Instance 1be84129-cec2-4633-9a4c-de19980d4dd4 could not be found. Aug 04 23:23:39.887753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-68647968-cd49-40a1-887a-ca7515e6f5a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Request method failure captured: Aug 04 23:23:39.887753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 HTTP/1.1 Aug 04 23:23:39.887753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:23:39.887753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:23:39.887753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:23:39.887753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:23:39.887753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:23:39.887753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:23:39.887753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:23:39.887753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:23:39.887753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FJ_lNPm7_BwGeDsbzR7xUFf6HRmZFVdHZp64YFZgRkmxH-Sh9Zs7zfyI1tg4rz4fIT0_42EdeSItQjFr98mlpv79qnV8bs9XxAhCJvGYFAjNytRR9pArGDXWp3W8Bz65mqFxVRaY2V6pbgLgjW91HXDnTae7piRZaEU3l6aEGpk3Gc Aug 04 23:23:39.887753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:23:39.887753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:23:39.887753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:23:39.887753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:23:39.887753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 23:23:39.887753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:23:39.887753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:23:39.887753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: 6b185a89edfd42a19bfbeff8d9c66e36 Aug 04 23:23:39.887753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-214528859 Aug 04 23:23:39.887753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:23:39.887753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:23:39.889254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b185a89edfd42a19bfbeff8d9c66e36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6b185a89edfd42a19bfbeff8d9c66e36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b185a89edfd42a19bfbeff8d9c66e36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6b185a89edfd42a19bfbeff8d9c66e36"}]}] Aug 04 23:23:39.889254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-AttachVolumeShelveTestJSON-214528859 Aug 04 23:23:39.889254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: 6b185a89edfd42a19bfbeff8d9c66e36 Aug 04 23:23:39.889254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-214528859 Aug 04 23:23:39.889254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-AttachVolumeShelveTestJSON-214528859-project Aug 04 23:23:39.889254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:23:39.889254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:23:39.889254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: c01696724a7c4291ae29cc10da276ea6 Aug 04 23:23:39.889254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-AttachVolumeShelveTestJSON-214528859-project Aug 04 23:23:39.889254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:23:39.889254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Instance 1be84129-cec2-4633-9a4c-de19980d4dd4 could not be found. Aug 04 23:23:39.889254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': '1be84129-cec2-4633-9a4c-de19980d4dd4'} Aug 04 23:23:39.890169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:23:39.890169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:23:39.890169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:23:39.890169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:23:39.890169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:23:39.890169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:23:39.890169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:23:39.890169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:23:39.890169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:23:39.890169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:23:39.890169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1be84129-cec2-4633-9a4c-de19980d4dd4 could not be found. Aug 04 23:23:39.890169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:23:39.890169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:23:39.890169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:23:39.890169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:23:39.890169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:23:39.890169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:23:39.890169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:23:39.890169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:23:39.890169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:23:39.891497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:23:39.891497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:23:39.891497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:23:39.891497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:23:39.891497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:23:39.891497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:23:39.891497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:23:39.891497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1be84129-cec2-4633-9a4c-de19980d4dd4 could not be found. Aug 04 23:23:39.891497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:23:39.891497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:23:39.891497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:23:39.891497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:23:39.891497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:23:39.891497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:23:39.891497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:23:39.891497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:23:39.891497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1be84129-cec2-4633-9a4c-de19980d4dd4 could not be found. Aug 04 23:23:39.891497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:23:39.893640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-68647968-cd49-40a1-887a-ca7515e6f5a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Returning 404 to user: Instance 1be84129-cec2-4633-9a4c-de19980d4dd4 could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:23:39.893640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-68647968-cd49-40a1-887a-ca7515e6f5a4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 404 len: 111 microversion: 2.20 time: 0.033056 Aug 04 23:23:39.893640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 488/1008] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:23:39 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 23:23:39.900201 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5f0de985-9476-413f-85b6-36c3796298dc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '.version_select at 0x7f6d25cc2550>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:39.921211 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5f0de985-9476-413f-85b6-36c3796298dc tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1076557412" status: 204 len: 0 microversion: 2.20 time: 0.024763 Aug 04 23:23:39.921767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 521/1009] 10.222.0.33 () {60 vars in 1262 bytes} [Thu Aug 4 23:23:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1076557412 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 23:23:41.767941 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0b735ac2-98e0-4c31-b691-c3a25a401545 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:41.768484 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0b735ac2-98e0-4c31-b691-c3a25a401545 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:41.775043 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0b735ac2-98e0-4c31-b691-c3a25a401545 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:41.775531 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0b735ac2-98e0-4c31-b691-c3a25a401545 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:41.775990 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0b735ac2-98e0-4c31-b691-c3a25a401545 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:41.776690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0b735ac2-98e0-4c31-b691-c3a25a401545 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:41.777139 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0b735ac2-98e0-4c31-b691-c3a25a401545 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:41.777563 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0b735ac2-98e0-4c31-b691-c3a25a401545 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:41.791986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-0b735ac2-98e0-4c31-b691-c3a25a401545 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] HTTP exception thrown: Instance 1be84129-cec2-4633-9a4c-de19980d4dd4 could not be found. Aug 04 23:23:41.793549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0b735ac2-98e0-4c31-b691-c3a25a401545 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Request method failure captured: Aug 04 23:23:41.793549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: DELETE /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 HTTP/1.1 Aug 04 23:23:41.793549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:23:41.793549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:23:41.793549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:23:41.793549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:23:41.793549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:23:41.793549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:23:41.793549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:23:41.793549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:23:41.793549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FJ_lNPm7_BwGeDsbzR7xUFf6HRmZFVdHZp64YFZgRkmxH-Sh9Zs7zfyI1tg4rz4fIT0_42EdeSItQjFr98mlpv79qnV8bs9XxAhCJvGYFAjNytRR9pArGDXWp3W8Bz65mqFxVRaY2V6pbgLgjW91HXDnTae7piRZaEU3l6aEGpk3Gc Aug 04 23:23:41.793549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:23:41.793549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:23:41.793549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:23:41.793549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:23:41.793549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 23:23:41.793549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:23:41.793549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:23:41.793549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: 6b185a89edfd42a19bfbeff8d9c66e36 Aug 04 23:23:41.793549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-214528859 Aug 04 23:23:41.793549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:23:41.793549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:23:41.795568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b185a89edfd42a19bfbeff8d9c66e36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6b185a89edfd42a19bfbeff8d9c66e36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b185a89edfd42a19bfbeff8d9c66e36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6b185a89edfd42a19bfbeff8d9c66e36"}]}] Aug 04 23:23:41.795568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-AttachVolumeShelveTestJSON-214528859 Aug 04 23:23:41.795568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: 6b185a89edfd42a19bfbeff8d9c66e36 Aug 04 23:23:41.795568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-214528859 Aug 04 23:23:41.795568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-AttachVolumeShelveTestJSON-214528859-project Aug 04 23:23:41.795568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:23:41.795568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:23:41.795568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: c01696724a7c4291ae29cc10da276ea6 Aug 04 23:23:41.795568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-AttachVolumeShelveTestJSON-214528859-project Aug 04 23:23:41.795568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:23:41.795568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Instance 1be84129-cec2-4633-9a4c-de19980d4dd4 could not be found. Aug 04 23:23:41.795568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': '1be84129-cec2-4633-9a4c-de19980d4dd4'} Aug 04 23:23:41.796449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:23:41.796449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:23:41.796449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:23:41.796449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:23:41.796449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:23:41.796449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:23:41.796449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:23:41.796449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:23:41.796449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:23:41.796449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:23:41.796449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1be84129-cec2-4633-9a4c-de19980d4dd4 could not be found. Aug 04 23:23:41.796449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:23:41.796449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:23:41.796449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:23:41.796449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:23:41.796449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:23:41.796449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:23:41.796449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:23:41.796449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:23:41.796449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:23:41.797658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:23:41.797658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 23:23:41.797658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 23:23:41.797658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 23:23:41.797658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 23:23:41.797658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:23:41.797658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:23:41.797658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:23:41.797658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:23:41.797658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1be84129-cec2-4633-9a4c-de19980d4dd4 could not be found. Aug 04 23:23:41.797658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:23:41.797658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:23:41.797658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:23:41.797658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:23:41.797658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:23:41.797658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:23:41.797658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:23:41.797658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:23:41.797658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1be84129-cec2-4633-9a4c-de19980d4dd4 could not be found. Aug 04 23:23:41.797658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:23:41.799071 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0b735ac2-98e0-4c31-b691-c3a25a401545 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Returning 404 to user: Instance 1be84129-cec2-4633-9a4c-de19980d4dd4 could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:23:41.799071 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0b735ac2-98e0-4c31-b691-c3a25a401545 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 404 len: 111 microversion: 2.20 time: 0.031597 Aug 04 23:23:41.799071 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 489/1010] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Aug 4 23:23:41 2022] DELETE /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 23:23:41.805172 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8af48fd2-a9c2-4d39-9969-04952cdbf7c4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:41.805859 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8af48fd2-a9c2-4d39-9969-04952cdbf7c4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 1be84129-cec2-4633-9a4c-de19980d4dd4] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:41.817549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8af48fd2-a9c2-4d39-9969-04952cdbf7c4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:41.818058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8af48fd2-a9c2-4d39-9969-04952cdbf7c4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:41.818522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8af48fd2-a9c2-4d39-9969-04952cdbf7c4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:41.819232 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8af48fd2-a9c2-4d39-9969-04952cdbf7c4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:41.819716 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8af48fd2-a9c2-4d39-9969-04952cdbf7c4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:41.820138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8af48fd2-a9c2-4d39-9969-04952cdbf7c4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:41.835826 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-8af48fd2-a9c2-4d39-9969-04952cdbf7c4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] HTTP exception thrown: Instance 1be84129-cec2-4633-9a4c-de19980d4dd4 could not be found. Aug 04 23:23:41.837600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8af48fd2-a9c2-4d39-9969-04952cdbf7c4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Request method failure captured: Aug 04 23:23:41.837600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 HTTP/1.1 Aug 04 23:23:41.837600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:23:41.837600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:23:41.837600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:23:41.837600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 0 Aug 04 23:23:41.837600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:23:41.837600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:23:41.837600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:23:41.837600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:23:41.837600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FJ_lNPm7_BwGeDsbzR7xUFf6HRmZFVdHZp64YFZgRkmxH-Sh9Zs7zfyI1tg4rz4fIT0_42EdeSItQjFr98mlpv79qnV8bs9XxAhCJvGYFAjNytRR9pArGDXWp3W8Bz65mqFxVRaY2V6pbgLgjW91HXDnTae7piRZaEU3l6aEGpk3Gc Aug 04 23:23:41.837600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:23:41.837600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:23:41.837600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:23:41.837600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:23:41.837600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 23:23:41.837600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:23:41.837600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:23:41.837600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: 6b185a89edfd42a19bfbeff8d9c66e36 Aug 04 23:23:41.837600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-214528859 Aug 04 23:23:41.837600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:23:41.837600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:23:41.839323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b185a89edfd42a19bfbeff8d9c66e36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6b185a89edfd42a19bfbeff8d9c66e36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b185a89edfd42a19bfbeff8d9c66e36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6b185a89edfd42a19bfbeff8d9c66e36"}]}] Aug 04 23:23:41.839323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-AttachVolumeShelveTestJSON-214528859 Aug 04 23:23:41.839323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: 6b185a89edfd42a19bfbeff8d9c66e36 Aug 04 23:23:41.839323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-214528859 Aug 04 23:23:41.839323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-AttachVolumeShelveTestJSON-214528859-project Aug 04 23:23:41.839323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:23:41.839323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:23:41.839323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: c01696724a7c4291ae29cc10da276ea6 Aug 04 23:23:41.839323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-AttachVolumeShelveTestJSON-214528859-project Aug 04 23:23:41.839323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: > Aug 04 23:23:41.839323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Instance 1be84129-cec2-4633-9a4c-de19980d4dd4 could not be found. Aug 04 23:23:41.839323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'id': '1be84129-cec2-4633-9a4c-de19980d4dd4'} Aug 04 23:23:41.840243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:23:41.840243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:23:41.840243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:23:41.840243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:23:41.840243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:23:41.840243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:23:41.840243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:23:41.840243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:23:41.840243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:23:41.840243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:23:41.840243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1be84129-cec2-4633-9a4c-de19980d4dd4 could not be found. Aug 04 23:23:41.840243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:23:41.840243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:23:41.840243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:23:41.840243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:23:41.840243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:23:41.840243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:23:41.840243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:23:41.840243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:23:41.840243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:23:41.841785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:23:41.841785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:23:41.841785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:23:41.841785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:23:41.841785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:23:41.841785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:23:41.841785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:23:41.841785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1be84129-cec2-4633-9a4c-de19980d4dd4 could not be found. Aug 04 23:23:41.841785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:23:41.841785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:23:41.841785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:23:41.841785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:23:41.841785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:23:41.841785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:23:41.841785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:23:41.841785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:23:41.841785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1be84129-cec2-4633-9a4c-de19980d4dd4 could not be found. Aug 04 23:23:41.841785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:23:41.843765 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8af48fd2-a9c2-4d39-9969-04952cdbf7c4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Returning 404 to user: Instance 1be84129-cec2-4633-9a4c-de19980d4dd4 could not be found. {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:23:41.843765 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8af48fd2-a9c2-4d39-9969-04952cdbf7c4 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4" status: 404 len: 111 microversion: 2.20 time: 0.039369 Aug 04 23:23:41.843765 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 522/1011] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:23:41 2022] GET /compute/v2.1/servers/1be84129-cec2-4633-9a4c-de19980d4dd4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 23:23:42.991442 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4fa5425e-c119-4b91-ba8a-5c3b011a95b3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:42.991930 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4fa5425e-c119-4b91-ba8a-5c3b011a95b3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:42.998247 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4fa5425e-c119-4b91-ba8a-5c3b011a95b3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:42.998758 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4fa5425e-c119-4b91-ba8a-5c3b011a95b3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:42.999193 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4fa5425e-c119-4b91-ba8a-5c3b011a95b3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:42.999888 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4fa5425e-c119-4b91-ba8a-5c3b011a95b3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:43.000332 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4fa5425e-c119-4b91-ba8a-5c3b011a95b3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:43.000750 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4fa5425e-c119-4b91-ba8a-5c3b011a95b3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:43.014733 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-4fa5425e-c119-4b91-ba8a-5c3b011a95b3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] HTTP exception thrown: Instance 2013d923-81bb-4002-976d-64d3722b15d2 could not be found. Aug 04 23:23:43.016316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4fa5425e-c119-4b91-ba8a-5c3b011a95b3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Request method failure captured: Aug 04 23:23:43.016316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: DELETE /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 HTTP/1.1 Aug 04 23:23:43.016316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:23:43.016316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:23:43.016316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:23:43.016316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:23:43.016316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:23:43.016316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:23:43.016316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:23:43.016316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:23:43.016316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FJ_lNPm7_BwGeDsbzR7xUFf6HRmZFVdHZp64YFZgRkmxH-Sh9Zs7zfyI1tg4rz4fIT0_42EdeSItQjFr98mlpv79qnV8bs9XxAhCJvGYFAjNytRR9pArGDXWp3W8Bz65mqFxVRaY2V6pbgLgjW91HXDnTae7piRZaEU3l6aEGpk3Gc Aug 04 23:23:43.016316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:23:43.016316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:23:43.016316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:23:43.016316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:23:43.016316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 23:23:43.016316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:23:43.016316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:23:43.016316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: 6b185a89edfd42a19bfbeff8d9c66e36 Aug 04 23:23:43.016316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-214528859 Aug 04 23:23:43.016316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:23:43.016316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:23:43.018298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b185a89edfd42a19bfbeff8d9c66e36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6b185a89edfd42a19bfbeff8d9c66e36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b185a89edfd42a19bfbeff8d9c66e36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6b185a89edfd42a19bfbeff8d9c66e36"}]}] Aug 04 23:23:43.018298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-AttachVolumeShelveTestJSON-214528859 Aug 04 23:23:43.018298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: 6b185a89edfd42a19bfbeff8d9c66e36 Aug 04 23:23:43.018298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-214528859 Aug 04 23:23:43.018298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-AttachVolumeShelveTestJSON-214528859-project Aug 04 23:23:43.018298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:23:43.018298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:23:43.018298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: c01696724a7c4291ae29cc10da276ea6 Aug 04 23:23:43.018298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-AttachVolumeShelveTestJSON-214528859-project Aug 04 23:23:43.018298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:23:43.018298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Instance 2013d923-81bb-4002-976d-64d3722b15d2 could not be found. Aug 04 23:23:43.018298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': '2013d923-81bb-4002-976d-64d3722b15d2'} Aug 04 23:23:43.019096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:23:43.019096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:23:43.019096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:23:43.019096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:23:43.019096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:23:43.019096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:23:43.019096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:23:43.019096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:23:43.019096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:23:43.019096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:23:43.019096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2013d923-81bb-4002-976d-64d3722b15d2 could not be found. Aug 04 23:23:43.019096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:23:43.019096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:23:43.019096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:23:43.019096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:23:43.019096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:23:43.019096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:23:43.019096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:23:43.019096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:23:43.019096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:23:43.020315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:23:43.020315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 23:23:43.020315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 23:23:43.020315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 23:23:43.020315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 23:23:43.020315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:23:43.020315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:23:43.020315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:23:43.020315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:23:43.020315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2013d923-81bb-4002-976d-64d3722b15d2 could not be found. Aug 04 23:23:43.020315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:23:43.020315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:23:43.020315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:23:43.020315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:23:43.020315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:23:43.020315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:23:43.020315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:23:43.020315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:23:43.020315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2013d923-81bb-4002-976d-64d3722b15d2 could not be found. Aug 04 23:23:43.020315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:23:43.022327 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4fa5425e-c119-4b91-ba8a-5c3b011a95b3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Returning 404 to user: Instance 2013d923-81bb-4002-976d-64d3722b15d2 could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:23:43.022327 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4fa5425e-c119-4b91-ba8a-5c3b011a95b3 tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 404 len: 111 microversion: 2.20 time: 0.030849 Aug 04 23:23:43.022327 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 490/1012] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Aug 4 23:23:42 2022] DELETE /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 23:23:43.027905 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3ad8cc38-4d35-4b7f-ae05-e4e97b8a6b5d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:43.028519 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3ad8cc38-4d35-4b7f-ae05-e4e97b8a6b5d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] [instance: 2013d923-81bb-4002-976d-64d3722b15d2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:23:43.037390 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ad8cc38-4d35-4b7f-ae05-e4e97b8a6b5d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:43.038089 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ad8cc38-4d35-4b7f-ae05-e4e97b8a6b5d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:43.038538 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ad8cc38-4d35-4b7f-ae05-e4e97b8a6b5d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:43.039450 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ad8cc38-4d35-4b7f-ae05-e4e97b8a6b5d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:23:43.039979 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ad8cc38-4d35-4b7f-ae05-e4e97b8a6b5d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:23:43.040497 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ad8cc38-4d35-4b7f-ae05-e4e97b8a6b5d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:23:43.059233 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-3ad8cc38-4d35-4b7f-ae05-e4e97b8a6b5d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] HTTP exception thrown: Instance 2013d923-81bb-4002-976d-64d3722b15d2 could not be found. Aug 04 23:23:43.061288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3ad8cc38-4d35-4b7f-ae05-e4e97b8a6b5d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Request method failure captured: Aug 04 23:23:43.061288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 HTTP/1.1 Aug 04 23:23:43.061288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:23:43.061288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:23:43.061288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:23:43.061288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 0 Aug 04 23:23:43.061288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:23:43.061288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:23:43.061288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:23:43.061288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:23:43.061288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FJ_lNPm7_BwGeDsbzR7xUFf6HRmZFVdHZp64YFZgRkmxH-Sh9Zs7zfyI1tg4rz4fIT0_42EdeSItQjFr98mlpv79qnV8bs9XxAhCJvGYFAjNytRR9pArGDXWp3W8Bz65mqFxVRaY2V6pbgLgjW91HXDnTae7piRZaEU3l6aEGpk3Gc Aug 04 23:23:43.061288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:23:43.061288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:23:43.061288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:23:43.061288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:23:43.061288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 23:23:43.061288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:23:43.061288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:23:43.061288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: 6b185a89edfd42a19bfbeff8d9c66e36 Aug 04 23:23:43.061288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-214528859 Aug 04 23:23:43.061288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:23:43.061288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:23:43.062936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b185a89edfd42a19bfbeff8d9c66e36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6b185a89edfd42a19bfbeff8d9c66e36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b185a89edfd42a19bfbeff8d9c66e36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6b185a89edfd42a19bfbeff8d9c66e36"}]}] Aug 04 23:23:43.062936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-AttachVolumeShelveTestJSON-214528859 Aug 04 23:23:43.062936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: 6b185a89edfd42a19bfbeff8d9c66e36 Aug 04 23:23:43.062936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-214528859 Aug 04 23:23:43.062936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-AttachVolumeShelveTestJSON-214528859-project Aug 04 23:23:43.062936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:23:43.062936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:23:43.062936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: c01696724a7c4291ae29cc10da276ea6 Aug 04 23:23:43.062936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-AttachVolumeShelveTestJSON-214528859-project Aug 04 23:23:43.062936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: > Aug 04 23:23:43.062936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Instance 2013d923-81bb-4002-976d-64d3722b15d2 could not be found. Aug 04 23:23:43.062936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'id': '2013d923-81bb-4002-976d-64d3722b15d2'} Aug 04 23:23:43.063696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:23:43.063696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:23:43.063696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:23:43.063696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:23:43.063696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:23:43.063696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:23:43.063696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:23:43.063696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:23:43.063696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:23:43.063696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:23:43.063696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2013d923-81bb-4002-976d-64d3722b15d2 could not be found. Aug 04 23:23:43.063696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:23:43.063696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:23:43.063696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:23:43.063696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:23:43.063696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:23:43.063696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:23:43.063696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:23:43.063696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:23:43.063696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:23:43.065721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:23:43.065721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:23:43.065721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:23:43.065721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:23:43.065721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:23:43.065721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:23:43.065721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:23:43.065721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2013d923-81bb-4002-976d-64d3722b15d2 could not be found. Aug 04 23:23:43.065721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:23:43.065721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:23:43.065721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:23:43.065721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:23:43.065721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:23:43.065721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:23:43.065721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:23:43.065721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:23:43.065721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2013d923-81bb-4002-976d-64d3722b15d2 could not be found. Aug 04 23:23:43.065721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:23:43.066900 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3ad8cc38-4d35-4b7f-ae05-e4e97b8a6b5d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] Returning 404 to user: Instance 2013d923-81bb-4002-976d-64d3722b15d2 could not be found. {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:23:43.066900 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3ad8cc38-4d35-4b7f-ae05-e4e97b8a6b5d tempest-AttachVolumeShelveTestJSON-214528859 tempest-AttachVolumeShelveTestJSON-214528859-project] 10.222.0.33 "GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2" status: 404 len: 111 microversion: 2.20 time: 0.039455 Aug 04 23:23:43.066900 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 523/1013] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Aug 4 23:23:43 2022] GET /compute/v2.1/servers/2013d923-81bb-4002-976d-64d3722b15d2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 23:23:49.145750 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7e437ab7-1e5c-49bd-9a37-69fc81059d9f tempest-VolumesTestJSON-1449402358 tempest-VolumesTestJSON-1449402358-project] Calling method '.version_select at 0x7f6d25eee5e0>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:49.194553 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7e437ab7-1e5c-49bd-9a37-69fc81059d9f tempest-VolumesTestJSON-1449402358 tempest-VolumesTestJSON-1449402358-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/939f7ca3-790a-4a68-8e15-2fd4ace9e383" status: 200 len: 351 microversion: 2.1 time: 0.053050 Aug 04 23:23:49.195116 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 491/1014] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Aug 4 23:23:49 2022] GET /compute/v2.1/os-volumes/939f7ca3-790a-4a68-8e15-2fd4ace9e383 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:23:50.550732 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-63b387c3-acc0-4ed8-864c-27038159bce0 tempest-VolumesTestJSON-1449402358 tempest-VolumesTestJSON-1449402358-project] Calling method '.version_select at 0x7f6d25ddaca0>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:50.600988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-63b387c3-acc0-4ed8-864c-27038159bce0 tempest-VolumesTestJSON-1449402358 tempest-VolumesTestJSON-1449402358-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/5e4c3cc4-56e1-4bcc-8ae8-d591ea47fb40" status: 200 len: 350 microversion: 2.1 time: 0.054683 Aug 04 23:23:50.601554 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 524/1015] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Aug 4 23:23:50 2022] GET /compute/v2.1/os-volumes/5e4c3cc4-56e1-4bcc-8ae8-d591ea47fb40 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:23:51.956986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0677c46f-8d64-471d-be6e-44bd0901dcae tempest-VolumesTestJSON-1449402358 tempest-VolumesTestJSON-1449402358-project] Calling method '.version_select at 0x7f6d260fe700>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:52.007804 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0677c46f-8d64-471d-be6e-44bd0901dcae tempest-VolumesTestJSON-1449402358 tempest-VolumesTestJSON-1449402358-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/9e19a1d3-e9f5-43b2-af67-39186b772953" status: 200 len: 350 microversion: 2.1 time: 0.056158 Aug 04 23:23:52.008612 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 492/1016] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Aug 4 23:23:51 2022] GET /compute/v2.1/os-volumes/9e19a1d3-e9f5-43b2-af67-39186b772953 => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:23:52.022758 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-98e98959-4ec5-48e9-9f0b-c6c64d4c7722 tempest-VolumesTestJSON-1449402358 tempest-VolumesTestJSON-1449402358-project] Calling method '.version_select at 0x7f6d25d0e040>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:52.108860 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-98e98959-4ec5-48e9-9f0b-c6c64d4c7722 tempest-VolumesTestJSON-1449402358 tempest-VolumesTestJSON-1449402358-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.091084 Aug 04 23:23:52.109438 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 525/1017] 10.222.0.33 () {58 vars in 1134 bytes} [Thu Aug 4 23:23:52 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:23:52.123820 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-60dd4c21-d33c-451c-bb03-19f4b8be05e8 tempest-VolumesTestJSON-1449402358 tempest-VolumesTestJSON-1449402358-project] Calling method '.version_select at 0x7f6d25f22ee0>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:52.210514 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-60dd4c21-d33c-451c-bb03-19f4b8be05e8 tempest-VolumesTestJSON-1449402358 tempest-VolumesTestJSON-1449402358-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.090856 Aug 04 23:23:52.211072 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 493/1018] 10.222.0.33 () {58 vars in 1149 bytes} [Thu Aug 4 23:23:52 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:23:52.226688 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1d431df5-ff33-49dd-9979-4fb98692b5e8 tempest-VolumesTestJSON-1449402358 tempest-VolumesTestJSON-1449402358-project] Calling method '.version_select at 0x7f6d25caae50>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:52.314656 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1d431df5-ff33-49dd-9979-4fb98692b5e8 tempest-VolumesTestJSON-1449402358 tempest-VolumesTestJSON-1449402358-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.092160 Aug 04 23:23:52.315332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 526/1019] 10.222.0.33 () {58 vars in 1134 bytes} [Thu Aug 4 23:23:52 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:23:52.327701 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0875bf50-1884-4125-9395-8c9ef523ac31 tempest-VolumesTestJSON-1449402358 tempest-VolumesTestJSON-1449402358-project] Calling method '.version_select at 0x7f6d25eee550>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:52.415956 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0875bf50-1884-4125-9395-8c9ef523ac31 tempest-VolumesTestJSON-1449402358 tempest-VolumesTestJSON-1449402358-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091966 Aug 04 23:23:52.416522 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 494/1020] 10.222.0.33 () {58 vars in 1167 bytes} [Thu Aug 4 23:23:52 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:23:52.430023 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3d34110a-1843-4864-aaa0-deb6425e1e4e tempest-VolumesTestJSON-1449402358 tempest-VolumesTestJSON-1449402358-project] Calling method '.version_select at 0x7f6d25d95b80>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:52.514096 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3d34110a-1843-4864-aaa0-deb6425e1e4e tempest-VolumesTestJSON-1449402358 tempest-VolumesTestJSON-1449402358-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.087843 Aug 04 23:23:52.514698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 527/1021] 10.222.0.33 () {58 vars in 1170 bytes} [Thu Aug 4 23:23:52 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:23:52.527672 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-283119f9-4a5a-4599-9ee4-018a5eff9dc8 tempest-VolumesTestJSON-1449402358 tempest-VolumesTestJSON-1449402358-project] Calling method '.version_select at 0x7f6d25c4f4c0>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:52.611793 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-283119f9-4a5a-4599-9ee4-018a5eff9dc8 tempest-VolumesTestJSON-1449402358 tempest-VolumesTestJSON-1449402358-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087893 Aug 04 23:23:52.612391 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 495/1022] 10.222.0.33 () {58 vars in 1155 bytes} [Thu Aug 4 23:23:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:23:52.625124 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-50c7e2de-527e-46f3-a17e-9d750973fab2 tempest-VolumesTestJSON-1449402358 tempest-VolumesTestJSON-1449402358-project] Calling method '.version_select at 0x7f6d25d23430>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:52.712240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-50c7e2de-527e-46f3-a17e-9d750973fab2 tempest-VolumesTestJSON-1449402358 tempest-VolumesTestJSON-1449402358-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090940 Aug 04 23:23:52.712804 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 528/1023] 10.222.0.33 () {58 vars in 1188 bytes} [Thu Aug 4 23:23:52 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:23:52.726752 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f00b1c42-77c5-4c1e-af8e-f7cbae9d012b tempest-VolumesTestJSON-1449402358 tempest-VolumesTestJSON-1449402358-project] Calling method '.version_select at 0x7f6d25f51430>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:23:52.809104 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f00b1c42-77c5-4c1e-af8e-f7cbae9d012b tempest-VolumesTestJSON-1449402358 tempest-VolumesTestJSON-1449402358-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.086442 Aug 04 23:23:52.809694 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 496/1024] 10.222.0.33 () {58 vars in 1155 bytes} [Thu Aug 4 23:23:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:10.300530 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-72bfa236-2518-4609-96f3-5186144dfa76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1466155111", "imageRef": "e1e9d70e-b252-44e5-9ecd-bf73cbf00160", "flavorRef": "452", "networks": [{"uuid": "120214f1-3de2-4ddb-917a-25d2c69add2d"}]}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:24:10.310306 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:24:10.311507 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=30 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:24:10.374516 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.network.neutron [None req-72bfa236-2518-4609-96f3-5186144dfa76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] validate_networks() for [('120214f1-3de2-4ddb-917a-25d2c69add2d', None, None, None, None, None)] {{(pid=129791) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 23:24:10.892965 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-72bfa236-2518-4609-96f3-5186144dfa76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Flavor limits 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 23:24:10.893578 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-72bfa236-2518-4609-96f3-5186144dfa76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Image limits 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 23:24:10.894194 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-72bfa236-2518-4609-96f3-5186144dfa76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Flavor pref 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 23:24:10.894661 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-72bfa236-2518-4609-96f3-5186144dfa76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Image pref 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 23:24:10.895070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-72bfa236-2518-4609-96f3-5186144dfa76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 23:24:10.903883 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-72bfa236-2518-4609-96f3-5186144dfa76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:10.904356 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-72bfa236-2518-4609-96f3-5186144dfa76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:10.904787 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-72bfa236-2518-4609-96f3-5186144dfa76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:10.905512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-72bfa236-2518-4609-96f3-5186144dfa76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:10.905961 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-72bfa236-2518-4609-96f3-5186144dfa76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:10.906549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-72bfa236-2518-4609-96f3-5186144dfa76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:10.923983 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-72bfa236-2518-4609-96f3-5186144dfa76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Getting quotas for project 53d297a325844e15bfc7ac1b305789a2. Resources: {'ram', 'instances', 'cores'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:24:10.928035 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-72bfa236-2518-4609-96f3-5186144dfa76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Getting quotas for user 146d37206ef046fe98141e20a6835701 and project 53d297a325844e15bfc7ac1b305789a2. Resources: {'ram', 'instances', 'cores'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:24:10.938890 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-72bfa236-2518-4609-96f3-5186144dfa76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Going to run 1 instances... {{(pid=129791) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 23:24:10.941695 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-72bfa236-2518-4609-96f3-5186144dfa76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1e9d70e-b252-44e5-9ecd-bf73cbf00160',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 23:24:10.989657 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-72bfa236-2518-4609-96f3-5186144dfa76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693624 Aug 04 23:24:10.990418 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 529/1025] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Aug 4 23:24:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 23:24:10.998766 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:24:10.999903 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:24:11.005186 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-44de1b59-05eb-40b2-9519-1a479d80a9b2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:11.005814 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-44de1b59-05eb-40b2-9519-1a479d80a9b2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:11.068269 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-44de1b59-05eb-40b2-9519-1a479d80a9b2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:11.075003 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-44de1b59-05eb-40b2-9519-1a479d80a9b2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea" status: 200 len: 1219 microversion: 2.1 time: 0.077573 Aug 04 23:24:11.075573 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 497/1026] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:10 2022] GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:12.097094 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3bb8b93c-dfbf-4573-9959-d8f524097f91 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:12.098415 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3bb8b93c-dfbf-4573-9959-d8f524097f91 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:12.154476 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3bb8b93c-dfbf-4573-9959-d8f524097f91 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:12.163441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3bb8b93c-dfbf-4573-9959-d8f524097f91 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea" status: 200 len: 1219 microversion: 2.1 time: 0.070226 Aug 04 23:24:12.164019 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 530/1027] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:12 2022] GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:13.184568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e6dd0e61-65bb-4c87-9ab2-f2ad00ac7b3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:13.185202 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e6dd0e61-65bb-4c87-9ab2-f2ad00ac7b3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:13.242134 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e6dd0e61-65bb-4c87-9ab2-f2ad00ac7b3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:13.249259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e6dd0e61-65bb-4c87-9ab2-f2ad00ac7b3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea" status: 200 len: 1219 microversion: 2.1 time: 0.068582 Aug 04 23:24:13.249845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 498/1028] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:13 2022] GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:14.271490 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-33fc1603-eaf8-40af-97e7-b9c3a0ece316 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:14.272207 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-33fc1603-eaf8-40af-97e7-b9c3a0ece316 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:14.344860 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-33fc1603-eaf8-40af-97e7-b9c3a0ece316 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:14.353374 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-33fc1603-eaf8-40af-97e7-b9c3a0ece316 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea" status: 200 len: 1219 microversion: 2.1 time: 0.086798 Aug 04 23:24:14.354103 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 531/1029] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:14 2022] GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:15.375579 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9ed81314-f02b-4a6e-b0eb-2d890e47aa38 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:15.376282 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9ed81314-f02b-4a6e-b0eb-2d890e47aa38 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:15.383380 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ed81314-f02b-4a6e-b0eb-2d890e47aa38 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:15.384103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ed81314-f02b-4a6e-b0eb-2d890e47aa38 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:15.384549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ed81314-f02b-4a6e-b0eb-2d890e47aa38 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:15.385261 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ed81314-f02b-4a6e-b0eb-2d890e47aa38 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:15.385716 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ed81314-f02b-4a6e-b0eb-2d890e47aa38 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:15.386141 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ed81314-f02b-4a6e-b0eb-2d890e47aa38 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:15.453792 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9ed81314-f02b-4a6e-b0eb-2d890e47aa38 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:15.462671 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9ed81314-f02b-4a6e-b0eb-2d890e47aa38 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea" status: 200 len: 1223 microversion: 2.1 time: 0.090933 Aug 04 23:24:15.463181 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 499/1030] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:15 2022] GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:16.482948 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-89aaea42-ee64-4c14-a35c-a0760a7cef0f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:16.483553 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-89aaea42-ee64-4c14-a35c-a0760a7cef0f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:16.490898 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-89aaea42-ee64-4c14-a35c-a0760a7cef0f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:16.491383 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-89aaea42-ee64-4c14-a35c-a0760a7cef0f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:16.491817 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-89aaea42-ee64-4c14-a35c-a0760a7cef0f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:16.492518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-89aaea42-ee64-4c14-a35c-a0760a7cef0f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:16.492965 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-89aaea42-ee64-4c14-a35c-a0760a7cef0f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:16.493383 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-89aaea42-ee64-4c14-a35c-a0760a7cef0f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:16.561622 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-89aaea42-ee64-4c14-a35c-a0760a7cef0f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:16.569375 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-89aaea42-ee64-4c14-a35c-a0760a7cef0f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea" status: 200 len: 1277 microversion: 2.1 time: 0.090086 Aug 04 23:24:16.570010 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 532/1031] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:16 2022] GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:17.490577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-4747b89a-63d2-43f4-993d-da11040a15b4 req-4521621b-91ce-45bd-b91c-e80ef2b84ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b19e8f44-b38f-4a4c-b4d0-5738a590f1ea", "tag": "a1b86cb4-5116-4a36-92ea-91ca9ab69737"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:24:17.504861 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-4747b89a-63d2-43f4-993d-da11040a15b4 req-4521621b-91ce-45bd-b91c-e80ef2b84ba9 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:17.506240 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-4747b89a-63d2-43f4-993d-da11040a15b4 req-4521621b-91ce-45bd-b91c-e80ef2b84ba9 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:17.507378 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-4747b89a-63d2-43f4-993d-da11040a15b4 req-4521621b-91ce-45bd-b91c-e80ef2b84ba9 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:17.520844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-4747b89a-63d2-43f4-993d-da11040a15b4 req-4521621b-91ce-45bd-b91c-e80ef2b84ba9 service nova] Creating event network-changed:a1b86cb4-5116-4a36-92ea-91ca9ab69737 for instance b19e8f44-b38f-4a4c-b4d0-5738a590f1ea on hv-cinder-85221 Aug 04 23:24:17.525765 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-4747b89a-63d2-43f4-993d-da11040a15b4 req-4521621b-91ce-45bd-b91c-e80ef2b84ba9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039427 Aug 04 23:24:17.526442 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 500/1032] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:24:17.590718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-66475dc6-1f9e-4e74-9a51-57532bc4c3eb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:17.591627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-66475dc6-1f9e-4e74-9a51-57532bc4c3eb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:17.600056 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66475dc6-1f9e-4e74-9a51-57532bc4c3eb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:17.600539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66475dc6-1f9e-4e74-9a51-57532bc4c3eb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:17.600997 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66475dc6-1f9e-4e74-9a51-57532bc4c3eb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:17.601670 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66475dc6-1f9e-4e74-9a51-57532bc4c3eb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:17.602117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66475dc6-1f9e-4e74-9a51-57532bc4c3eb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:17.602651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66475dc6-1f9e-4e74-9a51-57532bc4c3eb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:17.744210 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-66475dc6-1f9e-4e74-9a51-57532bc4c3eb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:17.752982 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-66475dc6-1f9e-4e74-9a51-57532bc4c3eb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea" status: 200 len: 1319 microversion: 2.1 time: 0.165848 Aug 04 23:24:17.753561 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 533/1033] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:17 2022] GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:18.775216 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ac4c6875-0f11-4a62-a2b5-1ed55090b8cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:18.775946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ac4c6875-0f11-4a62-a2b5-1ed55090b8cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:18.783229 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac4c6875-0f11-4a62-a2b5-1ed55090b8cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:18.783845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac4c6875-0f11-4a62-a2b5-1ed55090b8cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:18.784277 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac4c6875-0f11-4a62-a2b5-1ed55090b8cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:18.784990 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac4c6875-0f11-4a62-a2b5-1ed55090b8cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:18.785446 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac4c6875-0f11-4a62-a2b5-1ed55090b8cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:18.785867 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac4c6875-0f11-4a62-a2b5-1ed55090b8cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:18.922880 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ac4c6875-0f11-4a62-a2b5-1ed55090b8cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:18.931015 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ac4c6875-0f11-4a62-a2b5-1ed55090b8cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea" status: 200 len: 1319 microversion: 2.1 time: 0.159979 Aug 04 23:24:18.931583 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 501/1034] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:18 2022] GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:19.952840 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9fb0025b-e2fe-4e0a-971d-a6486f76f4d2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:19.953525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9fb0025b-e2fe-4e0a-971d-a6486f76f4d2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:19.960512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9fb0025b-e2fe-4e0a-971d-a6486f76f4d2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:19.961003 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9fb0025b-e2fe-4e0a-971d-a6486f76f4d2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:19.961420 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9fb0025b-e2fe-4e0a-971d-a6486f76f4d2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:19.962107 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9fb0025b-e2fe-4e0a-971d-a6486f76f4d2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:19.962585 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9fb0025b-e2fe-4e0a-971d-a6486f76f4d2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:19.963002 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9fb0025b-e2fe-4e0a-971d-a6486f76f4d2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:20.100218 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9fb0025b-e2fe-4e0a-971d-a6486f76f4d2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:20.107856 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9fb0025b-e2fe-4e0a-971d-a6486f76f4d2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea" status: 200 len: 1319 microversion: 2.1 time: 0.159425 Aug 04 23:24:20.108413 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 534/1035] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:19 2022] GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:21.128971 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7181692f-763a-4f93-a84c-372e2841c616 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:21.129584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7181692f-763a-4f93-a84c-372e2841c616 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:21.136089 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7181692f-763a-4f93-a84c-372e2841c616 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:21.136565 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7181692f-763a-4f93-a84c-372e2841c616 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:21.136999 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7181692f-763a-4f93-a84c-372e2841c616 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:21.137691 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7181692f-763a-4f93-a84c-372e2841c616 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:21.138146 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7181692f-763a-4f93-a84c-372e2841c616 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:21.138604 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7181692f-763a-4f93-a84c-372e2841c616 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:21.288226 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7181692f-763a-4f93-a84c-372e2841c616 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:21.296506 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7181692f-763a-4f93-a84c-372e2841c616 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea" status: 200 len: 1319 microversion: 2.1 time: 0.171856 Aug 04 23:24:21.297666 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 502/1036] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:21 2022] GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:22.318576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=2 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:24:22.324799 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3e7dac0f-e9a7-4ab9-b3f9-397b14c7daba tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:22.325416 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3e7dac0f-e9a7-4ab9-b3f9-397b14c7daba tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:22.332637 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e7dac0f-e9a7-4ab9-b3f9-397b14c7daba tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:22.333113 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e7dac0f-e9a7-4ab9-b3f9-397b14c7daba tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:22.333831 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e7dac0f-e9a7-4ab9-b3f9-397b14c7daba tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:22.334567 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e7dac0f-e9a7-4ab9-b3f9-397b14c7daba tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:22.335022 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e7dac0f-e9a7-4ab9-b3f9-397b14c7daba tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:22.335445 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e7dac0f-e9a7-4ab9-b3f9-397b14c7daba tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:22.466448 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3e7dac0f-e9a7-4ab9-b3f9-397b14c7daba tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:22.474405 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3e7dac0f-e9a7-4ab9-b3f9-397b14c7daba tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea" status: 200 len: 1319 microversion: 2.1 time: 0.157760 Aug 04 23:24:22.474971 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 535/1037] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:22 2022] GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:23.137704 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7f83ec28-177d-4c82-b84a-7dbc7af76aef tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:23.138272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7f83ec28-177d-4c82-b84a-7dbc7af76aef tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:23.145593 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7f83ec28-177d-4c82-b84a-7dbc7af76aef tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:23.146086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7f83ec28-177d-4c82-b84a-7dbc7af76aef tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:23.146569 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7f83ec28-177d-4c82-b84a-7dbc7af76aef tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:23.147283 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7f83ec28-177d-4c82-b84a-7dbc7af76aef tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:23.147789 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7f83ec28-177d-4c82-b84a-7dbc7af76aef tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:23.148216 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7f83ec28-177d-4c82-b84a-7dbc7af76aef tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:23.237104 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.objects.instance [None req-7f83ec28-177d-4c82-b84a-7dbc7af76aef tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lazy-loading 'services' on Instance uuid 46a7e2be-71c5-4d64-b02a-a8d125d790e2 {{(pid=129790) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:24:23.248674 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=4 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:24:23.322810 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7f83ec28-177d-4c82-b84a-7dbc7af76aef tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "DELETE /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2/os-volume_attachments/b54e6360-e8ea-497d-8fe5-c866683862b9" status: 202 len: 0 microversion: 2.1 time: 0.189271 Aug 04 23:24:23.323717 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 503/1038] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Aug 4 23:24:23 2022] DELETE /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2/os-volume_attachments/b54e6360-e8ea-497d-8fe5-c866683862b9 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:24:23.495644 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1ba41553-e8da-4a98-85d4-f9a8471915f3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:23.496251 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1ba41553-e8da-4a98-85d4-f9a8471915f3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:23.503750 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ba41553-e8da-4a98-85d4-f9a8471915f3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:23.504357 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ba41553-e8da-4a98-85d4-f9a8471915f3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:23.504976 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ba41553-e8da-4a98-85d4-f9a8471915f3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:23.505844 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ba41553-e8da-4a98-85d4-f9a8471915f3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:23.506335 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ba41553-e8da-4a98-85d4-f9a8471915f3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:23.506898 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ba41553-e8da-4a98-85d4-f9a8471915f3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:23.643958 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1ba41553-e8da-4a98-85d4-f9a8471915f3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:23.651532 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1ba41553-e8da-4a98-85d4-f9a8471915f3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea" status: 200 len: 1319 microversion: 2.1 time: 0.159760 Aug 04 23:24:23.652130 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 536/1039] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:23 2022] GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:24.454708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0421ff41-0810-41a4-9400-313c2d3ccb95 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:24:24.463280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0421ff41-0810-41a4-9400-313c2d3ccb95 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:24.464407 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0421ff41-0810-41a4-9400-313c2d3ccb95 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:24.464856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0421ff41-0810-41a4-9400-313c2d3ccb95 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:24.490992 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0421ff41-0810-41a4-9400-313c2d3ccb95 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Going to try to stop instance {{(pid=129790) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 23:24:24.540835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0421ff41-0810-41a4-9400-313c2d3ccb95 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "POST /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2/action" status: 202 len: 0 microversion: 2.1 time: 0.091815 Aug 04 23:24:24.541897 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 504/1040] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Aug 4 23:24:24 2022] POST /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:24:24.554422 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-739743f7-f5b1-4640-ac81-000e398964f4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:24.555967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-739743f7-f5b1-4640-ac81-000e398964f4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:24.558702 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=10 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:24:24.571007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-739743f7-f5b1-4640-ac81-000e398964f4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:24.577256 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-739743f7-f5b1-4640-ac81-000e398964f4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:24.578042 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-739743f7-f5b1-4640-ac81-000e398964f4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:24.580869 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-739743f7-f5b1-4640-ac81-000e398964f4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:24.581583 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-739743f7-f5b1-4640-ac81-000e398964f4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:24.582026 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-739743f7-f5b1-4640-ac81-000e398964f4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:24.673065 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4e41c2c9-1a16-4956-99d9-2e623850186a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:24.674871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4e41c2c9-1a16-4956-99d9-2e623850186a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:24.682029 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e41c2c9-1a16-4956-99d9-2e623850186a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:24.683032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e41c2c9-1a16-4956-99d9-2e623850186a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:24.683569 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e41c2c9-1a16-4956-99d9-2e623850186a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:24.684402 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e41c2c9-1a16-4956-99d9-2e623850186a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:24.685071 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e41c2c9-1a16-4956-99d9-2e623850186a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:24.685577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e41c2c9-1a16-4956-99d9-2e623850186a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:24.791605 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-739743f7-f5b1-4640-ac81-000e398964f4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:24.801032 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-739743f7-f5b1-4640-ac81-000e398964f4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1678 microversion: 2.1 time: 0.254497 Aug 04 23:24:24.801965 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 537/1041] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:24 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1678 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:24:24.808512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-7ce3c076-8f09-4c58-b6af-13c104e989c8 req-e2826570-1c6f-4dbf-a4ba-9f1634cc6f7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19e8f44-b38f-4a4c-b4d0-5738a590f1ea", "name": "network-vif-plugged", "status": "completed", "tag": "a1b86cb4-5116-4a36-92ea-91ca9ab69737"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:24:24.824509 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-7ce3c076-8f09-4c58-b6af-13c104e989c8 req-e2826570-1c6f-4dbf-a4ba-9f1634cc6f7d service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:24.825089 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-7ce3c076-8f09-4c58-b6af-13c104e989c8 req-e2826570-1c6f-4dbf-a4ba-9f1634cc6f7d service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:24.825588 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-7ce3c076-8f09-4c58-b6af-13c104e989c8 req-e2826570-1c6f-4dbf-a4ba-9f1634cc6f7d service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:24.883554 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4e41c2c9-1a16-4956-99d9-2e623850186a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:24.891751 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4e41c2c9-1a16-4956-99d9-2e623850186a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea" status: 200 len: 1319 microversion: 2.1 time: 0.222912 Aug 04 23:24:24.892392 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 505/1042] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:24 2022] GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:24.997878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-7ce3c076-8f09-4c58-b6af-13c104e989c8 req-e2826570-1c6f-4dbf-a4ba-9f1634cc6f7d service nova] Creating event network-vif-plugged:a1b86cb4-5116-4a36-92ea-91ca9ab69737 for instance b19e8f44-b38f-4a4c-b4d0-5738a590f1ea on hv-cinder-85221 Aug 04 23:24:25.003214 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-7ce3c076-8f09-4c58-b6af-13c104e989c8 req-e2826570-1c6f-4dbf-a4ba-9f1634cc6f7d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199531 Aug 04 23:24:25.003814 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 538/1043] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:24:25.824444 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-69b4723d-112e-498e-9951-02c21727495d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:25.825158 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-69b4723d-112e-498e-9951-02c21727495d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:25.833202 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-69b4723d-112e-498e-9951-02c21727495d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:25.833947 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-69b4723d-112e-498e-9951-02c21727495d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:25.834396 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-69b4723d-112e-498e-9951-02c21727495d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:25.835108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-69b4723d-112e-498e-9951-02c21727495d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:25.835553 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-69b4723d-112e-498e-9951-02c21727495d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:25.835968 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-69b4723d-112e-498e-9951-02c21727495d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:25.915250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5575a4cc-cae0-4fdf-8aa3-fee629fd6e97 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:25.918295 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5575a4cc-cae0-4fdf-8aa3-fee629fd6e97 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:25.929316 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5575a4cc-cae0-4fdf-8aa3-fee629fd6e97 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:25.929878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5575a4cc-cae0-4fdf-8aa3-fee629fd6e97 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:25.930339 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5575a4cc-cae0-4fdf-8aa3-fee629fd6e97 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:25.931807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5575a4cc-cae0-4fdf-8aa3-fee629fd6e97 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:25.932297 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5575a4cc-cae0-4fdf-8aa3-fee629fd6e97 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:25.932743 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5575a4cc-cae0-4fdf-8aa3-fee629fd6e97 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:25.991807 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-69b4723d-112e-498e-9951-02c21727495d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:25.999927 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-69b4723d-112e-498e-9951-02c21727495d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1678 microversion: 2.1 time: 0.179471 Aug 04 23:24:26.000495 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 506/1044] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:25 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:26.081309 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5575a4cc-cae0-4fdf-8aa3-fee629fd6e97 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:26.089524 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5575a4cc-cae0-4fdf-8aa3-fee629fd6e97 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea" status: 200 len: 1319 microversion: 2.1 time: 0.179364 Aug 04 23:24:26.090136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 539/1045] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:25 2022] GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:24:27.021072 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d3c712fe-afef-4bc3-9f20-a063ea23ddfc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:27.021684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d3c712fe-afef-4bc3-9f20-a063ea23ddfc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:27.028164 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3c712fe-afef-4bc3-9f20-a063ea23ddfc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:27.028646 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3c712fe-afef-4bc3-9f20-a063ea23ddfc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:27.029081 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3c712fe-afef-4bc3-9f20-a063ea23ddfc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:27.029772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3c712fe-afef-4bc3-9f20-a063ea23ddfc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:27.030219 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3c712fe-afef-4bc3-9f20-a063ea23ddfc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:27.030664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3c712fe-afef-4bc3-9f20-a063ea23ddfc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:27.110753 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-df2edcf1-5ec3-4b0c-974f-dd538333574d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:27.111934 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-df2edcf1-5ec3-4b0c-974f-dd538333574d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:27.118747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-df2edcf1-5ec3-4b0c-974f-dd538333574d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:27.119230 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-df2edcf1-5ec3-4b0c-974f-dd538333574d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:27.119657 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-df2edcf1-5ec3-4b0c-974f-dd538333574d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:27.120361 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-df2edcf1-5ec3-4b0c-974f-dd538333574d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:27.120807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-df2edcf1-5ec3-4b0c-974f-dd538333574d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:27.121219 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-df2edcf1-5ec3-4b0c-974f-dd538333574d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:27.179511 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d3c712fe-afef-4bc3-9f20-a063ea23ddfc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:27.189602 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d3c712fe-afef-4bc3-9f20-a063ea23ddfc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1678 microversion: 2.1 time: 0.172019 Aug 04 23:24:27.192469 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 507/1046] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:27 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:27.267338 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-df2edcf1-5ec3-4b0c-974f-dd538333574d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:27.275008 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-df2edcf1-5ec3-4b0c-974f-dd538333574d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea" status: 200 len: 1507 microversion: 2.1 time: 0.168346 Aug 04 23:24:27.275564 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 540/1047] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:27 2022] GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:28.211557 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-920d05f6-92dc-4d39-afbe-6ee2e727d441 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:28.212166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-920d05f6-92dc-4d39-afbe-6ee2e727d441 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:28.218590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-920d05f6-92dc-4d39-afbe-6ee2e727d441 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:28.219074 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-920d05f6-92dc-4d39-afbe-6ee2e727d441 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:28.219508 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-920d05f6-92dc-4d39-afbe-6ee2e727d441 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:28.220195 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-920d05f6-92dc-4d39-afbe-6ee2e727d441 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:28.220700 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-920d05f6-92dc-4d39-afbe-6ee2e727d441 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:28.221146 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-920d05f6-92dc-4d39-afbe-6ee2e727d441 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:28.353291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-920d05f6-92dc-4d39-afbe-6ee2e727d441 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:28.360814 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-920d05f6-92dc-4d39-afbe-6ee2e727d441 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1678 microversion: 2.1 time: 0.153424 Aug 04 23:24:28.361944 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 508/1048] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:28 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:29.382596 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6fadd53e-5929-4bf1-813b-c74b269106b7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:29.383197 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6fadd53e-5929-4bf1-813b-c74b269106b7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:29.389574 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6fadd53e-5929-4bf1-813b-c74b269106b7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:29.390034 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6fadd53e-5929-4bf1-813b-c74b269106b7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:29.390484 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6fadd53e-5929-4bf1-813b-c74b269106b7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:29.391166 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6fadd53e-5929-4bf1-813b-c74b269106b7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:29.391606 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6fadd53e-5929-4bf1-813b-c74b269106b7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:29.392017 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6fadd53e-5929-4bf1-813b-c74b269106b7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:29.527139 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6fadd53e-5929-4bf1-813b-c74b269106b7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:29.535123 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6fadd53e-5929-4bf1-813b-c74b269106b7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1678 microversion: 2.1 time: 0.156475 Aug 04 23:24:29.535668 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 541/1049] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:29 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:30.556004 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2cf9d55a-46fc-439f-b5a2-53ae7a02f46b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:30.556620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2cf9d55a-46fc-439f-b5a2-53ae7a02f46b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:30.563051 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2cf9d55a-46fc-439f-b5a2-53ae7a02f46b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:30.563535 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2cf9d55a-46fc-439f-b5a2-53ae7a02f46b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:30.563980 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2cf9d55a-46fc-439f-b5a2-53ae7a02f46b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:30.564828 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2cf9d55a-46fc-439f-b5a2-53ae7a02f46b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:30.565449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2cf9d55a-46fc-439f-b5a2-53ae7a02f46b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:30.565879 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2cf9d55a-46fc-439f-b5a2-53ae7a02f46b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:30.703258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2cf9d55a-46fc-439f-b5a2-53ae7a02f46b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:30.711512 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2cf9d55a-46fc-439f-b5a2-53ae7a02f46b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1678 microversion: 2.1 time: 0.159320 Aug 04 23:24:30.712078 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 509/1050] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:30 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:31.732493 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-80bccbe1-9757-4795-b644-3c27b3d166e1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:31.733110 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-80bccbe1-9757-4795-b644-3c27b3d166e1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:31.740549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80bccbe1-9757-4795-b644-3c27b3d166e1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:31.741035 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80bccbe1-9757-4795-b644-3c27b3d166e1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:31.741475 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80bccbe1-9757-4795-b644-3c27b3d166e1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:31.742189 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80bccbe1-9757-4795-b644-3c27b3d166e1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:31.742667 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80bccbe1-9757-4795-b644-3c27b3d166e1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:31.743097 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80bccbe1-9757-4795-b644-3c27b3d166e1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:31.878453 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-80bccbe1-9757-4795-b644-3c27b3d166e1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:31.886617 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-80bccbe1-9757-4795-b644-3c27b3d166e1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1678 microversion: 2.1 time: 0.157942 Aug 04 23:24:31.887175 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 542/1051] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:31 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:32.909273 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f3e74375-051c-4576-81f0-22930f22fe1d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:32.909896 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f3e74375-051c-4576-81f0-22930f22fe1d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:32.917294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f3e74375-051c-4576-81f0-22930f22fe1d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:32.917778 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f3e74375-051c-4576-81f0-22930f22fe1d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:32.918214 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f3e74375-051c-4576-81f0-22930f22fe1d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:32.918956 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f3e74375-051c-4576-81f0-22930f22fe1d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:32.919414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f3e74375-051c-4576-81f0-22930f22fe1d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:32.919835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f3e74375-051c-4576-81f0-22930f22fe1d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:33.062137 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f3e74375-051c-4576-81f0-22930f22fe1d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:33.069896 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f3e74375-051c-4576-81f0-22930f22fe1d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1678 microversion: 2.1 time: 0.164836 Aug 04 23:24:33.070480 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 510/1052] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:32 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:34.091302 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-dff55acc-076a-425d-9250-890b191dfd91 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:34.091863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-dff55acc-076a-425d-9250-890b191dfd91 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:34.098832 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dff55acc-076a-425d-9250-890b191dfd91 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:34.099311 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dff55acc-076a-425d-9250-890b191dfd91 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:34.099743 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dff55acc-076a-425d-9250-890b191dfd91 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:34.100446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dff55acc-076a-425d-9250-890b191dfd91 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:34.100948 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dff55acc-076a-425d-9250-890b191dfd91 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:34.101322 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dff55acc-076a-425d-9250-890b191dfd91 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:34.240651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-dff55acc-076a-425d-9250-890b191dfd91 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:34.248078 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-dff55acc-076a-425d-9250-890b191dfd91 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1678 microversion: 2.1 time: 0.160685 Aug 04 23:24:34.248642 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 543/1053] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:34 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:35.270109 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f0d92379-c913-4891-9ac1-269e6f9c8f4b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:35.270784 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f0d92379-c913-4891-9ac1-269e6f9c8f4b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:35.277333 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f0d92379-c913-4891-9ac1-269e6f9c8f4b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:35.277818 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f0d92379-c913-4891-9ac1-269e6f9c8f4b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:35.278249 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f0d92379-c913-4891-9ac1-269e6f9c8f4b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:35.278980 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f0d92379-c913-4891-9ac1-269e6f9c8f4b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:35.279435 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f0d92379-c913-4891-9ac1-269e6f9c8f4b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:35.279860 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f0d92379-c913-4891-9ac1-269e6f9c8f4b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:35.413807 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f0d92379-c913-4891-9ac1-269e6f9c8f4b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:35.421297 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f0d92379-c913-4891-9ac1-269e6f9c8f4b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1678 microversion: 2.1 time: 0.155639 Aug 04 23:24:35.421857 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 511/1054] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:35 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:36.443028 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f8a1d7af-0878-4d0b-afb2-6c95c41b2ee7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:36.443633 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f8a1d7af-0878-4d0b-afb2-6c95c41b2ee7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:36.450079 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f8a1d7af-0878-4d0b-afb2-6c95c41b2ee7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:36.450591 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f8a1d7af-0878-4d0b-afb2-6c95c41b2ee7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:36.451017 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f8a1d7af-0878-4d0b-afb2-6c95c41b2ee7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:36.452280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f8a1d7af-0878-4d0b-afb2-6c95c41b2ee7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:36.452280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f8a1d7af-0878-4d0b-afb2-6c95c41b2ee7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:36.452553 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f8a1d7af-0878-4d0b-afb2-6c95c41b2ee7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:36.592177 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f8a1d7af-0878-4d0b-afb2-6c95c41b2ee7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:36.600424 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f8a1d7af-0878-4d0b-afb2-6c95c41b2ee7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1678 microversion: 2.1 time: 0.161819 Aug 04 23:24:36.600980 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 544/1055] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:36 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:37.622106 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6f35255d-f626-4d3b-b5eb-c79179c8f197 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:37.622763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6f35255d-f626-4d3b-b5eb-c79179c8f197 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:37.630618 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6f35255d-f626-4d3b-b5eb-c79179c8f197 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:37.631098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6f35255d-f626-4d3b-b5eb-c79179c8f197 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:37.631532 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6f35255d-f626-4d3b-b5eb-c79179c8f197 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:37.632228 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6f35255d-f626-4d3b-b5eb-c79179c8f197 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:37.632675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6f35255d-f626-4d3b-b5eb-c79179c8f197 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:37.633096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6f35255d-f626-4d3b-b5eb-c79179c8f197 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:37.777088 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6f35255d-f626-4d3b-b5eb-c79179c8f197 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:37.787359 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6f35255d-f626-4d3b-b5eb-c79179c8f197 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1678 microversion: 2.1 time: 0.169216 Aug 04 23:24:37.788258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 512/1056] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:37 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:24:38.811602 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e1c0e8f8-2ef6-4da5-909d-0f4726cf25ab tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:38.812211 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e1c0e8f8-2ef6-4da5-909d-0f4726cf25ab tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:38.819670 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1c0e8f8-2ef6-4da5-909d-0f4726cf25ab tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:38.820155 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1c0e8f8-2ef6-4da5-909d-0f4726cf25ab tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:38.820586 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1c0e8f8-2ef6-4da5-909d-0f4726cf25ab tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:38.821288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1c0e8f8-2ef6-4da5-909d-0f4726cf25ab tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:38.821735 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1c0e8f8-2ef6-4da5-909d-0f4726cf25ab tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:38.822159 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1c0e8f8-2ef6-4da5-909d-0f4726cf25ab tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:38.954558 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e1c0e8f8-2ef6-4da5-909d-0f4726cf25ab tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:38.962344 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e1c0e8f8-2ef6-4da5-909d-0f4726cf25ab tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1678 microversion: 2.1 time: 0.154630 Aug 04 23:24:38.962930 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 545/1057] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:38 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:39.984604 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a403636e-bd24-4390-a7ea-7a3a1eb3042e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:39.985268 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a403636e-bd24-4390-a7ea-7a3a1eb3042e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:39.992680 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a403636e-bd24-4390-a7ea-7a3a1eb3042e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:39.993166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a403636e-bd24-4390-a7ea-7a3a1eb3042e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:39.993594 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a403636e-bd24-4390-a7ea-7a3a1eb3042e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:39.994295 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a403636e-bd24-4390-a7ea-7a3a1eb3042e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:39.994765 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a403636e-bd24-4390-a7ea-7a3a1eb3042e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:39.995181 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a403636e-bd24-4390-a7ea-7a3a1eb3042e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:40.131553 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a403636e-bd24-4390-a7ea-7a3a1eb3042e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:40.139327 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a403636e-bd24-4390-a7ea-7a3a1eb3042e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1655 microversion: 2.1 time: 0.159093 Aug 04 23:24:40.145684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 513/1058] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:39 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1655 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:24:40.159854 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-04b13a10-c7e0-4537-9838-6f1bbee9a8e1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:24:40.166633 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-04b13a10-c7e0-4537-9838-6f1bbee9a8e1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:40.167106 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-04b13a10-c7e0-4537-9838-6f1bbee9a8e1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:40.167532 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-04b13a10-c7e0-4537-9838-6f1bbee9a8e1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:40.237345 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-04b13a10-c7e0-4537-9838-6f1bbee9a8e1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Going to try to start instance {{(pid=129791) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 23:24:40.280031 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-04b13a10-c7e0-4537-9838-6f1bbee9a8e1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "POST /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2/action" status: 202 len: 0 microversion: 2.1 time: 0.123706 Aug 04 23:24:40.283721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 546/1059] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Aug 4 23:24:40 2022] POST /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:24:40.289727 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e8ee56d9-8adc-4887-8584-f6c939d13d48 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:40.290353 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e8ee56d9-8adc-4887-8584-f6c939d13d48 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:40.296829 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e8ee56d9-8adc-4887-8584-f6c939d13d48 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:40.297360 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e8ee56d9-8adc-4887-8584-f6c939d13d48 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:40.297801 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e8ee56d9-8adc-4887-8584-f6c939d13d48 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:40.298590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e8ee56d9-8adc-4887-8584-f6c939d13d48 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:40.299061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e8ee56d9-8adc-4887-8584-f6c939d13d48 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:40.299484 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e8ee56d9-8adc-4887-8584-f6c939d13d48 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:40.322983 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:24:40.446818 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e8ee56d9-8adc-4887-8584-f6c939d13d48 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:40.454340 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e8ee56d9-8adc-4887-8584-f6c939d13d48 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1664 microversion: 2.1 time: 0.169399 Aug 04 23:24:40.454923 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 514/1060] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:40 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1664 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:41.477783 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-dd09bbbe-ac95-4dc8-a056-8a28fb1722d1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:41.479511 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-dd09bbbe-ac95-4dc8-a056-8a28fb1722d1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:41.481705 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:24:41.487946 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd09bbbe-ac95-4dc8-a056-8a28fb1722d1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:41.488879 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd09bbbe-ac95-4dc8-a056-8a28fb1722d1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:41.489586 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd09bbbe-ac95-4dc8-a056-8a28fb1722d1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:41.490322 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd09bbbe-ac95-4dc8-a056-8a28fb1722d1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:41.490818 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd09bbbe-ac95-4dc8-a056-8a28fb1722d1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:41.491306 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd09bbbe-ac95-4dc8-a056-8a28fb1722d1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:41.496090 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:24:41.640747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-dd09bbbe-ac95-4dc8-a056-8a28fb1722d1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:41.649285 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-dd09bbbe-ac95-4dc8-a056-8a28fb1722d1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1664 microversion: 2.1 time: 0.177660 Aug 04 23:24:41.649858 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 547/1061] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:41 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1664 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:42.670320 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-30ad8178-831c-4318-871c-9e5d0941803a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:24:42.670959 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-30ad8178-831c-4318-871c-9e5d0941803a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:42.673319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=41 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:24:42.680471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-30ad8178-831c-4318-871c-9e5d0941803a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:42.680880 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-30ad8178-831c-4318-871c-9e5d0941803a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:42.681312 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-30ad8178-831c-4318-871c-9e5d0941803a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:42.682010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-30ad8178-831c-4318-871c-9e5d0941803a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:42.682484 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-30ad8178-831c-4318-871c-9e5d0941803a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:42.682901 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-30ad8178-831c-4318-871c-9e5d0941803a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:42.821212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-30ad8178-831c-4318-871c-9e5d0941803a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:24:42.828991 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-30ad8178-831c-4318-871c-9e5d0941803a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1668 microversion: 2.1 time: 0.162569 Aug 04 23:24:42.829555 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 515/1062] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:24:42 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:24:43.577931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:24:43.578111 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:24:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:24:59.343910 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9a84bb79-67e5-41ad-9a2a-29ab09a1e3cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91398eda-5b13-49b2-b1f2-b30f1afd1c5d", "device": "/dev/sdb"}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:24:59.346757 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9a84bb79-67e5-41ad-9a2a-29ab09a1e3cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:24:59.350735 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:24:59.351420 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=5 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:24:59.355952 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9a84bb79-67e5-41ad-9a2a-29ab09a1e3cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:59.356430 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9a84bb79-67e5-41ad-9a2a-29ab09a1e3cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:59.356884 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9a84bb79-67e5-41ad-9a2a-29ab09a1e3cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:59.357735 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9a84bb79-67e5-41ad-9a2a-29ab09a1e3cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:24:59.358007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9a84bb79-67e5-41ad-9a2a-29ab09a1e3cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:24:59.358446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9a84bb79-67e5-41ad-9a2a-29ab09a1e3cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:24:59.643221 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9a84bb79-67e5-41ad-9a2a-29ab09a1e3cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "POST /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303079 Aug 04 23:24:59.644211 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 548/1063] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Aug 4 23:24:59 2022] POST /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:25:31.727776 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d10e19d3-2f21-4157-a8b8-023db0c2f1e9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:25:31.728393 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d10e19d3-2f21-4157-a8b8-023db0c2f1e9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:25:31.730546 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:25:31.731378 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=8 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:25:31.737435 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d10e19d3-2f21-4157-a8b8-023db0c2f1e9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:31.737775 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d10e19d3-2f21-4157-a8b8-023db0c2f1e9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:31.738765 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d10e19d3-2f21-4157-a8b8-023db0c2f1e9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:31.739480 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d10e19d3-2f21-4157-a8b8-023db0c2f1e9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:31.739931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d10e19d3-2f21-4157-a8b8-023db0c2f1e9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:31.741697 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d10e19d3-2f21-4157-a8b8-023db0c2f1e9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:31.848357 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.objects.instance [None req-d10e19d3-2f21-4157-a8b8-023db0c2f1e9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lazy-loading 'services' on Instance uuid b19e8f44-b38f-4a4c-b4d0-5738a590f1ea {{(pid=129790) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:25:31.942941 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d10e19d3-2f21-4157-a8b8-023db0c2f1e9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea/os-volume_attachments/91398eda-5b13-49b2-b1f2-b30f1afd1c5d" status: 202 len: 0 microversion: 2.1 time: 0.218774 Aug 04 23:25:31.943436 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 516/1064] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Aug 4 23:25:31 2022] DELETE /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea/os-volume_attachments/91398eda-5b13-49b2-b1f2-b30f1afd1c5d => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:25:33.086819 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=2 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:25:33.087766 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:25:33.092238 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-36870c8e-558b-49e1-9cf9-5d8faf0b7359 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:25:33.093178 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-36870c8e-558b-49e1-9cf9-5d8faf0b7359 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:25:33.099958 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-36870c8e-558b-49e1-9cf9-5d8faf0b7359 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:33.100510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-36870c8e-558b-49e1-9cf9-5d8faf0b7359 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:33.101015 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-36870c8e-558b-49e1-9cf9-5d8faf0b7359 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:33.101786 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-36870c8e-558b-49e1-9cf9-5d8faf0b7359 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:33.102324 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-36870c8e-558b-49e1-9cf9-5d8faf0b7359 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:33.102863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-36870c8e-558b-49e1-9cf9-5d8faf0b7359 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:33.135476 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-36870c8e-558b-49e1-9cf9-5d8faf0b7359 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] Going to try to terminate instance {{(pid=129791) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 23:25:33.223237 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-36870c8e-558b-49e1-9cf9-5d8faf0b7359 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea" status: 204 len: 0 microversion: 2.1 time: 0.136847 Aug 04 23:25:33.224138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 549/1065] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:25:33 2022] DELETE /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 23:25:33.234503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-44399e38-00e0-401f-a2a6-914593dc8cfa tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:25:33.235828 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-44399e38-00e0-401f-a2a6-914593dc8cfa tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:25:33.242747 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44399e38-00e0-401f-a2a6-914593dc8cfa tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:33.243462 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44399e38-00e0-401f-a2a6-914593dc8cfa tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:33.243901 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44399e38-00e0-401f-a2a6-914593dc8cfa tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:33.244604 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44399e38-00e0-401f-a2a6-914593dc8cfa tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:33.245235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44399e38-00e0-401f-a2a6-914593dc8cfa tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:33.245666 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44399e38-00e0-401f-a2a6-914593dc8cfa tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:33.474247 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-44399e38-00e0-401f-a2a6-914593dc8cfa tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:25:33.487001 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-44399e38-00e0-401f-a2a6-914593dc8cfa tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea" status: 200 len: 1513 microversion: 2.1 time: 0.257479 Aug 04 23:25:33.487685 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 517/1066] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:25:33 2022] GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea => generated 1513 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:25:34.512422 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b5fff18e-332e-4a75-8372-b896aa40e139 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:25:34.513432 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b5fff18e-332e-4a75-8372-b896aa40e139 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:25:34.521718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b5fff18e-332e-4a75-8372-b896aa40e139 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:34.522290 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b5fff18e-332e-4a75-8372-b896aa40e139 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:34.534005 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b5fff18e-332e-4a75-8372-b896aa40e139 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:34.534982 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b5fff18e-332e-4a75-8372-b896aa40e139 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:34.536557 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b5fff18e-332e-4a75-8372-b896aa40e139 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:34.537212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b5fff18e-332e-4a75-8372-b896aa40e139 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:34.715395 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b5fff18e-332e-4a75-8372-b896aa40e139 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:25:34.726293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b5fff18e-332e-4a75-8372-b896aa40e139 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea" status: 200 len: 1513 microversion: 2.1 time: 0.220882 Aug 04 23:25:34.726935 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 550/1067] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:25:34 2022] GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea => generated 1513 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:25:35.752110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8ab2a30c-55d9-4cb3-b861-06edd0adb3b7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:25:35.752663 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8ab2a30c-55d9-4cb3-b861-06edd0adb3b7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:25:35.764109 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8ab2a30c-55d9-4cb3-b861-06edd0adb3b7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:35.764606 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8ab2a30c-55d9-4cb3-b861-06edd0adb3b7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:35.765017 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8ab2a30c-55d9-4cb3-b861-06edd0adb3b7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:35.765889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8ab2a30c-55d9-4cb3-b861-06edd0adb3b7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:35.766343 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8ab2a30c-55d9-4cb3-b861-06edd0adb3b7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:35.766789 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8ab2a30c-55d9-4cb3-b861-06edd0adb3b7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:35.952636 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8ab2a30c-55d9-4cb3-b861-06edd0adb3b7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:25:35.963675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8ab2a30c-55d9-4cb3-b861-06edd0adb3b7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea" status: 200 len: 1513 microversion: 2.1 time: 0.218213 Aug 04 23:25:35.964290 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 518/1068] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:25:35 2022] GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea => generated 1513 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:25:36.173175 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-2611d5b2-6872-480d-82be-f9ad2c4e6553 req-d211950f-c9d3-4ff6-8d92-5f3d781eb807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19e8f44-b38f-4a4c-b4d0-5738a590f1ea", "name": "network-vif-deleted", "tag": "a1b86cb4-5116-4a36-92ea-91ca9ab69737"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:25:36.188166 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-2611d5b2-6872-480d-82be-f9ad2c4e6553 req-d211950f-c9d3-4ff6-8d92-5f3d781eb807 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:36.188660 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-2611d5b2-6872-480d-82be-f9ad2c4e6553 req-d211950f-c9d3-4ff6-8d92-5f3d781eb807 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:36.196343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-2611d5b2-6872-480d-82be-f9ad2c4e6553 req-d211950f-c9d3-4ff6-8d92-5f3d781eb807 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:36.217453 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-2611d5b2-6872-480d-82be-f9ad2c4e6553 req-d211950f-c9d3-4ff6-8d92-5f3d781eb807 service nova] Creating event network-vif-deleted:a1b86cb4-5116-4a36-92ea-91ca9ab69737 for instance b19e8f44-b38f-4a4c-b4d0-5738a590f1ea on hv-cinder-85221 Aug 04 23:25:36.225302 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-2611d5b2-6872-480d-82be-f9ad2c4e6553 req-d211950f-c9d3-4ff6-8d92-5f3d781eb807 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055687 Aug 04 23:25:36.226320 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 551/1069] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:25:36.985037 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-db664c12-8dc1-4ae2-bf0b-e18daee46b29 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:25:36.986270 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-db664c12-8dc1-4ae2-bf0b-e18daee46b29 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: b19e8f44-b38f-4a4c-b4d0-5738a590f1ea] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:25:36.993139 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-db664c12-8dc1-4ae2-bf0b-e18daee46b29 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:36.993622 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-db664c12-8dc1-4ae2-bf0b-e18daee46b29 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:36.994056 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-db664c12-8dc1-4ae2-bf0b-e18daee46b29 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:36.994799 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-db664c12-8dc1-4ae2-bf0b-e18daee46b29 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:36.995250 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-db664c12-8dc1-4ae2-bf0b-e18daee46b29 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:36.995671 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-db664c12-8dc1-4ae2-bf0b-e18daee46b29 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:37.010185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-db664c12-8dc1-4ae2-bf0b-e18daee46b29 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] HTTP exception thrown: Instance b19e8f44-b38f-4a4c-b4d0-5738a590f1ea could not be found. Aug 04 23:25:37.011917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-db664c12-8dc1-4ae2-bf0b-e18daee46b29 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Request method failure captured: Aug 04 23:25:37.011917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea HTTP/1.1 Aug 04 23:25:37.011917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:25:37.011917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:25:37.011917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:25:37.011917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:25:37.011917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:25:37.011917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:25:37.011917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:25:37.011917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:25:37.011917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FUYhX2TojNXAcA603ptQ9cSfNJYH-1IUoAk5kZ1Xhubg5tN0qtpjimLeaP4DiWFcLxH2g5RKdF89ROPd4N0_vnzOqa3rgLnlkGR2sYAQx46hu4JhEOZYCJsuiCjpxL8apQRiWT6nAtjhYZ6EKOCs_uZdEradeyWqviJYCWy4ptjup4 Aug 04 23:25:37.011917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:25:37.011917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:25:37.011917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:25:37.011917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:25:37.011917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:25:37.011917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:25:37.011917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: 53d297a325844e15bfc7ac1b305789a2 Aug 04 23:25:37.011917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1426913507 Aug 04 23:25:37.011917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:25:37.011917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:25:37.013659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d297a325844e15bfc7ac1b305789a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53d297a325844e15bfc7ac1b305789a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d297a325844e15bfc7ac1b305789a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53d297a325844e15bfc7ac1b305789a2"}]}] Aug 04 23:25:37.013659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-VolumesSnapshotTestJSON-1426913507 Aug 04 23:25:37.013659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: 53d297a325844e15bfc7ac1b305789a2 Aug 04 23:25:37.013659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1426913507 Aug 04 23:25:37.013659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-VolumesSnapshotTestJSON-1426913507-project Aug 04 23:25:37.013659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:25:37.013659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:25:37.013659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: 146d37206ef046fe98141e20a6835701 Aug 04 23:25:37.013659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-VolumesSnapshotTestJSON-1426913507-project Aug 04 23:25:37.013659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:25:37.013659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Instance b19e8f44-b38f-4a4c-b4d0-5738a590f1ea could not be found. Aug 04 23:25:37.013659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': 'b19e8f44-b38f-4a4c-b4d0-5738a590f1ea'} Aug 04 23:25:37.014692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:25:37.014692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:25:37.014692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:25:37.014692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:25:37.014692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:25:37.014692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:25:37.014692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:25:37.014692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:25:37.014692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:25:37.014692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:25:37.014692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b19e8f44-b38f-4a4c-b4d0-5738a590f1ea could not be found. Aug 04 23:25:37.014692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:25:37.014692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:25:37.014692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:25:37.014692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:25:37.014692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:25:37.014692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:25:37.014692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:25:37.014692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:25:37.014692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:25:37.016174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:25:37.016174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:25:37.016174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:25:37.016174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:25:37.016174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:25:37.016174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:25:37.016174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:25:37.016174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b19e8f44-b38f-4a4c-b4d0-5738a590f1ea could not be found. Aug 04 23:25:37.016174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:25:37.016174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:25:37.016174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:25:37.016174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:25:37.016174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:25:37.016174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:25:37.016174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:25:37.016174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:25:37.016174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b19e8f44-b38f-4a4c-b4d0-5738a590f1ea could not be found. Aug 04 23:25:37.016174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:25:37.017365 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-db664c12-8dc1-4ae2-bf0b-e18daee46b29 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Returning 404 to user: Instance b19e8f44-b38f-4a4c-b4d0-5738a590f1ea could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:25:37.017365 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-db664c12-8dc1-4ae2-bf0b-e18daee46b29 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea" status: 404 len: 111 microversion: 2.1 time: 0.032166 Aug 04 23:25:37.017530 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 519/1070] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:25:36 2022] GET /compute/v2.1/servers/b19e8f44-b38f-4a4c-b4d0-5738a590f1ea => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:25:41.105248 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d70e6c57-6a38-4ad7-af3f-25c8de3a6ec0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Action: 'create', calling method: .version_select at 0x7f6d25d954c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1675453597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhWwlIm4fVQEQFlgzdB97zuptWE9pGK17djs+cVygIOf+71vSrx2PB347W4zRsEdovHuq5h1T8nv3bkFt692KdfKdRYUMQOnTiEY0e4MTFZahioIhuJd2z5EGTvPKPSEg=="}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:25:41.123364 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-d70e6c57-6a38-4ad7-af3f-25c8de3a6ec0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Getting quotas for project ce6ec5e686904fe69e4891c68fcd8cb6. Resources: {'key_pairs'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:25:41.127835 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-d70e6c57-6a38-4ad7-af3f-25c8de3a6ec0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Getting quotas for user 83876d8ed0af480d9b531193eeced051 and project ce6ec5e686904fe69e4891c68fcd8cb6. Resources: {'key_pairs'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:25:41.174873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d70e6c57-6a38-4ad7-af3f-25c8de3a6ec0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.255408 Aug 04 23:25:41.175854 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 552/1071] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Aug 4 23:25:40 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:25:51.288100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f19de347-0f86-43c3-9269-2b259d4189cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-581641451", "imageRef": "e1e9d70e-b252-44e5-9ecd-bf73cbf00160", "flavorRef": "452", "networks": [{"uuid": "120214f1-3de2-4ddb-917a-25d2c69add2d"}]}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:25:51.297035 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=8 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:25:51.297690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:25:51.345093 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.network.neutron [None req-f19de347-0f86-43c3-9269-2b259d4189cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] validate_networks() for [('120214f1-3de2-4ddb-917a-25d2c69add2d', None, None, None, None, None)] {{(pid=129790) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 23:25:51.819439 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-f19de347-0f86-43c3-9269-2b259d4189cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Flavor limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 23:25:51.819864 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-f19de347-0f86-43c3-9269-2b259d4189cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Image limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 23:25:51.820341 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-f19de347-0f86-43c3-9269-2b259d4189cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Flavor pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 23:25:51.820752 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-f19de347-0f86-43c3-9269-2b259d4189cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Image pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 23:25:51.821162 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-f19de347-0f86-43c3-9269-2b259d4189cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 23:25:51.836988 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f19de347-0f86-43c3-9269-2b259d4189cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:51.837739 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f19de347-0f86-43c3-9269-2b259d4189cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:51.838873 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f19de347-0f86-43c3-9269-2b259d4189cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:51.840178 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f19de347-0f86-43c3-9269-2b259d4189cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:51.841004 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f19de347-0f86-43c3-9269-2b259d4189cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:51.841474 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f19de347-0f86-43c3-9269-2b259d4189cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:51.858812 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-f19de347-0f86-43c3-9269-2b259d4189cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Getting quotas for project 53d297a325844e15bfc7ac1b305789a2. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:25:51.863239 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-f19de347-0f86-43c3-9269-2b259d4189cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Getting quotas for user 146d37206ef046fe98141e20a6835701 and project 53d297a325844e15bfc7ac1b305789a2. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:25:51.874141 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f19de347-0f86-43c3-9269-2b259d4189cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Going to run 1 instances... {{(pid=129790) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 23:25:51.876435 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f19de347-0f86-43c3-9269-2b259d4189cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1e9d70e-b252-44e5-9ecd-bf73cbf00160',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129790) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 23:25:51.931213 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f19de347-0f86-43c3-9269-2b259d4189cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647514 Aug 04 23:25:51.931888 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 520/1072] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Aug 4 23:25:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 23:25:51.940112 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:25:51.941832 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=4 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:25:51.942066 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:25:51.946061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-76c59c58-55f7-4b42-a677-fd74b2db1897 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:25:51.946809 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-76c59c58-55f7-4b42-a677-fd74b2db1897 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:25:52.009697 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-76c59c58-55f7-4b42-a677-fd74b2db1897 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:25:52.016460 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-76c59c58-55f7-4b42-a677-fd74b2db1897 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1218 microversion: 2.1 time: 0.077780 Aug 04 23:25:52.017022 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 553/1073] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:25:51 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:25:53.038489 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f7cdfa96-fc4e-4120-8555-af1696bdac05 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:25:53.039478 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f7cdfa96-fc4e-4120-8555-af1696bdac05 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:25:53.050596 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f7cdfa96-fc4e-4120-8555-af1696bdac05 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:53.051707 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f7cdfa96-fc4e-4120-8555-af1696bdac05 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:53.052222 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f7cdfa96-fc4e-4120-8555-af1696bdac05 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:53.053227 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f7cdfa96-fc4e-4120-8555-af1696bdac05 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:53.053762 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f7cdfa96-fc4e-4120-8555-af1696bdac05 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:53.054256 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f7cdfa96-fc4e-4120-8555-af1696bdac05 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:53.133272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f7cdfa96-fc4e-4120-8555-af1696bdac05 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:25:53.141010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f7cdfa96-fc4e-4120-8555-af1696bdac05 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1276 microversion: 2.1 time: 0.108034 Aug 04 23:25:53.141660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 521/1074] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:25:53 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1276 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:25:54.163391 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a255a0a4-fdff-4671-9dcf-d248c218eb9f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:25:54.163988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a255a0a4-fdff-4671-9dcf-d248c218eb9f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:25:54.170419 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a255a0a4-fdff-4671-9dcf-d248c218eb9f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:54.170895 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a255a0a4-fdff-4671-9dcf-d248c218eb9f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:54.171320 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a255a0a4-fdff-4671-9dcf-d248c218eb9f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:54.172008 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a255a0a4-fdff-4671-9dcf-d248c218eb9f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:54.172455 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a255a0a4-fdff-4671-9dcf-d248c218eb9f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:54.172870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a255a0a4-fdff-4671-9dcf-d248c218eb9f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:54.227204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-c87a8d7d-6467-4bfd-9484-8abecf880321 req-52c1d61e-26af-4289-a4bb-346862fb9d91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c786164b-4aee-4a6a-9208-29f6ae31f247", "tag": "ca8dff39-0739-4a70-8fc8-bb6e5c88a496"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:25:54.243655 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-c87a8d7d-6467-4bfd-9484-8abecf880321 req-52c1d61e-26af-4289-a4bb-346862fb9d91 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:54.244181 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-c87a8d7d-6467-4bfd-9484-8abecf880321 req-52c1d61e-26af-4289-a4bb-346862fb9d91 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:54.244610 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-c87a8d7d-6467-4bfd-9484-8abecf880321 req-52c1d61e-26af-4289-a4bb-346862fb9d91 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:54.257209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-c87a8d7d-6467-4bfd-9484-8abecf880321 req-52c1d61e-26af-4289-a4bb-346862fb9d91 service nova] Creating event network-changed:ca8dff39-0739-4a70-8fc8-bb6e5c88a496 for instance c786164b-4aee-4a6a-9208-29f6ae31f247 on hv-cinder-85221 Aug 04 23:25:54.262961 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-c87a8d7d-6467-4bfd-9484-8abecf880321 req-52c1d61e-26af-4289-a4bb-346862fb9d91 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043789 Aug 04 23:25:54.264051 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 522/1075] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:25:54.335397 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a255a0a4-fdff-4671-9dcf-d248c218eb9f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:25:54.343578 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a255a0a4-fdff-4671-9dcf-d248c218eb9f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1318 microversion: 2.1 time: 0.184604 Aug 04 23:25:54.344160 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 554/1076] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:25:54 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:25:55.366986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9fbbeb1f-6f41-453e-b494-dc75a30df796 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:25:55.367690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9fbbeb1f-6f41-453e-b494-dc75a30df796 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:25:55.373837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9fbbeb1f-6f41-453e-b494-dc75a30df796 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:55.374421 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9fbbeb1f-6f41-453e-b494-dc75a30df796 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:55.374857 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9fbbeb1f-6f41-453e-b494-dc75a30df796 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:55.375547 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9fbbeb1f-6f41-453e-b494-dc75a30df796 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:55.375997 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9fbbeb1f-6f41-453e-b494-dc75a30df796 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:55.376418 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9fbbeb1f-6f41-453e-b494-dc75a30df796 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:55.512497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9fbbeb1f-6f41-453e-b494-dc75a30df796 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:25:55.521316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9fbbeb1f-6f41-453e-b494-dc75a30df796 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1318 microversion: 2.1 time: 0.159760 Aug 04 23:25:55.521893 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 523/1077] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:25:55 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:25:56.541754 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a21990ce-117f-4470-b275-cdbc77161e1e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:25:56.542411 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a21990ce-117f-4470-b275-cdbc77161e1e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:25:56.548855 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a21990ce-117f-4470-b275-cdbc77161e1e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:56.549906 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a21990ce-117f-4470-b275-cdbc77161e1e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:56.550528 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a21990ce-117f-4470-b275-cdbc77161e1e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:56.551286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a21990ce-117f-4470-b275-cdbc77161e1e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:56.551736 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a21990ce-117f-4470-b275-cdbc77161e1e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:56.552156 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a21990ce-117f-4470-b275-cdbc77161e1e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:56.687712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a21990ce-117f-4470-b275-cdbc77161e1e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:25:56.696137 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a21990ce-117f-4470-b275-cdbc77161e1e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1318 microversion: 2.1 time: 0.158126 Aug 04 23:25:56.696703 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 555/1078] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:25:56 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:25:57.717182 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-26662f00-9913-4f7b-b666-c5679c3dadc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:25:57.717797 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-26662f00-9913-4f7b-b666-c5679c3dadc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:25:57.725033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-26662f00-9913-4f7b-b666-c5679c3dadc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:57.725528 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-26662f00-9913-4f7b-b666-c5679c3dadc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:57.725963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-26662f00-9913-4f7b-b666-c5679c3dadc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:57.726710 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-26662f00-9913-4f7b-b666-c5679c3dadc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:57.727166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-26662f00-9913-4f7b-b666-c5679c3dadc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:57.727591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-26662f00-9913-4f7b-b666-c5679c3dadc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:57.866751 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-26662f00-9913-4f7b-b666-c5679c3dadc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:25:57.874245 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-26662f00-9913-4f7b-b666-c5679c3dadc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1318 microversion: 2.1 time: 0.160840 Aug 04 23:25:57.875276 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 524/1079] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:25:57 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:25:58.896790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c841b83f-1043-454f-8415-0d6da7c81240 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:25:58.897335 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c841b83f-1043-454f-8415-0d6da7c81240 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:25:58.903745 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c841b83f-1043-454f-8415-0d6da7c81240 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:58.904223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c841b83f-1043-454f-8415-0d6da7c81240 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:58.904653 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c841b83f-1043-454f-8415-0d6da7c81240 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:58.905370 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c841b83f-1043-454f-8415-0d6da7c81240 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:25:58.905820 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c841b83f-1043-454f-8415-0d6da7c81240 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:25:58.906238 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c841b83f-1043-454f-8415-0d6da7c81240 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:25:59.040849 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c841b83f-1043-454f-8415-0d6da7c81240 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:25:59.048274 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c841b83f-1043-454f-8415-0d6da7c81240 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1318 microversion: 2.1 time: 0.155518 Aug 04 23:25:59.048830 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 556/1080] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:25:58 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:00.069786 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5f3dfe58-6329-43ce-b8d9-21140c6bf0da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:00.070550 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5f3dfe58-6329-43ce-b8d9-21140c6bf0da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:00.076987 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5f3dfe58-6329-43ce-b8d9-21140c6bf0da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:00.077454 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5f3dfe58-6329-43ce-b8d9-21140c6bf0da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:00.077881 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5f3dfe58-6329-43ce-b8d9-21140c6bf0da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:00.078616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5f3dfe58-6329-43ce-b8d9-21140c6bf0da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:00.079061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5f3dfe58-6329-43ce-b8d9-21140c6bf0da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:00.079477 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5f3dfe58-6329-43ce-b8d9-21140c6bf0da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:00.214212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5f3dfe58-6329-43ce-b8d9-21140c6bf0da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:00.221971 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5f3dfe58-6329-43ce-b8d9-21140c6bf0da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1318 microversion: 2.1 time: 0.156755 Aug 04 23:26:00.222497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 525/1081] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:00 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:01.243340 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-cc3f7b41-baf2-407a-be38-55032c9e3afa tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:01.243955 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-cc3f7b41-baf2-407a-be38-55032c9e3afa tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:01.251054 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc3f7b41-baf2-407a-be38-55032c9e3afa tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:01.251538 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc3f7b41-baf2-407a-be38-55032c9e3afa tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:01.251969 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc3f7b41-baf2-407a-be38-55032c9e3afa tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:01.252874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc3f7b41-baf2-407a-be38-55032c9e3afa tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:01.253321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc3f7b41-baf2-407a-be38-55032c9e3afa tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:01.253773 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc3f7b41-baf2-407a-be38-55032c9e3afa tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:01.387881 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cc3f7b41-baf2-407a-be38-55032c9e3afa tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:01.397396 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-cc3f7b41-baf2-407a-be38-55032c9e3afa tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1318 microversion: 2.1 time: 0.157963 Aug 04 23:26:01.397969 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 557/1082] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:01 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:01.911784 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=2 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:26:01.912770 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=6 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:26:01.980775 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-82e6d3d2-5f4a-4897-8106-4246861c9ab7 req-4329bcb4-d403-4e22-a0f5-9e3c688df76f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c786164b-4aee-4a6a-9208-29f6ae31f247", "name": "network-vif-plugged", "status": "completed", "tag": "ca8dff39-0739-4a70-8fc8-bb6e5c88a496"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:26:01.995343 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-82e6d3d2-5f4a-4897-8106-4246861c9ab7 req-4329bcb4-d403-4e22-a0f5-9e3c688df76f service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:01.995848 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-82e6d3d2-5f4a-4897-8106-4246861c9ab7 req-4329bcb4-d403-4e22-a0f5-9e3c688df76f service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:01.996280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-82e6d3d2-5f4a-4897-8106-4246861c9ab7 req-4329bcb4-d403-4e22-a0f5-9e3c688df76f service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:02.010234 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-82e6d3d2-5f4a-4897-8106-4246861c9ab7 req-4329bcb4-d403-4e22-a0f5-9e3c688df76f service nova] Creating event network-vif-plugged:ca8dff39-0739-4a70-8fc8-bb6e5c88a496 for instance c786164b-4aee-4a6a-9208-29f6ae31f247 on hv-cinder-85221 Aug 04 23:26:02.015725 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-82e6d3d2-5f4a-4897-8106-4246861c9ab7 req-4329bcb4-d403-4e22-a0f5-9e3c688df76f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117110 Aug 04 23:26:02.016358 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 526/1083] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:26:02.419788 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6dbc817b-fbad-4a1d-a5ba-bc8a91a7895b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:02.420401 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6dbc817b-fbad-4a1d-a5ba-bc8a91a7895b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:02.422283 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=2 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:26:02.428641 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6dbc817b-fbad-4a1d-a5ba-bc8a91a7895b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:02.429124 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6dbc817b-fbad-4a1d-a5ba-bc8a91a7895b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:02.429563 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6dbc817b-fbad-4a1d-a5ba-bc8a91a7895b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:02.430260 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6dbc817b-fbad-4a1d-a5ba-bc8a91a7895b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:02.430736 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6dbc817b-fbad-4a1d-a5ba-bc8a91a7895b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:02.431161 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6dbc817b-fbad-4a1d-a5ba-bc8a91a7895b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:02.566037 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6dbc817b-fbad-4a1d-a5ba-bc8a91a7895b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:02.573516 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6dbc817b-fbad-4a1d-a5ba-bc8a91a7895b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1318 microversion: 2.1 time: 0.157549 Aug 04 23:26:02.574069 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 558/1084] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:02 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:03.595690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-65de4146-e1b6-40b2-a69d-5ecbb0e5f170 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:03.596684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-65de4146-e1b6-40b2-a69d-5ecbb0e5f170 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:03.602834 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-65de4146-e1b6-40b2-a69d-5ecbb0e5f170 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:03.603302 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-65de4146-e1b6-40b2-a69d-5ecbb0e5f170 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:03.603732 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-65de4146-e1b6-40b2-a69d-5ecbb0e5f170 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:03.604412 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-65de4146-e1b6-40b2-a69d-5ecbb0e5f170 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:03.604855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-65de4146-e1b6-40b2-a69d-5ecbb0e5f170 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:03.605269 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-65de4146-e1b6-40b2-a69d-5ecbb0e5f170 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:03.735534 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-65de4146-e1b6-40b2-a69d-5ecbb0e5f170 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:03.743924 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-65de4146-e1b6-40b2-a69d-5ecbb0e5f170 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1318 microversion: 2.1 time: 0.152980 Aug 04 23:26:03.744474 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 527/1085] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:03 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:04.765413 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6c24e890-1ce8-4575-8588-59f0d1dc8926 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:04.766012 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6c24e890-1ce8-4575-8588-59f0d1dc8926 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:04.773464 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6c24e890-1ce8-4575-8588-59f0d1dc8926 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:04.773940 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6c24e890-1ce8-4575-8588-59f0d1dc8926 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:04.774386 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6c24e890-1ce8-4575-8588-59f0d1dc8926 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:04.775069 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6c24e890-1ce8-4575-8588-59f0d1dc8926 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:04.775572 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6c24e890-1ce8-4575-8588-59f0d1dc8926 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:04.775930 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6c24e890-1ce8-4575-8588-59f0d1dc8926 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:04.911141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6c24e890-1ce8-4575-8588-59f0d1dc8926 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:04.919307 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6c24e890-1ce8-4575-8588-59f0d1dc8926 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1507 microversion: 2.1 time: 0.157752 Aug 04 23:26:04.919889 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 559/1086] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:04 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:04.940629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f4e79d06-b4ad-449f-b095-21c501259934 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f345256-fed5-4b16-a195-56888e81102b", "device": "/dev/sdb"}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:26:04.943642 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f4e79d06-b4ad-449f-b095-21c501259934 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:04.950090 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4e79d06-b4ad-449f-b095-21c501259934 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:04.950598 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4e79d06-b4ad-449f-b095-21c501259934 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:04.951027 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4e79d06-b4ad-449f-b095-21c501259934 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:04.951720 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4e79d06-b4ad-449f-b095-21c501259934 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:04.952166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4e79d06-b4ad-449f-b095-21c501259934 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:04.952585 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4e79d06-b4ad-449f-b095-21c501259934 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:05.304560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f4e79d06-b4ad-449f-b095-21c501259934 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "POST /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.368361 Aug 04 23:26:05.305333 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 528/1087] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Aug 4 23:26:04 2022] POST /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:26:06.052209 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-68172366-e384-4f8d-9ad6-bd8197493440 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-303972199", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1675453597", "security_groups": [{"name": "tempest-secgroup-smoke-573924840"}], "networks": [{"uuid": "f0eeaaae-0af0-494f-a8ab-b32f59f90730"}], "block_device_mapping_v2": [{"uuid": "5bc92bde-9034-46a3-a82f-8071612b0e0c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:26:06.166882 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.network.neutron [None req-68172366-e384-4f8d-9ad6-bd8197493440 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] validate_networks() for [('f0eeaaae-0af0-494f-a8ab-b32f59f90730', None, None, None, None, None)] {{(pid=129791) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 23:26:06.544164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-68172366-e384-4f8d-9ad6-bd8197493440 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Flavor limits 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 23:26:06.544585 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-68172366-e384-4f8d-9ad6-bd8197493440 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Image limits 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 23:26:06.545058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-68172366-e384-4f8d-9ad6-bd8197493440 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Flavor pref 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 23:26:06.545495 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-68172366-e384-4f8d-9ad6-bd8197493440 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Image pref 0:0:0 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 23:26:06.545902 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.virt.hardware [None req-68172366-e384-4f8d-9ad6-bd8197493440 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 23:26:06.555671 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68172366-e384-4f8d-9ad6-bd8197493440 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:06.556151 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68172366-e384-4f8d-9ad6-bd8197493440 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:06.556585 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68172366-e384-4f8d-9ad6-bd8197493440 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:06.557314 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68172366-e384-4f8d-9ad6-bd8197493440 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:06.557762 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68172366-e384-4f8d-9ad6-bd8197493440 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:06.558184 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68172366-e384-4f8d-9ad6-bd8197493440 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:06.574347 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-68172366-e384-4f8d-9ad6-bd8197493440 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Getting quotas for project ce6ec5e686904fe69e4891c68fcd8cb6. Resources: {'ram', 'instances', 'cores'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:26:06.578319 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.quota [None req-68172366-e384-4f8d-9ad6-bd8197493440 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Getting quotas for user 83876d8ed0af480d9b531193eeced051 and project ce6ec5e686904fe69e4891c68fcd8cb6. Resources: {'ram', 'instances', 'cores'} {{(pid=129791) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:26:06.638481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-68172366-e384-4f8d-9ad6-bd8197493440 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Going to run 1 instances... {{(pid=129791) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 23:26:06.640601 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-68172366-e384-4f8d-9ad6-bd8197493440 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5bc92bde-9034-46a3-a82f-8071612b0e0c',volume_size=None,volume_type=None)] {{(pid=129791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 23:26:06.775092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-68172366-e384-4f8d-9ad6-bd8197493440 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.727515 Aug 04 23:26:06.775730 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 560/1088] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Aug 4 23:26:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 23:26:06.788512 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e4b901e0-3bef-4f18-9eb4-5ba8cfbfc9b0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:06.789206 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e4b901e0-3bef-4f18-9eb4-5ba8cfbfc9b0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:06.843807 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e4b901e0-3bef-4f18-9eb4-5ba8cfbfc9b0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:06.851969 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e4b901e0-3bef-4f18-9eb4-5ba8cfbfc9b0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1088 microversion: 2.1 time: 0.068987 Aug 04 23:26:06.866401 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 529/1089] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:06 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:07.874031 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-85683b23-12a9-4fed-adf8-32a34827fc93 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:07.874794 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-85683b23-12a9-4fed-adf8-32a34827fc93 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:07.881492 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-85683b23-12a9-4fed-adf8-32a34827fc93 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:07.882238 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-85683b23-12a9-4fed-adf8-32a34827fc93 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:07.883005 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-85683b23-12a9-4fed-adf8-32a34827fc93 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:07.883712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-85683b23-12a9-4fed-adf8-32a34827fc93 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:07.884163 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-85683b23-12a9-4fed-adf8-32a34827fc93 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:07.884586 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-85683b23-12a9-4fed-adf8-32a34827fc93 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:07.950220 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-85683b23-12a9-4fed-adf8-32a34827fc93 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:07.958526 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-85683b23-12a9-4fed-adf8-32a34827fc93 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1194 microversion: 2.1 time: 0.089113 Aug 04 23:26:07.959101 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 561/1090] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:07 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:08.980398 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6471c608-28a3-4776-8db2-4d237bf0c10d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:08.981717 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6471c608-28a3-4776-8db2-4d237bf0c10d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:08.989657 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6471c608-28a3-4776-8db2-4d237bf0c10d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:08.990142 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6471c608-28a3-4776-8db2-4d237bf0c10d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:08.990608 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6471c608-28a3-4776-8db2-4d237bf0c10d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:08.991304 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6471c608-28a3-4776-8db2-4d237bf0c10d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:08.991758 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6471c608-28a3-4776-8db2-4d237bf0c10d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:08.992180 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6471c608-28a3-4776-8db2-4d237bf0c10d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:09.133646 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6471c608-28a3-4776-8db2-4d237bf0c10d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:09.141193 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6471c608-28a3-4776-8db2-4d237bf0c10d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1271 microversion: 2.1 time: 0.164656 Aug 04 23:26:09.141753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 530/1091] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:08 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1271 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:09.431675 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-e25d3f10-db02-48f4-a64f-fa4acc98a29c req-bff572c4-23d9-402a-b6e4-56b2e9e227ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a0c9ea5-2710-4533-b166-010d46ab0027", "tag": "288e902d-3b66-41d9-a3c5-5e1bbfb5e18b"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:26:09.444818 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-e25d3f10-db02-48f4-a64f-fa4acc98a29c req-bff572c4-23d9-402a-b6e4-56b2e9e227ac service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:09.445311 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-e25d3f10-db02-48f4-a64f-fa4acc98a29c req-bff572c4-23d9-402a-b6e4-56b2e9e227ac service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:09.445940 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-e25d3f10-db02-48f4-a64f-fa4acc98a29c req-bff572c4-23d9-402a-b6e4-56b2e9e227ac service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:09.458742 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-e25d3f10-db02-48f4-a64f-fa4acc98a29c req-bff572c4-23d9-402a-b6e4-56b2e9e227ac service nova] Creating event network-changed:288e902d-3b66-41d9-a3c5-5e1bbfb5e18b for instance 7a0c9ea5-2710-4533-b166-010d46ab0027 on hv-cinder-85221 Aug 04 23:26:09.464124 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-e25d3f10-db02-48f4-a64f-fa4acc98a29c req-bff572c4-23d9-402a-b6e4-56b2e9e227ac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036232 Aug 04 23:26:09.465059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 562/1092] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:26:10.163320 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-48b0f263-cd93-4a26-b62b-fe7c6a052002 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:10.163950 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-48b0f263-cd93-4a26-b62b-fe7c6a052002 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:10.170334 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48b0f263-cd93-4a26-b62b-fe7c6a052002 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:10.170845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48b0f263-cd93-4a26-b62b-fe7c6a052002 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:10.171278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48b0f263-cd93-4a26-b62b-fe7c6a052002 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:10.172000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48b0f263-cd93-4a26-b62b-fe7c6a052002 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:10.172425 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48b0f263-cd93-4a26-b62b-fe7c6a052002 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:10.172846 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48b0f263-cd93-4a26-b62b-fe7c6a052002 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:10.317698 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-48b0f263-cd93-4a26-b62b-fe7c6a052002 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:10.325263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-48b0f263-cd93-4a26-b62b-fe7c6a052002 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1271 microversion: 2.1 time: 0.166660 Aug 04 23:26:10.325834 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 531/1093] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:10 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:11.348203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3aa39afc-f19c-48c8-927c-f4573851ff04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:11.348891 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3aa39afc-f19c-48c8-927c-f4573851ff04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:11.355490 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3aa39afc-f19c-48c8-927c-f4573851ff04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:11.355968 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3aa39afc-f19c-48c8-927c-f4573851ff04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:11.356402 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3aa39afc-f19c-48c8-927c-f4573851ff04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:11.357089 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3aa39afc-f19c-48c8-927c-f4573851ff04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:11.357543 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3aa39afc-f19c-48c8-927c-f4573851ff04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:11.357959 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3aa39afc-f19c-48c8-927c-f4573851ff04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:11.492997 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3aa39afc-f19c-48c8-927c-f4573851ff04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:11.500382 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3aa39afc-f19c-48c8-927c-f4573851ff04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1271 microversion: 2.1 time: 0.157301 Aug 04 23:26:11.500936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 563/1094] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:11 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:12.520917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-09f06d4d-87ed-4eb2-9cee-b4a8840c62a1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:12.521529 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-09f06d4d-87ed-4eb2-9cee-b4a8840c62a1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:12.528009 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09f06d4d-87ed-4eb2-9cee-b4a8840c62a1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:12.528523 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09f06d4d-87ed-4eb2-9cee-b4a8840c62a1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:12.528953 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09f06d4d-87ed-4eb2-9cee-b4a8840c62a1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:12.529665 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09f06d4d-87ed-4eb2-9cee-b4a8840c62a1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:12.530116 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09f06d4d-87ed-4eb2-9cee-b4a8840c62a1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:12.530577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09f06d4d-87ed-4eb2-9cee-b4a8840c62a1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:12.674196 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-09f06d4d-87ed-4eb2-9cee-b4a8840c62a1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:12.682463 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-09f06d4d-87ed-4eb2-9cee-b4a8840c62a1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1271 microversion: 2.1 time: 0.165429 Aug 04 23:26:12.683034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 532/1095] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:12 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:13.703501 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-bdaf56a6-762e-4d20-9fbf-718329538566 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:13.704112 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-bdaf56a6-762e-4d20-9fbf-718329538566 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:13.710872 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdaf56a6-762e-4d20-9fbf-718329538566 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:13.711353 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdaf56a6-762e-4d20-9fbf-718329538566 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:13.711785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdaf56a6-762e-4d20-9fbf-718329538566 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:13.712509 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdaf56a6-762e-4d20-9fbf-718329538566 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:13.712959 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdaf56a6-762e-4d20-9fbf-718329538566 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:13.713381 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdaf56a6-762e-4d20-9fbf-718329538566 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:13.851294 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-bdaf56a6-762e-4d20-9fbf-718329538566 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:13.858734 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-bdaf56a6-762e-4d20-9fbf-718329538566 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.159090 Aug 04 23:26:13.859289 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 564/1096] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:13 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:14.880132 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2184498a-2d42-4ed6-845d-e3be5b20fa41 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:14.880747 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2184498a-2d42-4ed6-845d-e3be5b20fa41 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:14.887278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2184498a-2d42-4ed6-845d-e3be5b20fa41 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:14.887758 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2184498a-2d42-4ed6-845d-e3be5b20fa41 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:14.888194 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2184498a-2d42-4ed6-845d-e3be5b20fa41 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:14.888886 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2184498a-2d42-4ed6-845d-e3be5b20fa41 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:14.889348 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2184498a-2d42-4ed6-845d-e3be5b20fa41 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:14.889770 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2184498a-2d42-4ed6-845d-e3be5b20fa41 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:15.027483 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2184498a-2d42-4ed6-845d-e3be5b20fa41 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:15.035330 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2184498a-2d42-4ed6-845d-e3be5b20fa41 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.159622 Aug 04 23:26:15.035893 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 533/1097] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:14 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:16.056786 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a473786a-a526-4ebd-baed-bec3d407e9d8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:16.057390 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a473786a-a526-4ebd-baed-bec3d407e9d8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:16.063790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a473786a-a526-4ebd-baed-bec3d407e9d8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:16.064265 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a473786a-a526-4ebd-baed-bec3d407e9d8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:16.064704 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a473786a-a526-4ebd-baed-bec3d407e9d8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:16.065992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a473786a-a526-4ebd-baed-bec3d407e9d8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:16.066469 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a473786a-a526-4ebd-baed-bec3d407e9d8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:16.066877 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a473786a-a526-4ebd-baed-bec3d407e9d8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:16.202443 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a473786a-a526-4ebd-baed-bec3d407e9d8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:16.211171 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a473786a-a526-4ebd-baed-bec3d407e9d8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.158225 Aug 04 23:26:16.211741 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 565/1098] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:16 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:17.231645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-fce4c690-6db8-44c0-88e7-eacb154a6cfc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:17.232263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-fce4c690-6db8-44c0-88e7-eacb154a6cfc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:17.234695 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=2 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:26:17.240803 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fce4c690-6db8-44c0-88e7-eacb154a6cfc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:17.241287 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fce4c690-6db8-44c0-88e7-eacb154a6cfc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:17.241726 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fce4c690-6db8-44c0-88e7-eacb154a6cfc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:17.242460 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fce4c690-6db8-44c0-88e7-eacb154a6cfc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:17.242924 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fce4c690-6db8-44c0-88e7-eacb154a6cfc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:17.243347 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fce4c690-6db8-44c0-88e7-eacb154a6cfc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:17.381480 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-fce4c690-6db8-44c0-88e7-eacb154a6cfc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:17.388979 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-fce4c690-6db8-44c0-88e7-eacb154a6cfc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.161182 Aug 04 23:26:17.389543 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 534/1099] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:17 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:18.410237 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-103f226e-389d-4aac-a7f8-efd16f93b537 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:18.410792 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-103f226e-389d-4aac-a7f8-efd16f93b537 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:18.413102 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=2 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:26:18.413911 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=6 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:26:18.420235 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-103f226e-389d-4aac-a7f8-efd16f93b537 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:18.420719 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-103f226e-389d-4aac-a7f8-efd16f93b537 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:18.421152 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-103f226e-389d-4aac-a7f8-efd16f93b537 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:18.421850 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-103f226e-389d-4aac-a7f8-efd16f93b537 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:18.422299 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-103f226e-389d-4aac-a7f8-efd16f93b537 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:18.422757 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-103f226e-389d-4aac-a7f8-efd16f93b537 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:18.554352 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-103f226e-389d-4aac-a7f8-efd16f93b537 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:18.561801 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-103f226e-389d-4aac-a7f8-efd16f93b537 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.155453 Aug 04 23:26:18.562380 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 566/1100] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:18 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:19.583712 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b1ac8787-2148-4c9a-a974-139603f780ad tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:19.584320 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b1ac8787-2148-4c9a-a974-139603f780ad tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:19.590796 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b1ac8787-2148-4c9a-a974-139603f780ad tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:19.591274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b1ac8787-2148-4c9a-a974-139603f780ad tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:19.591701 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b1ac8787-2148-4c9a-a974-139603f780ad tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:19.592385 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b1ac8787-2148-4c9a-a974-139603f780ad tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:19.592834 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b1ac8787-2148-4c9a-a974-139603f780ad tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:19.593252 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b1ac8787-2148-4c9a-a974-139603f780ad tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:19.730817 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b1ac8787-2148-4c9a-a974-139603f780ad tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:19.738996 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b1ac8787-2148-4c9a-a974-139603f780ad tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.159742 Aug 04 23:26:19.739560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 535/1101] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:19 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:20.759712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c11cb613-09e4-48e1-9699-af3c56852ed4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:20.760301 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c11cb613-09e4-48e1-9699-af3c56852ed4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:20.766753 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c11cb613-09e4-48e1-9699-af3c56852ed4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:20.767234 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c11cb613-09e4-48e1-9699-af3c56852ed4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:20.767671 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c11cb613-09e4-48e1-9699-af3c56852ed4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:20.769005 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c11cb613-09e4-48e1-9699-af3c56852ed4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:20.769488 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c11cb613-09e4-48e1-9699-af3c56852ed4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:20.769964 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c11cb613-09e4-48e1-9699-af3c56852ed4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:20.901360 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c11cb613-09e4-48e1-9699-af3c56852ed4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:20.909312 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c11cb613-09e4-48e1-9699-af3c56852ed4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.153084 Aug 04 23:26:20.909876 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 567/1102] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:20 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:21.930064 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4af0036d-8893-4ae5-b0ee-45ceb0439691 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:21.930728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4af0036d-8893-4ae5-b0ee-45ceb0439691 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:21.933009 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:26:21.938561 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4af0036d-8893-4ae5-b0ee-45ceb0439691 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:21.939042 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4af0036d-8893-4ae5-b0ee-45ceb0439691 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:21.939491 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4af0036d-8893-4ae5-b0ee-45ceb0439691 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:21.940850 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4af0036d-8893-4ae5-b0ee-45ceb0439691 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:21.941421 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4af0036d-8893-4ae5-b0ee-45ceb0439691 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:21.941809 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4af0036d-8893-4ae5-b0ee-45ceb0439691 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:21.946734 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:26:22.075409 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4af0036d-8893-4ae5-b0ee-45ceb0439691 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:22.083515 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4af0036d-8893-4ae5-b0ee-45ceb0439691 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.157582 Aug 04 23:26:22.084085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 536/1103] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:21 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:23.045580 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-284a61d3-0a5b-44b6-a845-7c6c0c9d8a82 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:23.047792 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-284a61d3-0a5b-44b6-a845-7c6c0c9d8a82 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:23.050423 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:26:23.055504 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-284a61d3-0a5b-44b6-a845-7c6c0c9d8a82 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:23.055986 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-284a61d3-0a5b-44b6-a845-7c6c0c9d8a82 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:23.056419 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-284a61d3-0a5b-44b6-a845-7c6c0c9d8a82 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:23.057110 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-284a61d3-0a5b-44b6-a845-7c6c0c9d8a82 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:23.057572 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-284a61d3-0a5b-44b6-a845-7c6c0c9d8a82 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:23.057983 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-284a61d3-0a5b-44b6-a845-7c6c0c9d8a82 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:23.061039 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=77 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:26:23.089451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-284a61d3-0a5b-44b6-a845-7c6c0c9d8a82 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047724 Aug 04 23:26:23.089920 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 568/1104] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Aug 4 23:26:23 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 23:26:23.104096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8035263e-ac57-416d-8636-74e2152b96a2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:23.104704 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8035263e-ac57-416d-8636-74e2152b96a2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:23.111347 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8035263e-ac57-416d-8636-74e2152b96a2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:23.111861 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8035263e-ac57-416d-8636-74e2152b96a2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:23.112297 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8035263e-ac57-416d-8636-74e2152b96a2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:23.112997 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8035263e-ac57-416d-8636-74e2152b96a2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:23.113445 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8035263e-ac57-416d-8636-74e2152b96a2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:23.113868 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8035263e-ac57-416d-8636-74e2152b96a2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:23.151484 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c1b15fd1-a74c-4a87-b3d6-748cad9521eb tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:23.151972 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c1b15fd1-a74c-4a87-b3d6-748cad9521eb tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:23.158137 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c1b15fd1-a74c-4a87-b3d6-748cad9521eb tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:23.158645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c1b15fd1-a74c-4a87-b3d6-748cad9521eb tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:23.159747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c1b15fd1-a74c-4a87-b3d6-748cad9521eb tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:23.160646 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c1b15fd1-a74c-4a87-b3d6-748cad9521eb tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:23.160898 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c1b15fd1-a74c-4a87-b3d6-748cad9521eb tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:23.161315 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c1b15fd1-a74c-4a87-b3d6-748cad9521eb tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:23.187064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c1b15fd1-a74c-4a87-b3d6-748cad9521eb tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Going to try to terminate instance {{(pid=129791) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 23:26:23.254706 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8035263e-ac57-416d-8636-74e2152b96a2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:23.262185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8035263e-ac57-416d-8636-74e2152b96a2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.161870 Aug 04 23:26:23.262780 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 537/1105] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:23 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:23.271905 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c1b15fd1-a74c-4a87-b3d6-748cad9521eb tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "DELETE /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 204 len: 0 microversion: 2.1 time: 0.123808 Aug 04 23:26:23.272579 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 569/1106] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:26:23 2022] DELETE /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 23:26:23.280683 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-57763b53-9454-4d12-8453-ba0867efaf7e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:23.281285 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-57763b53-9454-4d12-8453-ba0867efaf7e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:23.288130 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57763b53-9454-4d12-8453-ba0867efaf7e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:23.288610 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57763b53-9454-4d12-8453-ba0867efaf7e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:23.289039 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57763b53-9454-4d12-8453-ba0867efaf7e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:23.289719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57763b53-9454-4d12-8453-ba0867efaf7e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:23.290163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57763b53-9454-4d12-8453-ba0867efaf7e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:23.290606 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57763b53-9454-4d12-8453-ba0867efaf7e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:23.422915 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-57763b53-9454-4d12-8453-ba0867efaf7e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:23.431282 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-57763b53-9454-4d12-8453-ba0867efaf7e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.154377 Aug 04 23:26:23.431843 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 538/1107] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:23 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:24.287937 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ef293a3d-81c2-413d-b976-b1a1b590d7b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:24.288728 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ef293a3d-81c2-413d-b976-b1a1b590d7b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:24.295527 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef293a3d-81c2-413d-b976-b1a1b590d7b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:24.296107 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef293a3d-81c2-413d-b976-b1a1b590d7b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:24.296543 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef293a3d-81c2-413d-b976-b1a1b590d7b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:24.297252 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef293a3d-81c2-413d-b976-b1a1b590d7b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:24.297713 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef293a3d-81c2-413d-b976-b1a1b590d7b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:24.298138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef293a3d-81c2-413d-b976-b1a1b590d7b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:24.453930 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c0ba3124-90ce-4489-8941-55a831eef160 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:24.454711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c0ba3124-90ce-4489-8941-55a831eef160 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:24.462034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0ba3124-90ce-4489-8941-55a831eef160 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:24.462556 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0ba3124-90ce-4489-8941-55a831eef160 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:24.463032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0ba3124-90ce-4489-8941-55a831eef160 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:24.463740 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0ba3124-90ce-4489-8941-55a831eef160 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:24.464195 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0ba3124-90ce-4489-8941-55a831eef160 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:24.464624 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0ba3124-90ce-4489-8941-55a831eef160 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:24.564411 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ef293a3d-81c2-413d-b976-b1a1b590d7b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:24.572354 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ef293a3d-81c2-413d-b976-b1a1b590d7b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.291675 Aug 04 23:26:24.573161 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 570/1108] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:24 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:24.699206 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c0ba3124-90ce-4489-8941-55a831eef160 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:24.707873 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c0ba3124-90ce-4489-8941-55a831eef160 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.257999 Aug 04 23:26:24.708443 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 539/1109] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:24 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:25.254016 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-198bad0a-da2d-46b1-8f27-9ea47afcc87f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:25.254722 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-198bad0a-da2d-46b1-8f27-9ea47afcc87f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:25.266272 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-198bad0a-da2d-46b1-8f27-9ea47afcc87f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:25.266836 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-198bad0a-da2d-46b1-8f27-9ea47afcc87f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:25.267275 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-198bad0a-da2d-46b1-8f27-9ea47afcc87f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:25.268673 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-198bad0a-da2d-46b1-8f27-9ea47afcc87f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:25.269127 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-198bad0a-da2d-46b1-8f27-9ea47afcc87f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:25.269548 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-198bad0a-da2d-46b1-8f27-9ea47afcc87f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:25.299496 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-198bad0a-da2d-46b1-8f27-9ea47afcc87f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Going to try to terminate instance {{(pid=129791) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 23:26:25.334802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-8bed3cfb-bd18-4f30-b981-1f98f2567ba2 req-3fd27459-d6ca-4be0-8dc3-e9583f72174d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d", "tag": "17de7e5d-00f0-4cfb-bf74-3a9d56f6471d"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:26:25.345841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-8bed3cfb-bd18-4f30-b981-1f98f2567ba2 req-3fd27459-d6ca-4be0-8dc3-e9583f72174d service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:25.346576 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-8bed3cfb-bd18-4f30-b981-1f98f2567ba2 req-3fd27459-d6ca-4be0-8dc3-e9583f72174d service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:25.347103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-8bed3cfb-bd18-4f30-b981-1f98f2567ba2 req-3fd27459-d6ca-4be0-8dc3-e9583f72174d service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:25.360283 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-8bed3cfb-bd18-4f30-b981-1f98f2567ba2 req-3fd27459-d6ca-4be0-8dc3-e9583f72174d service nova] Creating event network-changed:17de7e5d-00f0-4cfb-bf74-3a9d56f6471d for instance 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d on hv-cinder-85221 Aug 04 23:26:25.366208 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-8bed3cfb-bd18-4f30-b981-1f98f2567ba2 req-3fd27459-d6ca-4be0-8dc3-e9583f72174d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107520 Aug 04 23:26:25.367276 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 540/1110] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:26:25.384867 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-198bad0a-da2d-46b1-8f27-9ea47afcc87f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "DELETE /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 204 len: 0 microversion: 2.1 time: 0.135096 Aug 04 23:26:25.385487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 571/1111] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:26:25 2022] DELETE /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 23:26:25.396933 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-366162f4-4a5e-418d-9cee-0e3c53ee5a9d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:25.397644 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-366162f4-4a5e-418d-9cee-0e3c53ee5a9d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:25.403918 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-366162f4-4a5e-418d-9cee-0e3c53ee5a9d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:25.404404 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-366162f4-4a5e-418d-9cee-0e3c53ee5a9d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:25.404844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-366162f4-4a5e-418d-9cee-0e3c53ee5a9d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:25.405539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-366162f4-4a5e-418d-9cee-0e3c53ee5a9d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:25.405987 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-366162f4-4a5e-418d-9cee-0e3c53ee5a9d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:25.406487 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-366162f4-4a5e-418d-9cee-0e3c53ee5a9d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:25.547079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-366162f4-4a5e-418d-9cee-0e3c53ee5a9d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:25.555365 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-366162f4-4a5e-418d-9cee-0e3c53ee5a9d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.164056 Aug 04 23:26:25.555933 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 541/1112] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:25 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:25.593721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-251b3724-94b8-41b8-b977-0ac5290a3907 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:25.594544 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-251b3724-94b8-41b8-b977-0ac5290a3907 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:25.600708 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-251b3724-94b8-41b8-b977-0ac5290a3907 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:25.601191 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-251b3724-94b8-41b8-b977-0ac5290a3907 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:25.601628 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-251b3724-94b8-41b8-b977-0ac5290a3907 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:25.602329 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-251b3724-94b8-41b8-b977-0ac5290a3907 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:25.602814 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-251b3724-94b8-41b8-b977-0ac5290a3907 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:25.603240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-251b3724-94b8-41b8-b977-0ac5290a3907 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:25.729980 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-864f2215-2827-4281-93c8-8893c8edf3cc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:25.730841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-864f2215-2827-4281-93c8-8893c8edf3cc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:25.738074 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-864f2215-2827-4281-93c8-8893c8edf3cc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:25.738619 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-864f2215-2827-4281-93c8-8893c8edf3cc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:25.739053 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-864f2215-2827-4281-93c8-8893c8edf3cc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:25.739764 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-864f2215-2827-4281-93c8-8893c8edf3cc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:25.740221 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-864f2215-2827-4281-93c8-8893c8edf3cc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:25.740829 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-864f2215-2827-4281-93c8-8893c8edf3cc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:25.741694 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-251b3724-94b8-41b8-b977-0ac5290a3907 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:25.749871 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-251b3724-94b8-41b8-b977-0ac5290a3907 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.160339 Aug 04 23:26:25.750468 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 572/1113] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:25 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:25.880812 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-864f2215-2827-4281-93c8-8893c8edf3cc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:25.888424 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-864f2215-2827-4281-93c8-8893c8edf3cc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.162329 Aug 04 23:26:25.888987 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 542/1114] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:25 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:26.577975 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b81e0448-97bc-41e3-a2fe-0df72b07810e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:26.578618 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b81e0448-97bc-41e3-a2fe-0df72b07810e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:26.585532 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b81e0448-97bc-41e3-a2fe-0df72b07810e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:26.586013 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b81e0448-97bc-41e3-a2fe-0df72b07810e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:26.586486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b81e0448-97bc-41e3-a2fe-0df72b07810e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:26.587198 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b81e0448-97bc-41e3-a2fe-0df72b07810e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:26.587645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b81e0448-97bc-41e3-a2fe-0df72b07810e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:26.588069 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b81e0448-97bc-41e3-a2fe-0df72b07810e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:26.730256 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b81e0448-97bc-41e3-a2fe-0df72b07810e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:26.738012 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b81e0448-97bc-41e3-a2fe-0df72b07810e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.163903 Aug 04 23:26:26.738616 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 573/1115] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:26 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:26.773346 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6ad598e5-e8df-467d-ae2a-d7c75a346b78 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:26.773959 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6ad598e5-e8df-467d-ae2a-d7c75a346b78 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:26.780501 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ad598e5-e8df-467d-ae2a-d7c75a346b78 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:26.780986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ad598e5-e8df-467d-ae2a-d7c75a346b78 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:26.781419 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ad598e5-e8df-467d-ae2a-d7c75a346b78 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:26.782114 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ad598e5-e8df-467d-ae2a-d7c75a346b78 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:26.782591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ad598e5-e8df-467d-ae2a-d7c75a346b78 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:26.783009 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6ad598e5-e8df-467d-ae2a-d7c75a346b78 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:26.912039 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e4fc3ecf-9c6e-450d-8248-d013ad0426a4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:26.912660 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e4fc3ecf-9c6e-450d-8248-d013ad0426a4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:26.919247 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4fc3ecf-9c6e-450d-8248-d013ad0426a4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:26.919742 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4fc3ecf-9c6e-450d-8248-d013ad0426a4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:26.920176 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4fc3ecf-9c6e-450d-8248-d013ad0426a4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:26.920308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6ad598e5-e8df-467d-ae2a-d7c75a346b78 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:26.920891 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4fc3ecf-9c6e-450d-8248-d013ad0426a4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:26.921340 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4fc3ecf-9c6e-450d-8248-d013ad0426a4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:26.921758 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4fc3ecf-9c6e-450d-8248-d013ad0426a4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:26.928630 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6ad598e5-e8df-467d-ae2a-d7c75a346b78 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.159119 Aug 04 23:26:26.929226 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 543/1116] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:26 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:27.067091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e4fc3ecf-9c6e-450d-8248-d013ad0426a4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:27.075011 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e4fc3ecf-9c6e-450d-8248-d013ad0426a4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.166863 Aug 04 23:26:27.075596 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 574/1117] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:26 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:27.759892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8897c212-8ec5-48a9-a4da-cbcc542e43f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:27.760502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8897c212-8ec5-48a9-a4da-cbcc542e43f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:27.766697 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8897c212-8ec5-48a9-a4da-cbcc542e43f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:27.767178 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8897c212-8ec5-48a9-a4da-cbcc542e43f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:27.767605 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8897c212-8ec5-48a9-a4da-cbcc542e43f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:27.769209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8897c212-8ec5-48a9-a4da-cbcc542e43f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:27.769343 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8897c212-8ec5-48a9-a4da-cbcc542e43f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:27.769660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8897c212-8ec5-48a9-a4da-cbcc542e43f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:27.911335 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8897c212-8ec5-48a9-a4da-cbcc542e43f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:27.918928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8897c212-8ec5-48a9-a4da-cbcc542e43f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.162979 Aug 04 23:26:27.919487 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 544/1118] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:27 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:27.949285 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-361f6b16-ac89-411a-aa99-1644fab3329d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:27.949896 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-361f6b16-ac89-411a-aa99-1644fab3329d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:27.956890 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-361f6b16-ac89-411a-aa99-1644fab3329d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:27.957373 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-361f6b16-ac89-411a-aa99-1644fab3329d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:27.957805 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-361f6b16-ac89-411a-aa99-1644fab3329d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:27.958547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-361f6b16-ac89-411a-aa99-1644fab3329d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:27.959002 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-361f6b16-ac89-411a-aa99-1644fab3329d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:27.959421 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-361f6b16-ac89-411a-aa99-1644fab3329d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:28.097653 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-361f6b16-ac89-411a-aa99-1644fab3329d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:28.097821 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-35f2867a-0854-4a0d-8316-1fc445799dab tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:28.098274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-35f2867a-0854-4a0d-8316-1fc445799dab tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:28.104426 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-35f2867a-0854-4a0d-8316-1fc445799dab tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:28.104920 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-35f2867a-0854-4a0d-8316-1fc445799dab tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:28.105277 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-361f6b16-ac89-411a-aa99-1644fab3329d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.160000 Aug 04 23:26:28.105386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-35f2867a-0854-4a0d-8316-1fc445799dab tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:28.105847 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 575/1119] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:27 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:28.106118 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-35f2867a-0854-4a0d-8316-1fc445799dab tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:28.106610 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-35f2867a-0854-4a0d-8316-1fc445799dab tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:28.107028 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-35f2867a-0854-4a0d-8316-1fc445799dab tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:28.244265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-35f2867a-0854-4a0d-8316-1fc445799dab tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:28.253771 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-35f2867a-0854-4a0d-8316-1fc445799dab tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.159575 Aug 04 23:26:28.254040 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 545/1120] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:28 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:28.942096 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-51c66c0a-6897-42d3-852b-0c1b820d7f0d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:28.942740 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-51c66c0a-6897-42d3-852b-0c1b820d7f0d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:28.948966 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51c66c0a-6897-42d3-852b-0c1b820d7f0d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:28.949440 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51c66c0a-6897-42d3-852b-0c1b820d7f0d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:28.950024 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51c66c0a-6897-42d3-852b-0c1b820d7f0d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:28.950589 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51c66c0a-6897-42d3-852b-0c1b820d7f0d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:28.951034 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51c66c0a-6897-42d3-852b-0c1b820d7f0d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:28.951454 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51c66c0a-6897-42d3-852b-0c1b820d7f0d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:29.097499 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-51c66c0a-6897-42d3-852b-0c1b820d7f0d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:29.107663 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-51c66c0a-6897-42d3-852b-0c1b820d7f0d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.169958 Aug 04 23:26:29.108651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 576/1121] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:28 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:29.131503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-53d392ab-985f-4de7-ba11-98d9bf236d6a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:29.132651 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-53d392ab-985f-4de7-ba11-98d9bf236d6a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:29.140992 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53d392ab-985f-4de7-ba11-98d9bf236d6a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:29.141479 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53d392ab-985f-4de7-ba11-98d9bf236d6a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:29.141925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53d392ab-985f-4de7-ba11-98d9bf236d6a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:29.143371 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53d392ab-985f-4de7-ba11-98d9bf236d6a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:29.143833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53d392ab-985f-4de7-ba11-98d9bf236d6a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:29.144449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53d392ab-985f-4de7-ba11-98d9bf236d6a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:29.275158 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7f96a528-76ed-41f9-b133-545122a40c7e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:29.275769 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7f96a528-76ed-41f9-b133-545122a40c7e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:29.281854 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7f96a528-76ed-41f9-b133-545122a40c7e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:29.282337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7f96a528-76ed-41f9-b133-545122a40c7e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:29.282803 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7f96a528-76ed-41f9-b133-545122a40c7e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:29.284388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7f96a528-76ed-41f9-b133-545122a40c7e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:29.285100 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7f96a528-76ed-41f9-b133-545122a40c7e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:29.285527 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7f96a528-76ed-41f9-b133-545122a40c7e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:29.287359 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-53d392ab-985f-4de7-ba11-98d9bf236d6a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:29.295221 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-53d392ab-985f-4de7-ba11-98d9bf236d6a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.171806 Aug 04 23:26:29.295807 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 546/1122] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:29 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:29.422560 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7f96a528-76ed-41f9-b133-545122a40c7e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:29.431870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7f96a528-76ed-41f9-b133-545122a40c7e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.160509 Aug 04 23:26:29.432430 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 577/1123] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:29 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:30.131441 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a619da9d-bbbe-489e-96ee-99028fcbdd51 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:30.131988 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a619da9d-bbbe-489e-96ee-99028fcbdd51 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:30.138519 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a619da9d-bbbe-489e-96ee-99028fcbdd51 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:30.138999 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a619da9d-bbbe-489e-96ee-99028fcbdd51 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:30.139430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a619da9d-bbbe-489e-96ee-99028fcbdd51 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:30.140126 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a619da9d-bbbe-489e-96ee-99028fcbdd51 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:30.140572 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a619da9d-bbbe-489e-96ee-99028fcbdd51 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:30.140989 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a619da9d-bbbe-489e-96ee-99028fcbdd51 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:30.283019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a619da9d-bbbe-489e-96ee-99028fcbdd51 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:30.291501 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a619da9d-bbbe-489e-96ee-99028fcbdd51 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.164570 Aug 04 23:26:30.292075 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 547/1124] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:30 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:30.317505 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4d95d3b3-f815-4692-8bc2-fddaa05a6ed3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:30.318115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4d95d3b3-f815-4692-8bc2-fddaa05a6ed3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:30.324735 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4d95d3b3-f815-4692-8bc2-fddaa05a6ed3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:30.325209 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4d95d3b3-f815-4692-8bc2-fddaa05a6ed3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:30.325643 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4d95d3b3-f815-4692-8bc2-fddaa05a6ed3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:30.326405 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4d95d3b3-f815-4692-8bc2-fddaa05a6ed3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:30.326802 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4d95d3b3-f815-4692-8bc2-fddaa05a6ed3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:30.327279 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4d95d3b3-f815-4692-8bc2-fddaa05a6ed3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:30.454020 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-14bc679c-d22f-4f78-a256-ff42dc78984d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:30.454833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-14bc679c-d22f-4f78-a256-ff42dc78984d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:30.462760 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-14bc679c-d22f-4f78-a256-ff42dc78984d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:30.463247 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-14bc679c-d22f-4f78-a256-ff42dc78984d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:30.463683 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-14bc679c-d22f-4f78-a256-ff42dc78984d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:30.464410 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-14bc679c-d22f-4f78-a256-ff42dc78984d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:30.464857 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-14bc679c-d22f-4f78-a256-ff42dc78984d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:30.465277 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-14bc679c-d22f-4f78-a256-ff42dc78984d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:30.474680 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4d95d3b3-f815-4692-8bc2-fddaa05a6ed3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:30.483873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4d95d3b3-f815-4692-8bc2-fddaa05a6ed3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.170646 Aug 04 23:26:30.484453 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 578/1125] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:30 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:30.618551 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-14bc679c-d22f-4f78-a256-ff42dc78984d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:30.626803 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-14bc679c-d22f-4f78-a256-ff42dc78984d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.176709 Aug 04 23:26:30.627974 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 548/1126] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:30 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:31.313343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c3d1663b-25f1-40a6-b259-cac958294c34 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:31.313954 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c3d1663b-25f1-40a6-b259-cac958294c34 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:31.321014 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c3d1663b-25f1-40a6-b259-cac958294c34 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:31.321654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c3d1663b-25f1-40a6-b259-cac958294c34 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:31.321899 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c3d1663b-25f1-40a6-b259-cac958294c34 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:31.322631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c3d1663b-25f1-40a6-b259-cac958294c34 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:31.323252 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c3d1663b-25f1-40a6-b259-cac958294c34 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:31.323675 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c3d1663b-25f1-40a6-b259-cac958294c34 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:31.466192 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c3d1663b-25f1-40a6-b259-cac958294c34 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:31.475072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c3d1663b-25f1-40a6-b259-cac958294c34 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.165760 Aug 04 23:26:31.475643 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 579/1127] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:31 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:31.505010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9307c2da-ac87-434c-9939-31b8a9871ac4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:31.505695 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9307c2da-ac87-434c-9939-31b8a9871ac4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:31.512426 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9307c2da-ac87-434c-9939-31b8a9871ac4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:31.512913 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9307c2da-ac87-434c-9939-31b8a9871ac4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:31.513354 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9307c2da-ac87-434c-9939-31b8a9871ac4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:31.514055 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9307c2da-ac87-434c-9939-31b8a9871ac4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:31.514551 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9307c2da-ac87-434c-9939-31b8a9871ac4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:31.514973 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9307c2da-ac87-434c-9939-31b8a9871ac4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:31.648497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9307c2da-ac87-434c-9939-31b8a9871ac4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:31.649694 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d1409a63-d73e-445a-9667-5e7775d6b0ff tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:31.650509 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d1409a63-d73e-445a-9667-5e7775d6b0ff tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:31.656663 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1409a63-d73e-445a-9667-5e7775d6b0ff tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:31.657026 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1409a63-d73e-445a-9667-5e7775d6b0ff tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:31.657464 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1409a63-d73e-445a-9667-5e7775d6b0ff tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:31.657583 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9307c2da-ac87-434c-9939-31b8a9871ac4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.156303 Aug 04 23:26:31.658066 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 549/1128] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:31 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:31.658956 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1409a63-d73e-445a-9667-5e7775d6b0ff tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:31.659278 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1409a63-d73e-445a-9667-5e7775d6b0ff tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:31.659770 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1409a63-d73e-445a-9667-5e7775d6b0ff tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:31.796269 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d1409a63-d73e-445a-9667-5e7775d6b0ff tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:31.804728 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d1409a63-d73e-445a-9667-5e7775d6b0ff tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.158907 Aug 04 23:26:31.805299 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 580/1129] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:31 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:32.496547 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0f87ff00-8592-4858-aaa1-de4d17b27537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:32.497039 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0f87ff00-8592-4858-aaa1-de4d17b27537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:32.504516 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f87ff00-8592-4858-aaa1-de4d17b27537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:32.505002 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f87ff00-8592-4858-aaa1-de4d17b27537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:32.505431 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f87ff00-8592-4858-aaa1-de4d17b27537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:32.506137 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f87ff00-8592-4858-aaa1-de4d17b27537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:32.506836 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f87ff00-8592-4858-aaa1-de4d17b27537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:32.507047 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f87ff00-8592-4858-aaa1-de4d17b27537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:32.649989 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0f87ff00-8592-4858-aaa1-de4d17b27537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:32.657657 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0f87ff00-8592-4858-aaa1-de4d17b27537 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.165004 Aug 04 23:26:32.658311 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 550/1130] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:32 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:32.680626 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c5a1d81e-0cf6-449c-ac14-5556ad518044 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:32.681227 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c5a1d81e-0cf6-449c-ac14-5556ad518044 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:32.687795 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c5a1d81e-0cf6-449c-ac14-5556ad518044 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:32.688272 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c5a1d81e-0cf6-449c-ac14-5556ad518044 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:32.688706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c5a1d81e-0cf6-449c-ac14-5556ad518044 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:32.689922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c5a1d81e-0cf6-449c-ac14-5556ad518044 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:32.690664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c5a1d81e-0cf6-449c-ac14-5556ad518044 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:32.690826 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c5a1d81e-0cf6-449c-ac14-5556ad518044 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:32.707104 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:26:32.826687 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c5a1d81e-0cf6-449c-ac14-5556ad518044 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:32.828088 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e6cab130-0801-4307-9902-1f848a29fff3 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:32.828851 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e6cab130-0801-4307-9902-1f848a29fff3 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:32.835911 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c5a1d81e-0cf6-449c-ac14-5556ad518044 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.159125 Aug 04 23:26:32.836483 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 581/1131] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:32 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:32.842011 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6cab130-0801-4307-9902-1f848a29fff3 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:32.842011 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6cab130-0801-4307-9902-1f848a29fff3 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:32.842011 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6cab130-0801-4307-9902-1f848a29fff3 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:32.842011 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6cab130-0801-4307-9902-1f848a29fff3 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:32.842995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6cab130-0801-4307-9902-1f848a29fff3 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:32.842995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6cab130-0801-4307-9902-1f848a29fff3 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:33.221851 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e6cab130-0801-4307-9902-1f848a29fff3 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:33.234355 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e6cab130-0801-4307-9902-1f848a29fff3 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.410150 Aug 04 23:26:33.234966 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 551/1132] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:32 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:33.679959 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-abaeb537-0cc4-48a2-bc18-72ab401a1d2f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:33.680699 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-abaeb537-0cc4-48a2-bc18-72ab401a1d2f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:33.686928 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abaeb537-0cc4-48a2-bc18-72ab401a1d2f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:33.687407 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abaeb537-0cc4-48a2-bc18-72ab401a1d2f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:33.687837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abaeb537-0cc4-48a2-bc18-72ab401a1d2f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:33.688530 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abaeb537-0cc4-48a2-bc18-72ab401a1d2f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:33.688985 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abaeb537-0cc4-48a2-bc18-72ab401a1d2f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:33.690008 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abaeb537-0cc4-48a2-bc18-72ab401a1d2f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:33.833570 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-abaeb537-0cc4-48a2-bc18-72ab401a1d2f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:33.842384 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-abaeb537-0cc4-48a2-bc18-72ab401a1d2f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.166227 Aug 04 23:26:33.842962 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 582/1133] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:33 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:33.856659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6f42aaa9-f137-4aeb-9346-1fb28a3e3264 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:33.857267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6f42aaa9-f137-4aeb-9346-1fb28a3e3264 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:33.864619 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6f42aaa9-f137-4aeb-9346-1fb28a3e3264 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:33.865099 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6f42aaa9-f137-4aeb-9346-1fb28a3e3264 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:33.865532 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6f42aaa9-f137-4aeb-9346-1fb28a3e3264 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:33.866235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6f42aaa9-f137-4aeb-9346-1fb28a3e3264 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:33.866713 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6f42aaa9-f137-4aeb-9346-1fb28a3e3264 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:33.867136 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6f42aaa9-f137-4aeb-9346-1fb28a3e3264 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:34.011750 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6f42aaa9-f137-4aeb-9346-1fb28a3e3264 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:34.019639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6f42aaa9-f137-4aeb-9346-1fb28a3e3264 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.166945 Aug 04 23:26:34.020207 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 552/1134] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:33 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:34.257051 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-546ea7d8-fb34-4b30-954b-eb4bd42c652e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:34.257641 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-546ea7d8-fb34-4b30-954b-eb4bd42c652e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:34.263669 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-546ea7d8-fb34-4b30-954b-eb4bd42c652e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:34.264151 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-546ea7d8-fb34-4b30-954b-eb4bd42c652e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:34.264583 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-546ea7d8-fb34-4b30-954b-eb4bd42c652e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:34.265270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-546ea7d8-fb34-4b30-954b-eb4bd42c652e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:34.265721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-546ea7d8-fb34-4b30-954b-eb4bd42c652e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:34.266142 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-546ea7d8-fb34-4b30-954b-eb4bd42c652e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:34.396713 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-546ea7d8-fb34-4b30-954b-eb4bd42c652e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:34.404288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-546ea7d8-fb34-4b30-954b-eb4bd42c652e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.151150 Aug 04 23:26:34.404848 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 583/1135] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:34 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:34.864213 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8d608a1d-a8cd-43e4-bb75-a623e34a9e76 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:34.864823 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8d608a1d-a8cd-43e4-bb75-a623e34a9e76 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:34.871383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d608a1d-a8cd-43e4-bb75-a623e34a9e76 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:34.871868 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d608a1d-a8cd-43e4-bb75-a623e34a9e76 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:34.872301 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d608a1d-a8cd-43e4-bb75-a623e34a9e76 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:34.873001 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d608a1d-a8cd-43e4-bb75-a623e34a9e76 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:34.873453 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d608a1d-a8cd-43e4-bb75-a623e34a9e76 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:34.873875 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d608a1d-a8cd-43e4-bb75-a623e34a9e76 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:34.889706 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:26:35.013055 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8d608a1d-a8cd-43e4-bb75-a623e34a9e76 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:35.021308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8d608a1d-a8cd-43e4-bb75-a623e34a9e76 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.161529 Aug 04 23:26:35.021876 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 553/1136] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:34 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:35.040396 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-681c7e8d-e3ad-4db3-b322-dbef29b44ab2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:35.041031 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-681c7e8d-e3ad-4db3-b322-dbef29b44ab2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:35.047586 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-681c7e8d-e3ad-4db3-b322-dbef29b44ab2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:35.048067 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-681c7e8d-e3ad-4db3-b322-dbef29b44ab2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:35.048502 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-681c7e8d-e3ad-4db3-b322-dbef29b44ab2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:35.049901 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-681c7e8d-e3ad-4db3-b322-dbef29b44ab2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:35.050381 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-681c7e8d-e3ad-4db3-b322-dbef29b44ab2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:35.050804 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-681c7e8d-e3ad-4db3-b322-dbef29b44ab2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:35.186449 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-681c7e8d-e3ad-4db3-b322-dbef29b44ab2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:35.194602 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-681c7e8d-e3ad-4db3-b322-dbef29b44ab2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.158159 Aug 04 23:26:35.195173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 584/1137] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:35 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:35.425794 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b058ae31-258a-4c4a-9385-caa83efe5bb8 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:35.426451 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b058ae31-258a-4c4a-9385-caa83efe5bb8 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:35.432826 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b058ae31-258a-4c4a-9385-caa83efe5bb8 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:35.433316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b058ae31-258a-4c4a-9385-caa83efe5bb8 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:35.433752 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b058ae31-258a-4c4a-9385-caa83efe5bb8 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:35.434495 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b058ae31-258a-4c4a-9385-caa83efe5bb8 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:35.434953 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b058ae31-258a-4c4a-9385-caa83efe5bb8 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:35.435378 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b058ae31-258a-4c4a-9385-caa83efe5bb8 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:35.569614 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b058ae31-258a-4c4a-9385-caa83efe5bb8 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:35.577177 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b058ae31-258a-4c4a-9385-caa83efe5bb8 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.155610 Aug 04 23:26:35.577744 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 554/1138] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:35 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:36.047496 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3926bf87-d1d0-4a40-b425-75a5e3d81419 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:36.049166 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3926bf87-d1d0-4a40-b425-75a5e3d81419 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:36.056852 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3926bf87-d1d0-4a40-b425-75a5e3d81419 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:36.057373 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3926bf87-d1d0-4a40-b425-75a5e3d81419 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:36.057810 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3926bf87-d1d0-4a40-b425-75a5e3d81419 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:36.058561 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3926bf87-d1d0-4a40-b425-75a5e3d81419 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:36.059152 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3926bf87-d1d0-4a40-b425-75a5e3d81419 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:36.059790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3926bf87-d1d0-4a40-b425-75a5e3d81419 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:36.196949 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3926bf87-d1d0-4a40-b425-75a5e3d81419 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:36.204651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3926bf87-d1d0-4a40-b425-75a5e3d81419 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.163738 Aug 04 23:26:36.206420 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 585/1139] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:36 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:36.216794 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6a42cff7-a671-4eba-a75f-aa57e8cd6832 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:36.217412 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6a42cff7-a671-4eba-a75f-aa57e8cd6832 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:36.224639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a42cff7-a671-4eba-a75f-aa57e8cd6832 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:36.225127 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a42cff7-a671-4eba-a75f-aa57e8cd6832 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:36.225561 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a42cff7-a671-4eba-a75f-aa57e8cd6832 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:36.226270 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a42cff7-a671-4eba-a75f-aa57e8cd6832 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:36.226758 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a42cff7-a671-4eba-a75f-aa57e8cd6832 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:36.227183 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a42cff7-a671-4eba-a75f-aa57e8cd6832 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:36.364399 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6a42cff7-a671-4eba-a75f-aa57e8cd6832 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:36.372486 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6a42cff7-a671-4eba-a75f-aa57e8cd6832 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.159618 Aug 04 23:26:36.373074 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 555/1140] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:36 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:36.600067 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-bf9393b3-9f08-4b5a-a2fb-56eae4b91a36 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:36.600679 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-bf9393b3-9f08-4b5a-a2fb-56eae4b91a36 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:36.607008 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bf9393b3-9f08-4b5a-a2fb-56eae4b91a36 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:36.607490 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bf9393b3-9f08-4b5a-a2fb-56eae4b91a36 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:36.607923 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bf9393b3-9f08-4b5a-a2fb-56eae4b91a36 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:36.608652 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bf9393b3-9f08-4b5a-a2fb-56eae4b91a36 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:36.609099 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bf9393b3-9f08-4b5a-a2fb-56eae4b91a36 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:36.609525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bf9393b3-9f08-4b5a-a2fb-56eae4b91a36 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:36.747913 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-bf9393b3-9f08-4b5a-a2fb-56eae4b91a36 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:36.756625 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-bf9393b3-9f08-4b5a-a2fb-56eae4b91a36 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.161268 Aug 04 23:26:36.761574 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 586/1141] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:36 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:37.228097 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-cd52c5fe-a411-4d27-8473-668ad12fb24d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:37.228707 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-cd52c5fe-a411-4d27-8473-668ad12fb24d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:37.235262 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cd52c5fe-a411-4d27-8473-668ad12fb24d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:37.235748 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cd52c5fe-a411-4d27-8473-668ad12fb24d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:37.236767 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cd52c5fe-a411-4d27-8473-668ad12fb24d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:37.237577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cd52c5fe-a411-4d27-8473-668ad12fb24d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:37.238033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cd52c5fe-a411-4d27-8473-668ad12fb24d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:37.238486 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cd52c5fe-a411-4d27-8473-668ad12fb24d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:37.379015 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-cd52c5fe-a411-4d27-8473-668ad12fb24d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:37.388079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-cd52c5fe-a411-4d27-8473-668ad12fb24d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.162634 Aug 04 23:26:37.388079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 556/1142] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:37 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:37.396139 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5afd5b21-dd21-4f19-9b84-0d3beb52bcf8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:37.397144 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5afd5b21-dd21-4f19-9b84-0d3beb52bcf8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:37.405445 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5afd5b21-dd21-4f19-9b84-0d3beb52bcf8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:37.405923 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5afd5b21-dd21-4f19-9b84-0d3beb52bcf8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:37.406351 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5afd5b21-dd21-4f19-9b84-0d3beb52bcf8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:37.407067 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5afd5b21-dd21-4f19-9b84-0d3beb52bcf8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:37.407512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5afd5b21-dd21-4f19-9b84-0d3beb52bcf8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:37.409237 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5afd5b21-dd21-4f19-9b84-0d3beb52bcf8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:37.548005 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5afd5b21-dd21-4f19-9b84-0d3beb52bcf8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:37.556877 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5afd5b21-dd21-4f19-9b84-0d3beb52bcf8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.166902 Aug 04 23:26:37.557560 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 587/1143] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:37 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:37.777752 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a5c8966a-d451-41b7-bbc8-21e1e0ae2e21 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:37.778283 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a5c8966a-d451-41b7-bbc8-21e1e0ae2e21 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:37.785179 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5c8966a-d451-41b7-bbc8-21e1e0ae2e21 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:37.785663 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5c8966a-d451-41b7-bbc8-21e1e0ae2e21 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:37.786096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5c8966a-d451-41b7-bbc8-21e1e0ae2e21 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:37.786830 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5c8966a-d451-41b7-bbc8-21e1e0ae2e21 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:37.787284 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5c8966a-d451-41b7-bbc8-21e1e0ae2e21 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:37.787706 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5c8966a-d451-41b7-bbc8-21e1e0ae2e21 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:37.934597 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a5c8966a-d451-41b7-bbc8-21e1e0ae2e21 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:37.947632 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a5c8966a-d451-41b7-bbc8-21e1e0ae2e21 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.173818 Aug 04 23:26:37.948242 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 557/1144] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:37 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:38.411625 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e4f35ee7-6c49-4e75-9cee-4cc53af90842 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:38.412202 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e4f35ee7-6c49-4e75-9cee-4cc53af90842 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:38.418747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4f35ee7-6c49-4e75-9cee-4cc53af90842 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:38.419231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4f35ee7-6c49-4e75-9cee-4cc53af90842 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:38.419663 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4f35ee7-6c49-4e75-9cee-4cc53af90842 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:38.420387 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4f35ee7-6c49-4e75-9cee-4cc53af90842 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:38.420844 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4f35ee7-6c49-4e75-9cee-4cc53af90842 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:38.421266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4f35ee7-6c49-4e75-9cee-4cc53af90842 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:38.555147 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e4f35ee7-6c49-4e75-9cee-4cc53af90842 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:38.562816 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e4f35ee7-6c49-4e75-9cee-4cc53af90842 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.155107 Aug 04 23:26:38.563385 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 588/1145] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:38 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:38.576864 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3c6a933a-8af6-4ff5-aeff-5904387c2e09 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:38.577470 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3c6a933a-8af6-4ff5-aeff-5904387c2e09 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:38.584713 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c6a933a-8af6-4ff5-aeff-5904387c2e09 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:38.585185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c6a933a-8af6-4ff5-aeff-5904387c2e09 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:38.585615 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c6a933a-8af6-4ff5-aeff-5904387c2e09 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:38.586297 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c6a933a-8af6-4ff5-aeff-5904387c2e09 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:38.586771 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c6a933a-8af6-4ff5-aeff-5904387c2e09 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:38.587187 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c6a933a-8af6-4ff5-aeff-5904387c2e09 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:38.732780 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3c6a933a-8af6-4ff5-aeff-5904387c2e09 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:38.741836 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3c6a933a-8af6-4ff5-aeff-5904387c2e09 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.168706 Aug 04 23:26:38.742639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 558/1146] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:38 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:38.969594 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c7af8501-d0bd-418d-b505-f61056b0219c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:38.970115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c7af8501-d0bd-418d-b505-f61056b0219c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:38.976847 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c7af8501-d0bd-418d-b505-f61056b0219c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:38.977328 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c7af8501-d0bd-418d-b505-f61056b0219c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:38.977757 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c7af8501-d0bd-418d-b505-f61056b0219c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:38.978470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c7af8501-d0bd-418d-b505-f61056b0219c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:38.978923 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c7af8501-d0bd-418d-b505-f61056b0219c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:38.979342 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c7af8501-d0bd-418d-b505-f61056b0219c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:39.112915 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c7af8501-d0bd-418d-b505-f61056b0219c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:39.120402 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c7af8501-d0bd-418d-b505-f61056b0219c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.154752 Aug 04 23:26:39.120958 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 589/1147] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:38 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:39.585000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7b31f85c-8650-4067-856c-c347f0659f62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:39.585589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7b31f85c-8650-4067-856c-c347f0659f62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:39.592058 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b31f85c-8650-4067-856c-c347f0659f62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:39.592539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b31f85c-8650-4067-856c-c347f0659f62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:39.592970 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b31f85c-8650-4067-856c-c347f0659f62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:39.593660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b31f85c-8650-4067-856c-c347f0659f62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:39.594108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b31f85c-8650-4067-856c-c347f0659f62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:39.594560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b31f85c-8650-4067-856c-c347f0659f62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:39.733902 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7b31f85c-8650-4067-856c-c347f0659f62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:39.742022 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7b31f85c-8650-4067-856c-c347f0659f62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.160846 Aug 04 23:26:39.742621 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 559/1148] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:39 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:39.762790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c63c0112-7640-4eec-83ef-a73ed7b2fb57 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:39.763449 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c63c0112-7640-4eec-83ef-a73ed7b2fb57 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:39.770262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c63c0112-7640-4eec-83ef-a73ed7b2fb57 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:39.770767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c63c0112-7640-4eec-83ef-a73ed7b2fb57 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:39.771194 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c63c0112-7640-4eec-83ef-a73ed7b2fb57 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:39.771872 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c63c0112-7640-4eec-83ef-a73ed7b2fb57 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:39.772313 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c63c0112-7640-4eec-83ef-a73ed7b2fb57 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:39.772730 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c63c0112-7640-4eec-83ef-a73ed7b2fb57 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:39.910229 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c63c0112-7640-4eec-83ef-a73ed7b2fb57 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:39.917726 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c63c0112-7640-4eec-83ef-a73ed7b2fb57 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.158764 Aug 04 23:26:39.918292 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 590/1149] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:39 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:40.140932 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e7c7c322-d353-41e1-a982-be5147381abc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:40.141539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e7c7c322-d353-41e1-a982-be5147381abc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:40.147936 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e7c7c322-d353-41e1-a982-be5147381abc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:40.148423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e7c7c322-d353-41e1-a982-be5147381abc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:40.148861 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e7c7c322-d353-41e1-a982-be5147381abc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:40.149562 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e7c7c322-d353-41e1-a982-be5147381abc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:40.150015 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e7c7c322-d353-41e1-a982-be5147381abc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:40.150463 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e7c7c322-d353-41e1-a982-be5147381abc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:40.287684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e7c7c322-d353-41e1-a982-be5147381abc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:40.295580 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e7c7c322-d353-41e1-a982-be5147381abc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.158431 Aug 04 23:26:40.296503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 560/1150] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:40 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:40.770213 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9caced2a-23ac-4b8a-b2ec-14c6cd250e62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:40.771351 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9caced2a-23ac-4b8a-b2ec-14c6cd250e62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:40.779761 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9caced2a-23ac-4b8a-b2ec-14c6cd250e62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:40.780263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9caced2a-23ac-4b8a-b2ec-14c6cd250e62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:40.780779 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9caced2a-23ac-4b8a-b2ec-14c6cd250e62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:40.781547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9caced2a-23ac-4b8a-b2ec-14c6cd250e62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:40.782062 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9caced2a-23ac-4b8a-b2ec-14c6cd250e62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:40.782806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9caced2a-23ac-4b8a-b2ec-14c6cd250e62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:40.939054 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a577683f-694e-4abb-9d91-00f4037165a2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:40.940154 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a577683f-694e-4abb-9d91-00f4037165a2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:40.943460 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9caced2a-23ac-4b8a-b2ec-14c6cd250e62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:40.950073 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a577683f-694e-4abb-9d91-00f4037165a2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:40.950867 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a577683f-694e-4abb-9d91-00f4037165a2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:40.951311 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a577683f-694e-4abb-9d91-00f4037165a2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:40.952029 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a577683f-694e-4abb-9d91-00f4037165a2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:40.952482 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a577683f-694e-4abb-9d91-00f4037165a2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:40.952589 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9caced2a-23ac-4b8a-b2ec-14c6cd250e62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.191550 Aug 04 23:26:40.952909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a577683f-694e-4abb-9d91-00f4037165a2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:40.953159 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 591/1151] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:40 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:41.107241 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a577683f-694e-4abb-9d91-00f4037165a2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:41.116060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a577683f-694e-4abb-9d91-00f4037165a2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.181421 Aug 04 23:26:41.116662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 561/1152] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:40 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:41.320442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-20b9075b-72ed-46ba-a97b-0c7b1c34c320 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:41.321144 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-20b9075b-72ed-46ba-a97b-0c7b1c34c320 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:41.327739 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20b9075b-72ed-46ba-a97b-0c7b1c34c320 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:41.328220 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20b9075b-72ed-46ba-a97b-0c7b1c34c320 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:41.328651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20b9075b-72ed-46ba-a97b-0c7b1c34c320 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:41.329357 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20b9075b-72ed-46ba-a97b-0c7b1c34c320 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:41.330489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20b9075b-72ed-46ba-a97b-0c7b1c34c320 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:41.330950 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20b9075b-72ed-46ba-a97b-0c7b1c34c320 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:41.485162 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-20b9075b-72ed-46ba-a97b-0c7b1c34c320 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:41.492874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-20b9075b-72ed-46ba-a97b-0c7b1c34c320 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.176799 Aug 04 23:26:41.493455 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 592/1153] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:41 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:41.976095 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-bb6a8e0c-4fe4-4765-9fcf-bd78ab5185aa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:41.977166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-bb6a8e0c-4fe4-4765-9fcf-bd78ab5185aa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:41.984293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb6a8e0c-4fe4-4765-9fcf-bd78ab5185aa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:41.984783 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb6a8e0c-4fe4-4765-9fcf-bd78ab5185aa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:41.985222 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb6a8e0c-4fe4-4765-9fcf-bd78ab5185aa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:41.985933 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb6a8e0c-4fe4-4765-9fcf-bd78ab5185aa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:41.987030 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb6a8e0c-4fe4-4765-9fcf-bd78ab5185aa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:41.987459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb6a8e0c-4fe4-4765-9fcf-bd78ab5185aa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:42.127916 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-bb6a8e0c-4fe4-4765-9fcf-bd78ab5185aa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:42.136591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-bb6a8e0c-4fe4-4765-9fcf-bd78ab5185aa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.164303 Aug 04 23:26:42.137178 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 562/1154] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:41 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:42.138713 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8c9efe93-8cd9-4725-8201-4c078f463b44 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:42.139338 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8c9efe93-8cd9-4725-8201-4c078f463b44 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:42.147554 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8c9efe93-8cd9-4725-8201-4c078f463b44 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:42.148036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8c9efe93-8cd9-4725-8201-4c078f463b44 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:42.148476 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8c9efe93-8cd9-4725-8201-4c078f463b44 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:42.149178 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8c9efe93-8cd9-4725-8201-4c078f463b44 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:42.149621 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8c9efe93-8cd9-4725-8201-4c078f463b44 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:42.150044 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8c9efe93-8cd9-4725-8201-4c078f463b44 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:42.307395 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8c9efe93-8cd9-4725-8201-4c078f463b44 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:42.315908 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8c9efe93-8cd9-4725-8201-4c078f463b44 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.180983 Aug 04 23:26:42.316488 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 593/1155] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:42 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:42.513475 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d4e418f4-f60e-4ed0-b310-78a730144ad4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:42.514089 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d4e418f4-f60e-4ed0-b310-78a730144ad4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:42.522445 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d4e418f4-f60e-4ed0-b310-78a730144ad4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:42.522940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d4e418f4-f60e-4ed0-b310-78a730144ad4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:42.523378 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d4e418f4-f60e-4ed0-b310-78a730144ad4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:42.524107 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d4e418f4-f60e-4ed0-b310-78a730144ad4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:42.524594 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d4e418f4-f60e-4ed0-b310-78a730144ad4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:42.525020 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d4e418f4-f60e-4ed0-b310-78a730144ad4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:42.667208 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d4e418f4-f60e-4ed0-b310-78a730144ad4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:42.677737 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d4e418f4-f60e-4ed0-b310-78a730144ad4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.168169 Aug 04 23:26:42.678322 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 563/1156] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:42 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:43.158298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b6a6bbcf-01a3-4651-b6aa-005eb5776fef tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:43.159069 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b6a6bbcf-01a3-4651-b6aa-005eb5776fef tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:43.165416 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b6a6bbcf-01a3-4651-b6aa-005eb5776fef tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:43.165896 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b6a6bbcf-01a3-4651-b6aa-005eb5776fef tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:43.166327 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b6a6bbcf-01a3-4651-b6aa-005eb5776fef tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:43.167050 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b6a6bbcf-01a3-4651-b6aa-005eb5776fef tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:43.167500 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b6a6bbcf-01a3-4651-b6aa-005eb5776fef tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:43.167920 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b6a6bbcf-01a3-4651-b6aa-005eb5776fef tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:43.310103 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b6a6bbcf-01a3-4651-b6aa-005eb5776fef tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:43.320656 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b6a6bbcf-01a3-4651-b6aa-005eb5776fef tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.166259 Aug 04 23:26:43.321234 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 594/1157] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:43 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:43.338512 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-34d12824-744f-4219-9cc3-5212f79e752f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:43.339518 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-34d12824-744f-4219-9cc3-5212f79e752f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:43.347055 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34d12824-744f-4219-9cc3-5212f79e752f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:43.347534 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34d12824-744f-4219-9cc3-5212f79e752f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:43.347966 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34d12824-744f-4219-9cc3-5212f79e752f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:43.348654 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34d12824-744f-4219-9cc3-5212f79e752f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:43.349101 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34d12824-744f-4219-9cc3-5212f79e752f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:43.349514 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34d12824-744f-4219-9cc3-5212f79e752f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:43.501926 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-34d12824-744f-4219-9cc3-5212f79e752f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:43.509674 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-34d12824-744f-4219-9cc3-5212f79e752f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.176082 Aug 04 23:26:43.510269 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 564/1158] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:43 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:43.701787 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c94a0844-9d3b-4887-b3ad-e0f4c9bf781f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:43.703037 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c94a0844-9d3b-4887-b3ad-e0f4c9bf781f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:43.709678 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c94a0844-9d3b-4887-b3ad-e0f4c9bf781f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:43.710193 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c94a0844-9d3b-4887-b3ad-e0f4c9bf781f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:43.710670 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c94a0844-9d3b-4887-b3ad-e0f4c9bf781f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:43.711370 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c94a0844-9d3b-4887-b3ad-e0f4c9bf781f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:43.711821 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c94a0844-9d3b-4887-b3ad-e0f4c9bf781f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:43.712247 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c94a0844-9d3b-4887-b3ad-e0f4c9bf781f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:43.866250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c94a0844-9d3b-4887-b3ad-e0f4c9bf781f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:43.879719 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c94a0844-9d3b-4887-b3ad-e0f4c9bf781f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.181458 Aug 04 23:26:43.880695 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 595/1159] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:43 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:44.355567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1b36362a-2f79-4fc8-931f-6210e02f792e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:44.356191 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1b36362a-2f79-4fc8-931f-6210e02f792e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:44.364295 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1b36362a-2f79-4fc8-931f-6210e02f792e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:44.364696 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1b36362a-2f79-4fc8-931f-6210e02f792e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:44.365125 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1b36362a-2f79-4fc8-931f-6210e02f792e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:44.365833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1b36362a-2f79-4fc8-931f-6210e02f792e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:44.366283 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1b36362a-2f79-4fc8-931f-6210e02f792e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:44.366752 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1b36362a-2f79-4fc8-931f-6210e02f792e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:44.535522 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1b36362a-2f79-4fc8-931f-6210e02f792e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:44.535870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ada85959-168a-4663-b02e-1944044217f8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:44.536756 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ada85959-168a-4663-b02e-1944044217f8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:44.543532 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1b36362a-2f79-4fc8-931f-6210e02f792e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.192574 Aug 04 23:26:44.544144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 565/1160] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:44 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:44.546729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ada85959-168a-4663-b02e-1944044217f8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:44.547239 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ada85959-168a-4663-b02e-1944044217f8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:44.547957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ada85959-168a-4663-b02e-1944044217f8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:44.549799 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ada85959-168a-4663-b02e-1944044217f8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:44.550679 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ada85959-168a-4663-b02e-1944044217f8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:44.551352 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ada85959-168a-4663-b02e-1944044217f8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:44.701515 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ada85959-168a-4663-b02e-1944044217f8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:44.710157 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ada85959-168a-4663-b02e-1944044217f8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.182113 Aug 04 23:26:44.710757 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 596/1161] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:44 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:44.901992 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-593e671b-ff38-4cee-a990-68b7ca97938e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:44.902545 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-593e671b-ff38-4cee-a990-68b7ca97938e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:44.908798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-593e671b-ff38-4cee-a990-68b7ca97938e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:44.909277 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-593e671b-ff38-4cee-a990-68b7ca97938e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:44.909703 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-593e671b-ff38-4cee-a990-68b7ca97938e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:44.910429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-593e671b-ff38-4cee-a990-68b7ca97938e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:44.910884 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-593e671b-ff38-4cee-a990-68b7ca97938e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:44.911303 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-593e671b-ff38-4cee-a990-68b7ca97938e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:45.049511 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-593e671b-ff38-4cee-a990-68b7ca97938e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:45.057765 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-593e671b-ff38-4cee-a990-68b7ca97938e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.159708 Aug 04 23:26:45.058374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 566/1162] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:44 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:45.582534 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-773e90d3-a799-42db-804d-4a0846e90a5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:45.583495 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-773e90d3-a799-42db-804d-4a0846e90a5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:45.594170 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-773e90d3-a799-42db-804d-4a0846e90a5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:45.594795 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-773e90d3-a799-42db-804d-4a0846e90a5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:45.596200 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-773e90d3-a799-42db-804d-4a0846e90a5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:45.597438 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-773e90d3-a799-42db-804d-4a0846e90a5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:45.598206 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-773e90d3-a799-42db-804d-4a0846e90a5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:45.598949 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-773e90d3-a799-42db-804d-4a0846e90a5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:45.734860 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8d400e1c-6bb5-41e6-bd83-eec8b30655d4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:45.735697 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8d400e1c-6bb5-41e6-bd83-eec8b30655d4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:45.747476 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d400e1c-6bb5-41e6-bd83-eec8b30655d4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:45.748161 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d400e1c-6bb5-41e6-bd83-eec8b30655d4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:45.748784 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d400e1c-6bb5-41e6-bd83-eec8b30655d4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:45.749704 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d400e1c-6bb5-41e6-bd83-eec8b30655d4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:45.750516 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d400e1c-6bb5-41e6-bd83-eec8b30655d4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:45.751061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d400e1c-6bb5-41e6-bd83-eec8b30655d4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:45.751355 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-773e90d3-a799-42db-804d-4a0846e90a5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:45.759255 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-773e90d3-a799-42db-804d-4a0846e90a5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.183248 Aug 04 23:26:45.759834 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 597/1163] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:45 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:45.897011 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8d400e1c-6bb5-41e6-bd83-eec8b30655d4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:45.905295 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8d400e1c-6bb5-41e6-bd83-eec8b30655d4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.177299 Aug 04 23:26:45.905869 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 567/1164] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:45 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:46.081119 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-546d676b-f6a4-4655-ac2e-981a3663ef01 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:46.081786 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-546d676b-f6a4-4655-ac2e-981a3663ef01 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:46.088129 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-546d676b-f6a4-4655-ac2e-981a3663ef01 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:46.088543 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-546d676b-f6a4-4655-ac2e-981a3663ef01 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:46.088976 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-546d676b-f6a4-4655-ac2e-981a3663ef01 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:46.089680 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-546d676b-f6a4-4655-ac2e-981a3663ef01 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:46.090130 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-546d676b-f6a4-4655-ac2e-981a3663ef01 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:46.090601 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-546d676b-f6a4-4655-ac2e-981a3663ef01 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:46.093239 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:26:46.235511 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-546d676b-f6a4-4655-ac2e-981a3663ef01 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:46.243428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-546d676b-f6a4-4655-ac2e-981a3663ef01 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.167031 Aug 04 23:26:46.244012 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 598/1165] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:46 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:46.781239 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ecca24bb-303d-4971-b691-67800be3b2e9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:46.781800 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ecca24bb-303d-4971-b691-67800be3b2e9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:46.789210 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ecca24bb-303d-4971-b691-67800be3b2e9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:46.789696 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ecca24bb-303d-4971-b691-67800be3b2e9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:46.790168 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ecca24bb-303d-4971-b691-67800be3b2e9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:46.790909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ecca24bb-303d-4971-b691-67800be3b2e9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:46.791366 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ecca24bb-303d-4971-b691-67800be3b2e9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:46.791793 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ecca24bb-303d-4971-b691-67800be3b2e9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:46.929963 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-13470bf6-b945-48b2-9d25-4ca0d0311a7b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:46.930728 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-13470bf6-b945-48b2-9d25-4ca0d0311a7b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:46.937227 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-13470bf6-b945-48b2-9d25-4ca0d0311a7b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:46.937716 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-13470bf6-b945-48b2-9d25-4ca0d0311a7b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:46.938155 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-13470bf6-b945-48b2-9d25-4ca0d0311a7b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:46.939449 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-13470bf6-b945-48b2-9d25-4ca0d0311a7b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:46.939903 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-13470bf6-b945-48b2-9d25-4ca0d0311a7b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:46.940545 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-13470bf6-b945-48b2-9d25-4ca0d0311a7b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:46.950666 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ecca24bb-303d-4971-b691-67800be3b2e9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:46.959887 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ecca24bb-303d-4971-b691-67800be3b2e9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.182474 Aug 04 23:26:46.960472 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 568/1166] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:46 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:47.093334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-13470bf6-b945-48b2-9d25-4ca0d0311a7b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:47.107931 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-13470bf6-b945-48b2-9d25-4ca0d0311a7b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.182168 Aug 04 23:26:47.108513 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 599/1167] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:46 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:47.264704 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6a02dd85-3fb9-4085-a52a-e81de24af958 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:47.265313 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6a02dd85-3fb9-4085-a52a-e81de24af958 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:47.272449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a02dd85-3fb9-4085-a52a-e81de24af958 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:47.272929 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a02dd85-3fb9-4085-a52a-e81de24af958 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:47.273374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a02dd85-3fb9-4085-a52a-e81de24af958 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:47.274081 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a02dd85-3fb9-4085-a52a-e81de24af958 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:47.274593 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a02dd85-3fb9-4085-a52a-e81de24af958 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:47.275025 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a02dd85-3fb9-4085-a52a-e81de24af958 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:47.431846 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6a02dd85-3fb9-4085-a52a-e81de24af958 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:47.440131 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6a02dd85-3fb9-4085-a52a-e81de24af958 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.179266 Aug 04 23:26:47.440701 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 569/1168] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:47 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:47.982247 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ad4bcb36-232e-40a0-a9be-4d6a865e1409 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:47.982962 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ad4bcb36-232e-40a0-a9be-4d6a865e1409 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:47.990310 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad4bcb36-232e-40a0-a9be-4d6a865e1409 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:47.990821 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad4bcb36-232e-40a0-a9be-4d6a865e1409 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:47.991251 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad4bcb36-232e-40a0-a9be-4d6a865e1409 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:47.991954 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad4bcb36-232e-40a0-a9be-4d6a865e1409 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:47.992416 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad4bcb36-232e-40a0-a9be-4d6a865e1409 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:47.992831 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad4bcb36-232e-40a0-a9be-4d6a865e1409 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:48.130735 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-85b245f1-4eb0-470a-8486-fc0f280406ee tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:48.131631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ad4bcb36-232e-40a0-a9be-4d6a865e1409 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:48.131878 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-85b245f1-4eb0-470a-8486-fc0f280406ee tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:48.143769 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85b245f1-4eb0-470a-8486-fc0f280406ee tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:48.144540 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85b245f1-4eb0-470a-8486-fc0f280406ee tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:48.144706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ad4bcb36-232e-40a0-a9be-4d6a865e1409 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.165661 Aug 04 23:26:48.145262 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85b245f1-4eb0-470a-8486-fc0f280406ee tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:48.146601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85b245f1-4eb0-470a-8486-fc0f280406ee tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:48.147396 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85b245f1-4eb0-470a-8486-fc0f280406ee tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:48.148130 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85b245f1-4eb0-470a-8486-fc0f280406ee tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:48.148386 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 600/1169] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:47 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:48.157403 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:26:48.314885 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-85b245f1-4eb0-470a-8486-fc0f280406ee tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:48.322710 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-85b245f1-4eb0-470a-8486-fc0f280406ee tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.197136 Aug 04 23:26:48.323486 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 570/1170] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:48 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:48.462446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e1abeca1-b738-4450-9018-c940496a5003 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:48.463065 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e1abeca1-b738-4450-9018-c940496a5003 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:48.469316 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1abeca1-b738-4450-9018-c940496a5003 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:48.469805 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1abeca1-b738-4450-9018-c940496a5003 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:48.470868 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1abeca1-b738-4450-9018-c940496a5003 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:48.471679 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1abeca1-b738-4450-9018-c940496a5003 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:48.472136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1abeca1-b738-4450-9018-c940496a5003 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:48.472561 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1abeca1-b738-4450-9018-c940496a5003 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:48.615101 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e1abeca1-b738-4450-9018-c940496a5003 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:48.628295 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e1abeca1-b738-4450-9018-c940496a5003 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.169437 Aug 04 23:26:48.629434 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 601/1171] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:48 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:49.179185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-60c02f3d-5a4c-4caa-b8ec-1a6bdee90189 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:49.179821 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-60c02f3d-5a4c-4caa-b8ec-1a6bdee90189 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:49.186582 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60c02f3d-5a4c-4caa-b8ec-1a6bdee90189 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:49.187069 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60c02f3d-5a4c-4caa-b8ec-1a6bdee90189 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:49.187506 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60c02f3d-5a4c-4caa-b8ec-1a6bdee90189 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:49.188214 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60c02f3d-5a4c-4caa-b8ec-1a6bdee90189 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:49.189285 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60c02f3d-5a4c-4caa-b8ec-1a6bdee90189 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:49.189858 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60c02f3d-5a4c-4caa-b8ec-1a6bdee90189 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:49.343964 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8205d107-044d-4440-84d0-e1d43c0fd5b2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:49.344706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8205d107-044d-4440-84d0-e1d43c0fd5b2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:49.352306 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8205d107-044d-4440-84d0-e1d43c0fd5b2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:49.352473 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-60c02f3d-5a4c-4caa-b8ec-1a6bdee90189 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:49.352794 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8205d107-044d-4440-84d0-e1d43c0fd5b2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:49.353233 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8205d107-044d-4440-84d0-e1d43c0fd5b2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:49.353936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8205d107-044d-4440-84d0-e1d43c0fd5b2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:49.354408 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8205d107-044d-4440-84d0-e1d43c0fd5b2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:49.354837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8205d107-044d-4440-84d0-e1d43c0fd5b2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:49.360159 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-60c02f3d-5a4c-4caa-b8ec-1a6bdee90189 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.184858 Aug 04 23:26:49.361595 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 571/1172] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:49 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:49.522221 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8205d107-044d-4440-84d0-e1d43c0fd5b2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:49.529957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8205d107-044d-4440-84d0-e1d43c0fd5b2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.189794 Aug 04 23:26:49.530570 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 602/1173] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:49 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:49.650552 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f4edbd48-ec16-4b04-bb08-38039941133e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:49.651163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f4edbd48-ec16-4b04-bb08-38039941133e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:49.657464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4edbd48-ec16-4b04-bb08-38039941133e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:49.658124 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4edbd48-ec16-4b04-bb08-38039941133e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:49.658673 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4edbd48-ec16-4b04-bb08-38039941133e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:49.659376 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4edbd48-ec16-4b04-bb08-38039941133e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:49.659823 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4edbd48-ec16-4b04-bb08-38039941133e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:49.660244 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4edbd48-ec16-4b04-bb08-38039941133e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:49.800885 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f4edbd48-ec16-4b04-bb08-38039941133e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:49.808628 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f4edbd48-ec16-4b04-bb08-38039941133e tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.161858 Aug 04 23:26:49.809205 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 572/1174] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:49 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:50.381546 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-bbec3bd2-a8f6-4379-99cf-e04c096fc1ff tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:50.382115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-bbec3bd2-a8f6-4379-99cf-e04c096fc1ff tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:50.389334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bbec3bd2-a8f6-4379-99cf-e04c096fc1ff tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:50.389818 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bbec3bd2-a8f6-4379-99cf-e04c096fc1ff tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:50.390244 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bbec3bd2-a8f6-4379-99cf-e04c096fc1ff tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:50.390986 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bbec3bd2-a8f6-4379-99cf-e04c096fc1ff tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:50.391430 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bbec3bd2-a8f6-4379-99cf-e04c096fc1ff tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:50.392446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bbec3bd2-a8f6-4379-99cf-e04c096fc1ff tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:50.543296 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-bbec3bd2-a8f6-4379-99cf-e04c096fc1ff tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:50.551645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-bbec3bd2-a8f6-4379-99cf-e04c096fc1ff tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.174110 Aug 04 23:26:50.552203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 603/1175] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:50 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:50.560380 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-17176543-61b7-488a-949f-ac0e2194c811 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:50.560996 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-17176543-61b7-488a-949f-ac0e2194c811 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:50.568870 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17176543-61b7-488a-949f-ac0e2194c811 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:50.569372 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17176543-61b7-488a-949f-ac0e2194c811 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:50.569804 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17176543-61b7-488a-949f-ac0e2194c811 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:50.570581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17176543-61b7-488a-949f-ac0e2194c811 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:50.570996 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17176543-61b7-488a-949f-ac0e2194c811 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:50.571415 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17176543-61b7-488a-949f-ac0e2194c811 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:50.721582 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-17176543-61b7-488a-949f-ac0e2194c811 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:50.729839 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-17176543-61b7-488a-949f-ac0e2194c811 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.173313 Aug 04 23:26:50.730448 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 573/1176] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:50 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:50.832926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c8f47a55-c32b-453f-abac-3cef4ef78b06 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:50.833548 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c8f47a55-c32b-453f-abac-3cef4ef78b06 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:50.839747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8f47a55-c32b-453f-abac-3cef4ef78b06 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:50.840235 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8f47a55-c32b-453f-abac-3cef4ef78b06 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:50.840670 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8f47a55-c32b-453f-abac-3cef4ef78b06 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:50.841373 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8f47a55-c32b-453f-abac-3cef4ef78b06 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:50.841826 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8f47a55-c32b-453f-abac-3cef4ef78b06 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:50.842258 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8f47a55-c32b-453f-abac-3cef4ef78b06 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:50.984013 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c8f47a55-c32b-453f-abac-3cef4ef78b06 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:50.992381 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c8f47a55-c32b-453f-abac-3cef4ef78b06 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.164787 Aug 04 23:26:50.992952 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 604/1177] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:50 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:51.573244 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d83a0344-68c6-416b-bfd6-b01eff4864a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:51.573893 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d83a0344-68c6-416b-bfd6-b01eff4864a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:51.581177 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d83a0344-68c6-416b-bfd6-b01eff4864a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:51.581660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d83a0344-68c6-416b-bfd6-b01eff4864a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:51.582094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d83a0344-68c6-416b-bfd6-b01eff4864a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:51.582855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d83a0344-68c6-416b-bfd6-b01eff4864a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:51.583305 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d83a0344-68c6-416b-bfd6-b01eff4864a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:51.583732 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d83a0344-68c6-416b-bfd6-b01eff4864a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:51.725450 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d83a0344-68c6-416b-bfd6-b01eff4864a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:51.733748 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d83a0344-68c6-416b-bfd6-b01eff4864a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.164322 Aug 04 23:26:51.734379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 574/1178] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:51 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:51.752922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2bc83305-1ce6-4b10-a76d-a72709a97e80 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:51.753565 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2bc83305-1ce6-4b10-a76d-a72709a97e80 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:51.760519 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bc83305-1ce6-4b10-a76d-a72709a97e80 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:51.760997 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bc83305-1ce6-4b10-a76d-a72709a97e80 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:51.761429 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bc83305-1ce6-4b10-a76d-a72709a97e80 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:51.762135 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bc83305-1ce6-4b10-a76d-a72709a97e80 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:51.762657 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bc83305-1ce6-4b10-a76d-a72709a97e80 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:51.763080 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bc83305-1ce6-4b10-a76d-a72709a97e80 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:51.912489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2bc83305-1ce6-4b10-a76d-a72709a97e80 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:51.920400 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2bc83305-1ce6-4b10-a76d-a72709a97e80 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.171493 Aug 04 23:26:51.920882 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 605/1179] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:51 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:52.015311 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-89c30ba4-493b-4198-a5ab-96b1fdaf00b2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:52.015925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-89c30ba4-493b-4198-a5ab-96b1fdaf00b2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:52.018099 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=78 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:26:52.024085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-89c30ba4-493b-4198-a5ab-96b1fdaf00b2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:52.024579 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-89c30ba4-493b-4198-a5ab-96b1fdaf00b2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:52.025018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-89c30ba4-493b-4198-a5ab-96b1fdaf00b2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:52.025729 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-89c30ba4-493b-4198-a5ab-96b1fdaf00b2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:52.026188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-89c30ba4-493b-4198-a5ab-96b1fdaf00b2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:52.026677 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-89c30ba4-493b-4198-a5ab-96b1fdaf00b2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:52.175352 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-89c30ba4-493b-4198-a5ab-96b1fdaf00b2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:52.183189 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-89c30ba4-493b-4198-a5ab-96b1fdaf00b2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.172005 Aug 04 23:26:52.183770 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 575/1180] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:52 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:52.756266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e6b61e75-bdfb-46b0-bb77-25f04b1be515 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:52.756900 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e6b61e75-bdfb-46b0-bb77-25f04b1be515 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:52.763368 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6b61e75-bdfb-46b0-bb77-25f04b1be515 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:52.763857 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6b61e75-bdfb-46b0-bb77-25f04b1be515 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:52.764321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6b61e75-bdfb-46b0-bb77-25f04b1be515 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:52.765026 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6b61e75-bdfb-46b0-bb77-25f04b1be515 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:52.765475 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6b61e75-bdfb-46b0-bb77-25f04b1be515 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:52.765895 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6b61e75-bdfb-46b0-bb77-25f04b1be515 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:52.909063 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e6b61e75-bdfb-46b0-bb77-25f04b1be515 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:52.916814 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e6b61e75-bdfb-46b0-bb77-25f04b1be515 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.164501 Aug 04 23:26:52.917392 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 606/1181] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:52 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:52.941966 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-34e841aa-b7fd-4b9f-aebc-27e149f1ecd0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:52.942612 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-34e841aa-b7fd-4b9f-aebc-27e149f1ecd0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:52.949231 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34e841aa-b7fd-4b9f-aebc-27e149f1ecd0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:52.949708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34e841aa-b7fd-4b9f-aebc-27e149f1ecd0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:52.950138 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34e841aa-b7fd-4b9f-aebc-27e149f1ecd0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:52.950863 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34e841aa-b7fd-4b9f-aebc-27e149f1ecd0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:52.951311 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34e841aa-b7fd-4b9f-aebc-27e149f1ecd0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:52.951729 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34e841aa-b7fd-4b9f-aebc-27e149f1ecd0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:53.103041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-34e841aa-b7fd-4b9f-aebc-27e149f1ecd0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:53.115924 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-34e841aa-b7fd-4b9f-aebc-27e149f1ecd0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.178117 Aug 04 23:26:53.116796 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 576/1182] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:52 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:53.210227 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e6d4db5f-5298-4821-9326-40032a11c61b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:53.210867 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e6d4db5f-5298-4821-9326-40032a11c61b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:53.212782 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:26:53.218377 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6d4db5f-5298-4821-9326-40032a11c61b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:53.218863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6d4db5f-5298-4821-9326-40032a11c61b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:53.219292 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6d4db5f-5298-4821-9326-40032a11c61b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:53.220039 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6d4db5f-5298-4821-9326-40032a11c61b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:53.220486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6d4db5f-5298-4821-9326-40032a11c61b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:53.220896 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6d4db5f-5298-4821-9326-40032a11c61b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:53.383552 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e6d4db5f-5298-4821-9326-40032a11c61b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:53.391537 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e6d4db5f-5298-4821-9326-40032a11c61b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.185433 Aug 04 23:26:53.392714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 607/1183] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:53 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:53.938120 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-17b41ada-4c9d-472c-b346-3dc6655c0090 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:53.939308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-17b41ada-4c9d-472c-b346-3dc6655c0090 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:53.946118 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17b41ada-4c9d-472c-b346-3dc6655c0090 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:53.946837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17b41ada-4c9d-472c-b346-3dc6655c0090 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:53.947074 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17b41ada-4c9d-472c-b346-3dc6655c0090 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:53.947784 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17b41ada-4c9d-472c-b346-3dc6655c0090 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:53.948235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17b41ada-4c9d-472c-b346-3dc6655c0090 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:53.948660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17b41ada-4c9d-472c-b346-3dc6655c0090 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:54.112319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-17b41ada-4c9d-472c-b346-3dc6655c0090 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:54.120616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-17b41ada-4c9d-472c-b346-3dc6655c0090 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.186600 Aug 04 23:26:54.121205 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 577/1184] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:53 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:54.147409 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-43dcd8df-d7ab-451a-8e8e-85ffe6b694e8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:54.147971 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-43dcd8df-d7ab-451a-8e8e-85ffe6b694e8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:54.155327 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-43dcd8df-d7ab-451a-8e8e-85ffe6b694e8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:54.155724 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-43dcd8df-d7ab-451a-8e8e-85ffe6b694e8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:54.156158 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-43dcd8df-d7ab-451a-8e8e-85ffe6b694e8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:54.156864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-43dcd8df-d7ab-451a-8e8e-85ffe6b694e8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:54.157433 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-43dcd8df-d7ab-451a-8e8e-85ffe6b694e8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:54.157853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-43dcd8df-d7ab-451a-8e8e-85ffe6b694e8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:54.304913 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-43dcd8df-d7ab-451a-8e8e-85ffe6b694e8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:54.313049 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-43dcd8df-d7ab-451a-8e8e-85ffe6b694e8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.169633 Aug 04 23:26:54.313657 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 608/1185] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:54 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:54.420136 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3b6344f9-ab3e-43e0-86d0-8035dbcfd8c7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:54.420773 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3b6344f9-ab3e-43e0-86d0-8035dbcfd8c7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:54.427607 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b6344f9-ab3e-43e0-86d0-8035dbcfd8c7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:54.428098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b6344f9-ab3e-43e0-86d0-8035dbcfd8c7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:54.428532 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b6344f9-ab3e-43e0-86d0-8035dbcfd8c7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:54.429240 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b6344f9-ab3e-43e0-86d0-8035dbcfd8c7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:54.429694 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b6344f9-ab3e-43e0-86d0-8035dbcfd8c7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:54.430124 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b6344f9-ab3e-43e0-86d0-8035dbcfd8c7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:54.570130 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3b6344f9-ab3e-43e0-86d0-8035dbcfd8c7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:54.578062 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3b6344f9-ab3e-43e0-86d0-8035dbcfd8c7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.161926 Aug 04 23:26:54.578688 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 578/1186] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:54 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:55.145676 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fc2efab0-8135-4a4f-97f1-3c5b01c6d811 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:55.146240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-fc2efab0-8135-4a4f-97f1-3c5b01c6d811 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:55.153441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc2efab0-8135-4a4f-97f1-3c5b01c6d811 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:55.154127 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc2efab0-8135-4a4f-97f1-3c5b01c6d811 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:55.154339 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc2efab0-8135-4a4f-97f1-3c5b01c6d811 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:55.155073 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc2efab0-8135-4a4f-97f1-3c5b01c6d811 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:55.155518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc2efab0-8135-4a4f-97f1-3c5b01c6d811 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:55.155931 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc2efab0-8135-4a4f-97f1-3c5b01c6d811 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:55.299443 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fc2efab0-8135-4a4f-97f1-3c5b01c6d811 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:55.307434 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-fc2efab0-8135-4a4f-97f1-3c5b01c6d811 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.165957 Aug 04 23:26:55.308018 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 609/1187] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:55 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:55.333775 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e09405a1-f90c-4cc0-9df6-c32498520536 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:55.334414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e09405a1-f90c-4cc0-9df6-c32498520536 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:55.341038 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e09405a1-f90c-4cc0-9df6-c32498520536 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:55.341517 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e09405a1-f90c-4cc0-9df6-c32498520536 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:55.341947 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e09405a1-f90c-4cc0-9df6-c32498520536 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:55.342679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e09405a1-f90c-4cc0-9df6-c32498520536 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:55.343123 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e09405a1-f90c-4cc0-9df6-c32498520536 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:55.343537 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e09405a1-f90c-4cc0-9df6-c32498520536 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:55.485669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e09405a1-f90c-4cc0-9df6-c32498520536 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:55.494241 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e09405a1-f90c-4cc0-9df6-c32498520536 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.164923 Aug 04 23:26:55.494859 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 579/1188] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:55 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:55.600375 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fc2de54a-888b-4185-ab3a-81721d224f91 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:55.600989 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-fc2de54a-888b-4185-ab3a-81721d224f91 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:55.607348 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc2de54a-888b-4185-ab3a-81721d224f91 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:55.607838 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc2de54a-888b-4185-ab3a-81721d224f91 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:55.608278 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc2de54a-888b-4185-ab3a-81721d224f91 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:55.609000 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc2de54a-888b-4185-ab3a-81721d224f91 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:55.609454 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc2de54a-888b-4185-ab3a-81721d224f91 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:55.609880 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc2de54a-888b-4185-ab3a-81721d224f91 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:55.753206 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fc2de54a-888b-4185-ab3a-81721d224f91 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:55.761384 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-fc2de54a-888b-4185-ab3a-81721d224f91 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.164830 Aug 04 23:26:55.761973 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 610/1189] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:55 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:56.330761 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a2bef904-8ec6-4627-ae79-58eecbeed3fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:56.331548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a2bef904-8ec6-4627-ae79-58eecbeed3fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:56.339398 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a2bef904-8ec6-4627-ae79-58eecbeed3fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:56.340061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a2bef904-8ec6-4627-ae79-58eecbeed3fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:56.340554 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a2bef904-8ec6-4627-ae79-58eecbeed3fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:56.341534 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a2bef904-8ec6-4627-ae79-58eecbeed3fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:56.341997 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a2bef904-8ec6-4627-ae79-58eecbeed3fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:56.342452 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a2bef904-8ec6-4627-ae79-58eecbeed3fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:56.491877 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a2bef904-8ec6-4627-ae79-58eecbeed3fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:56.499880 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a2bef904-8ec6-4627-ae79-58eecbeed3fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.174105 Aug 04 23:26:56.500464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 580/1190] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:56 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:56.514905 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a5dd935f-114f-4324-9484-e47f37be0c5b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:56.515517 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a5dd935f-114f-4324-9484-e47f37be0c5b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:56.522928 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5dd935f-114f-4324-9484-e47f37be0c5b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:56.523412 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5dd935f-114f-4324-9484-e47f37be0c5b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:56.523846 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5dd935f-114f-4324-9484-e47f37be0c5b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:56.524552 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5dd935f-114f-4324-9484-e47f37be0c5b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:56.525001 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5dd935f-114f-4324-9484-e47f37be0c5b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:56.525419 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5dd935f-114f-4324-9484-e47f37be0c5b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:56.670449 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a5dd935f-114f-4324-9484-e47f37be0c5b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:56.678728 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a5dd935f-114f-4324-9484-e47f37be0c5b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.167623 Aug 04 23:26:56.679302 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 611/1191] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:56 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:56.784718 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-15ae6a7c-dcb4-4d99-95ca-4ab1bf3e888d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:56.785335 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-15ae6a7c-dcb4-4d99-95ca-4ab1bf3e888d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:56.791534 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-15ae6a7c-dcb4-4d99-95ca-4ab1bf3e888d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:56.792019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-15ae6a7c-dcb4-4d99-95ca-4ab1bf3e888d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:56.792445 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-15ae6a7c-dcb4-4d99-95ca-4ab1bf3e888d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:56.793151 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-15ae6a7c-dcb4-4d99-95ca-4ab1bf3e888d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:56.793603 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-15ae6a7c-dcb4-4d99-95ca-4ab1bf3e888d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:56.794041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-15ae6a7c-dcb4-4d99-95ca-4ab1bf3e888d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:56.949205 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-15ae6a7c-dcb4-4d99-95ca-4ab1bf3e888d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:56.957490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-15ae6a7c-dcb4-4d99-95ca-4ab1bf3e888d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.177921 Aug 04 23:26:56.958064 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 581/1192] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:56 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:57.522604 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f0a03599-2686-412f-a622-6b737aa22204 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:57.523197 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f0a03599-2686-412f-a622-6b737aa22204 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:57.529583 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f0a03599-2686-412f-a622-6b737aa22204 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:57.530055 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f0a03599-2686-412f-a622-6b737aa22204 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:57.530506 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f0a03599-2686-412f-a622-6b737aa22204 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:57.531204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f0a03599-2686-412f-a622-6b737aa22204 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:57.531647 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f0a03599-2686-412f-a622-6b737aa22204 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:57.532565 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f0a03599-2686-412f-a622-6b737aa22204 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:57.675985 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f0a03599-2686-412f-a622-6b737aa22204 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:57.683703 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f0a03599-2686-412f-a622-6b737aa22204 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.165180 Aug 04 23:26:57.684513 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 612/1193] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:57 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:57.701128 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e6ef4e69-0282-4976-8f2a-3aa9b0adfdce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:57.701754 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e6ef4e69-0282-4976-8f2a-3aa9b0adfdce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:57.709219 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6ef4e69-0282-4976-8f2a-3aa9b0adfdce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:57.709738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6ef4e69-0282-4976-8f2a-3aa9b0adfdce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:57.710178 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6ef4e69-0282-4976-8f2a-3aa9b0adfdce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:57.710917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6ef4e69-0282-4976-8f2a-3aa9b0adfdce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:57.711368 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6ef4e69-0282-4976-8f2a-3aa9b0adfdce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:57.711792 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6ef4e69-0282-4976-8f2a-3aa9b0adfdce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:57.856462 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e6ef4e69-0282-4976-8f2a-3aa9b0adfdce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:57.865259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e6ef4e69-0282-4976-8f2a-3aa9b0adfdce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.167965 Aug 04 23:26:57.865842 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 582/1194] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:57 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:57.979965 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3c8273fd-43f9-4998-bdc9-af05b18160f4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:57.980580 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3c8273fd-43f9-4998-bdc9-af05b18160f4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:57.988132 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3c8273fd-43f9-4998-bdc9-af05b18160f4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:57.988681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3c8273fd-43f9-4998-bdc9-af05b18160f4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:57.989163 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3c8273fd-43f9-4998-bdc9-af05b18160f4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:57.989921 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3c8273fd-43f9-4998-bdc9-af05b18160f4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:57.990457 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3c8273fd-43f9-4998-bdc9-af05b18160f4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:57.990915 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3c8273fd-43f9-4998-bdc9-af05b18160f4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:58.163200 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3c8273fd-43f9-4998-bdc9-af05b18160f4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:58.171227 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3c8273fd-43f9-4998-bdc9-af05b18160f4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.195194 Aug 04 23:26:58.171801 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 613/1195] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:57 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:58.707802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-311d3b91-9fa4-4d21-a5b1-d75339db7f5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:58.708421 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-311d3b91-9fa4-4d21-a5b1-d75339db7f5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:58.715374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-311d3b91-9fa4-4d21-a5b1-d75339db7f5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:58.715867 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-311d3b91-9fa4-4d21-a5b1-d75339db7f5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:58.716305 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-311d3b91-9fa4-4d21-a5b1-d75339db7f5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:58.717016 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-311d3b91-9fa4-4d21-a5b1-d75339db7f5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:58.717465 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-311d3b91-9fa4-4d21-a5b1-d75339db7f5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:58.717885 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-311d3b91-9fa4-4d21-a5b1-d75339db7f5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:58.867224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-311d3b91-9fa4-4d21-a5b1-d75339db7f5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:58.874846 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-311d3b91-9fa4-4d21-a5b1-d75339db7f5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.171247 Aug 04 23:26:58.875409 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 583/1196] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:58 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:26:58.886113 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-294ff9b8-942f-49df-8ade-8aa984922747 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:58.886791 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-294ff9b8-942f-49df-8ade-8aa984922747 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:58.894113 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-294ff9b8-942f-49df-8ade-8aa984922747 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:58.894629 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-294ff9b8-942f-49df-8ade-8aa984922747 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:58.895060 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-294ff9b8-942f-49df-8ade-8aa984922747 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:58.895765 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-294ff9b8-942f-49df-8ade-8aa984922747 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:58.896217 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-294ff9b8-942f-49df-8ade-8aa984922747 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:58.896645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-294ff9b8-942f-49df-8ade-8aa984922747 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:59.052011 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-294ff9b8-942f-49df-8ade-8aa984922747 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:59.054287 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:26:59.061204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-294ff9b8-942f-49df-8ade-8aa984922747 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.178748 Aug 04 23:26:59.061794 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 614/1197] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:58 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:59.193841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-594db47c-d979-4e53-83f8-5f8f9fbb23e4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:59.194486 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-594db47c-d979-4e53-83f8-5f8f9fbb23e4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:59.200671 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-594db47c-d979-4e53-83f8-5f8f9fbb23e4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:59.201164 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-594db47c-d979-4e53-83f8-5f8f9fbb23e4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:59.201607 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-594db47c-d979-4e53-83f8-5f8f9fbb23e4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:59.202326 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-594db47c-d979-4e53-83f8-5f8f9fbb23e4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:59.202812 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-594db47c-d979-4e53-83f8-5f8f9fbb23e4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:59.203243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-594db47c-d979-4e53-83f8-5f8f9fbb23e4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:59.356772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-594db47c-d979-4e53-83f8-5f8f9fbb23e4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:26:59.365888 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-594db47c-d979-4e53-83f8-5f8f9fbb23e4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.175951 Aug 04 23:26:59.366500 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 584/1198] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:59 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:26:59.897797 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5b69c417-2cd1-47f9-b0c6-011495bd8699 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:26:59.898430 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5b69c417-2cd1-47f9-b0c6-011495bd8699 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:26:59.905938 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b69c417-2cd1-47f9-b0c6-011495bd8699 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:59.906508 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b69c417-2cd1-47f9-b0c6-011495bd8699 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:59.906906 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b69c417-2cd1-47f9-b0c6-011495bd8699 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:26:59.908476 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b69c417-2cd1-47f9-b0c6-011495bd8699 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:26:59.908935 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b69c417-2cd1-47f9-b0c6-011495bd8699 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:26:59.909356 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b69c417-2cd1-47f9-b0c6-011495bd8699 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:00.057656 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5b69c417-2cd1-47f9-b0c6-011495bd8699 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:00.067054 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5b69c417-2cd1-47f9-b0c6-011495bd8699 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.173019 Aug 04 23:27:00.067637 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 615/1199] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:26:59 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:00.083614 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ee9af67d-d17c-4f01-9f9b-f72280839025 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:00.084402 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ee9af67d-d17c-4f01-9f9b-f72280839025 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:00.091168 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee9af67d-d17c-4f01-9f9b-f72280839025 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:00.091560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee9af67d-d17c-4f01-9f9b-f72280839025 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:00.092006 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee9af67d-d17c-4f01-9f9b-f72280839025 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:00.092726 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee9af67d-d17c-4f01-9f9b-f72280839025 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:00.093181 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee9af67d-d17c-4f01-9f9b-f72280839025 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:00.093609 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee9af67d-d17c-4f01-9f9b-f72280839025 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:00.234492 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ee9af67d-d17c-4f01-9f9b-f72280839025 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:00.243717 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ee9af67d-d17c-4f01-9f9b-f72280839025 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.164115 Aug 04 23:27:00.243717 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 585/1200] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:00 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:00.387529 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-23796c00-cc13-459f-9908-47ee6b43b196 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:00.388153 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-23796c00-cc13-459f-9908-47ee6b43b196 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:00.394395 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23796c00-cc13-459f-9908-47ee6b43b196 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:00.394902 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23796c00-cc13-459f-9908-47ee6b43b196 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:00.395348 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23796c00-cc13-459f-9908-47ee6b43b196 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:00.396066 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23796c00-cc13-459f-9908-47ee6b43b196 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:00.396525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23796c00-cc13-459f-9908-47ee6b43b196 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:00.396954 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23796c00-cc13-459f-9908-47ee6b43b196 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:00.559452 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-23796c00-cc13-459f-9908-47ee6b43b196 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:00.569636 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-23796c00-cc13-459f-9908-47ee6b43b196 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.185867 Aug 04 23:27:00.570449 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 616/1201] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:00 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:01.090717 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6585f32b-7726-4e2c-b6e3-decb809df9ac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:01.091276 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6585f32b-7726-4e2c-b6e3-decb809df9ac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:01.098592 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6585f32b-7726-4e2c-b6e3-decb809df9ac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:01.099065 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6585f32b-7726-4e2c-b6e3-decb809df9ac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:01.099491 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6585f32b-7726-4e2c-b6e3-decb809df9ac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:01.100174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6585f32b-7726-4e2c-b6e3-decb809df9ac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:01.100617 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6585f32b-7726-4e2c-b6e3-decb809df9ac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:01.101031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6585f32b-7726-4e2c-b6e3-decb809df9ac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:01.240027 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6585f32b-7726-4e2c-b6e3-decb809df9ac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:01.242262 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:27:01.249174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6585f32b-7726-4e2c-b6e3-decb809df9ac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.162440 Aug 04 23:27:01.249761 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 586/1202] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:01 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:01.262779 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-588686d3-71ef-465c-9222-218447f778b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:01.263391 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-588686d3-71ef-465c-9222-218447f778b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:01.270653 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-588686d3-71ef-465c-9222-218447f778b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:01.271137 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-588686d3-71ef-465c-9222-218447f778b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:01.271581 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-588686d3-71ef-465c-9222-218447f778b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:01.272279 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-588686d3-71ef-465c-9222-218447f778b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:01.272729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-588686d3-71ef-465c-9222-218447f778b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:01.273149 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-588686d3-71ef-465c-9222-218447f778b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:01.417963 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-588686d3-71ef-465c-9222-218447f778b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:01.426467 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-588686d3-71ef-465c-9222-218447f778b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.167613 Aug 04 23:27:01.427046 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 617/1203] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:01 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:01.591635 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-16cbef7d-888f-40ff-a6b4-90848c437cd2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:01.592242 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-16cbef7d-888f-40ff-a6b4-90848c437cd2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:01.598759 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-16cbef7d-888f-40ff-a6b4-90848c437cd2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:01.599261 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-16cbef7d-888f-40ff-a6b4-90848c437cd2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:01.599673 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-16cbef7d-888f-40ff-a6b4-90848c437cd2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:01.600381 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-16cbef7d-888f-40ff-a6b4-90848c437cd2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:01.600827 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-16cbef7d-888f-40ff-a6b4-90848c437cd2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:01.601254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-16cbef7d-888f-40ff-a6b4-90848c437cd2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:01.745548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-16cbef7d-888f-40ff-a6b4-90848c437cd2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:01.754594 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-16cbef7d-888f-40ff-a6b4-90848c437cd2 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.166944 Aug 04 23:27:01.755186 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 587/1204] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:01 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:02.271552 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c433db4f-8b7d-40b3-b362-8097f9919978 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:02.272303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c433db4f-8b7d-40b3-b362-8097f9919978 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:02.279100 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c433db4f-8b7d-40b3-b362-8097f9919978 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:02.279587 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c433db4f-8b7d-40b3-b362-8097f9919978 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:02.280268 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c433db4f-8b7d-40b3-b362-8097f9919978 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:02.280726 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c433db4f-8b7d-40b3-b362-8097f9919978 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:02.281174 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c433db4f-8b7d-40b3-b362-8097f9919978 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:02.281790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c433db4f-8b7d-40b3-b362-8097f9919978 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:02.431485 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c433db4f-8b7d-40b3-b362-8097f9919978 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:02.440419 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c433db4f-8b7d-40b3-b362-8097f9919978 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.172924 Aug 04 23:27:02.442904 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 618/1205] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:02 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:27:02.447837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d870137a-0d0c-4d81-8817-4b5289e8987b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:02.448452 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d870137a-0d0c-4d81-8817-4b5289e8987b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:02.455887 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d870137a-0d0c-4d81-8817-4b5289e8987b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:02.456373 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d870137a-0d0c-4d81-8817-4b5289e8987b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:02.456957 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d870137a-0d0c-4d81-8817-4b5289e8987b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:02.457659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d870137a-0d0c-4d81-8817-4b5289e8987b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:02.458109 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d870137a-0d0c-4d81-8817-4b5289e8987b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:02.458562 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d870137a-0d0c-4d81-8817-4b5289e8987b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:02.597320 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d870137a-0d0c-4d81-8817-4b5289e8987b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:02.605020 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d870137a-0d0c-4d81-8817-4b5289e8987b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.160965 Aug 04 23:27:02.605592 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 588/1206] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:02 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:02.777401 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d62ea1ea-6931-4787-8070-ab40fcee8d2d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:02.777914 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d62ea1ea-6931-4787-8070-ab40fcee8d2d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:02.784361 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d62ea1ea-6931-4787-8070-ab40fcee8d2d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:02.784836 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d62ea1ea-6931-4787-8070-ab40fcee8d2d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:02.785265 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d62ea1ea-6931-4787-8070-ab40fcee8d2d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:02.785941 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d62ea1ea-6931-4787-8070-ab40fcee8d2d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:02.786402 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d62ea1ea-6931-4787-8070-ab40fcee8d2d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:02.786821 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d62ea1ea-6931-4787-8070-ab40fcee8d2d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:02.918858 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d62ea1ea-6931-4787-8070-ab40fcee8d2d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:02.927756 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d62ea1ea-6931-4787-8070-ab40fcee8d2d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.154331 Aug 04 23:27:02.928359 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 619/1207] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:02 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:03.462530 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b94c03c6-b005-4d77-9b40-338e5c877005 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:03.463149 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b94c03c6-b005-4d77-9b40-338e5c877005 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:03.470540 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b94c03c6-b005-4d77-9b40-338e5c877005 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:03.471119 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b94c03c6-b005-4d77-9b40-338e5c877005 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:03.471553 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b94c03c6-b005-4d77-9b40-338e5c877005 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:03.472254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b94c03c6-b005-4d77-9b40-338e5c877005 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:03.472713 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b94c03c6-b005-4d77-9b40-338e5c877005 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:03.473129 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b94c03c6-b005-4d77-9b40-338e5c877005 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:03.613804 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b94c03c6-b005-4d77-9b40-338e5c877005 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:03.621785 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b94c03c6-b005-4d77-9b40-338e5c877005 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.163345 Aug 04 23:27:03.622393 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 589/1208] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:03 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:03.626260 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-33f77171-1d2f-4bfe-8bac-8a06f51b8d03 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:03.627027 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-33f77171-1d2f-4bfe-8bac-8a06f51b8d03 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:03.633792 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33f77171-1d2f-4bfe-8bac-8a06f51b8d03 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:03.634276 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33f77171-1d2f-4bfe-8bac-8a06f51b8d03 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:03.634752 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33f77171-1d2f-4bfe-8bac-8a06f51b8d03 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:03.635482 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33f77171-1d2f-4bfe-8bac-8a06f51b8d03 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:03.635927 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33f77171-1d2f-4bfe-8bac-8a06f51b8d03 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:03.636347 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33f77171-1d2f-4bfe-8bac-8a06f51b8d03 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:03.772707 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-33f77171-1d2f-4bfe-8bac-8a06f51b8d03 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:03.780132 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-33f77171-1d2f-4bfe-8bac-8a06f51b8d03 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.158937 Aug 04 23:27:03.780688 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 620/1209] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:03 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:27:03.950817 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a369830d-5fb4-4316-821a-d12f13266471 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:03.951429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a369830d-5fb4-4316-821a-d12f13266471 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:03.957893 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a369830d-5fb4-4316-821a-d12f13266471 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:03.958396 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a369830d-5fb4-4316-821a-d12f13266471 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:03.958832 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a369830d-5fb4-4316-821a-d12f13266471 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:03.959523 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a369830d-5fb4-4316-821a-d12f13266471 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:03.960005 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a369830d-5fb4-4316-821a-d12f13266471 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:03.960431 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a369830d-5fb4-4316-821a-d12f13266471 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:04.099166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a369830d-5fb4-4316-821a-d12f13266471 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:04.106760 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a369830d-5fb4-4316-821a-d12f13266471 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.160222 Aug 04 23:27:04.107339 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 590/1210] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:03 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:27:04.644282 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a04454b5-47a8-426b-a915-97c22a4b40e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:04.644889 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a04454b5-47a8-426b-a915-97c22a4b40e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:04.651388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a04454b5-47a8-426b-a915-97c22a4b40e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:04.651864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a04454b5-47a8-426b-a915-97c22a4b40e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:04.652292 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a04454b5-47a8-426b-a915-97c22a4b40e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:04.652975 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a04454b5-47a8-426b-a915-97c22a4b40e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:04.653422 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a04454b5-47a8-426b-a915-97c22a4b40e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:04.653839 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a04454b5-47a8-426b-a915-97c22a4b40e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:04.791296 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a04454b5-47a8-426b-a915-97c22a4b40e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:04.799411 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a04454b5-47a8-426b-a915-97c22a4b40e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.158664 Aug 04 23:27:04.799983 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 621/1211] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:04 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:04.801027 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2d8d22ea-a00d-4535-bd68-4fcf5b4637ed tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:04.801647 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2d8d22ea-a00d-4535-bd68-4fcf5b4637ed tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:04.808242 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2d8d22ea-a00d-4535-bd68-4fcf5b4637ed tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:04.808725 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2d8d22ea-a00d-4535-bd68-4fcf5b4637ed tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:04.809162 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2d8d22ea-a00d-4535-bd68-4fcf5b4637ed tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:04.809862 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2d8d22ea-a00d-4535-bd68-4fcf5b4637ed tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:04.810308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2d8d22ea-a00d-4535-bd68-4fcf5b4637ed tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:04.810768 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2d8d22ea-a00d-4535-bd68-4fcf5b4637ed tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:04.943470 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2d8d22ea-a00d-4535-bd68-4fcf5b4637ed tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:04.950915 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2d8d22ea-a00d-4535-bd68-4fcf5b4637ed tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.154422 Aug 04 23:27:04.951477 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 591/1212] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:04 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:27:05.128939 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1eefdd64-dcc2-4b9a-b607-268e963a6321 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:05.129462 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1eefdd64-dcc2-4b9a-b607-268e963a6321 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:05.135691 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1eefdd64-dcc2-4b9a-b607-268e963a6321 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:05.136171 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1eefdd64-dcc2-4b9a-b607-268e963a6321 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:05.136600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1eefdd64-dcc2-4b9a-b607-268e963a6321 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:05.137302 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1eefdd64-dcc2-4b9a-b607-268e963a6321 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:05.137747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1eefdd64-dcc2-4b9a-b607-268e963a6321 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:05.138194 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1eefdd64-dcc2-4b9a-b607-268e963a6321 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:05.279204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1eefdd64-dcc2-4b9a-b607-268e963a6321 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:05.287993 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1eefdd64-dcc2-4b9a-b607-268e963a6321 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.163093 Aug 04 23:27:05.288567 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 622/1213] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:05 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:27:05.821372 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2f14da27-b7c5-4399-8815-69168f919971 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:05.821929 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2f14da27-b7c5-4399-8815-69168f919971 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:05.828562 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f14da27-b7c5-4399-8815-69168f919971 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:05.829036 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f14da27-b7c5-4399-8815-69168f919971 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:05.829729 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f14da27-b7c5-4399-8815-69168f919971 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:05.831618 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f14da27-b7c5-4399-8815-69168f919971 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:05.832078 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f14da27-b7c5-4399-8815-69168f919971 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:05.832498 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f14da27-b7c5-4399-8815-69168f919971 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:05.967012 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2f14da27-b7c5-4399-8815-69168f919971 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:05.973165 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f4e7e24f-f076-4083-820f-14cc19db6d17 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:05.973777 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f4e7e24f-f076-4083-820f-14cc19db6d17 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:05.975104 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2f14da27-b7c5-4399-8815-69168f919971 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.157716 Aug 04 23:27:05.975681 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 592/1214] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:05 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:05.979955 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f4e7e24f-f076-4083-820f-14cc19db6d17 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:05.980429 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f4e7e24f-f076-4083-820f-14cc19db6d17 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:05.980854 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f4e7e24f-f076-4083-820f-14cc19db6d17 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:05.981543 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f4e7e24f-f076-4083-820f-14cc19db6d17 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:05.981988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f4e7e24f-f076-4083-820f-14cc19db6d17 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:05.982417 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f4e7e24f-f076-4083-820f-14cc19db6d17 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:06.117534 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f4e7e24f-f076-4083-820f-14cc19db6d17 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:06.125093 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f4e7e24f-f076-4083-820f-14cc19db6d17 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.156080 Aug 04 23:27:06.125651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 623/1215] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:05 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:27:06.312369 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d1883544-d587-4b3f-b702-829dc7779dd7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:06.312369 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d1883544-d587-4b3f-b702-829dc7779dd7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:06.316822 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1883544-d587-4b3f-b702-829dc7779dd7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:06.317510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1883544-d587-4b3f-b702-829dc7779dd7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:06.318151 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1883544-d587-4b3f-b702-829dc7779dd7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:06.319184 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1883544-d587-4b3f-b702-829dc7779dd7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:06.319862 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1883544-d587-4b3f-b702-829dc7779dd7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:06.320497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1883544-d587-4b3f-b702-829dc7779dd7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:06.459267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d1883544-d587-4b3f-b702-829dc7779dd7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:06.467018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d1883544-d587-4b3f-b702-829dc7779dd7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.161669 Aug 04 23:27:06.467604 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 593/1216] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:06 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:06.996839 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0fa77599-80c0-4843-bd0a-cc9640c0b21b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:06.997479 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0fa77599-80c0-4843-bd0a-cc9640c0b21b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:07.004573 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0fa77599-80c0-4843-bd0a-cc9640c0b21b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:07.005054 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0fa77599-80c0-4843-bd0a-cc9640c0b21b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:07.005490 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0fa77599-80c0-4843-bd0a-cc9640c0b21b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:07.006182 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0fa77599-80c0-4843-bd0a-cc9640c0b21b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:07.006665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0fa77599-80c0-4843-bd0a-cc9640c0b21b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:07.007094 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0fa77599-80c0-4843-bd0a-cc9640c0b21b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:07.139706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0fa77599-80c0-4843-bd0a-cc9640c0b21b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:07.146522 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-18d446c3-1252-42ed-bc60-4aa75bd13e89 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:07.147143 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-18d446c3-1252-42ed-bc60-4aa75bd13e89 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:07.148922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0fa77599-80c0-4843-bd0a-cc9640c0b21b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.155899 Aug 04 23:27:07.149600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 624/1217] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:06 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:27:07.153792 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-18d446c3-1252-42ed-bc60-4aa75bd13e89 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:07.154272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-18d446c3-1252-42ed-bc60-4aa75bd13e89 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:07.155322 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-18d446c3-1252-42ed-bc60-4aa75bd13e89 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:07.155471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-18d446c3-1252-42ed-bc60-4aa75bd13e89 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:07.156299 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-18d446c3-1252-42ed-bc60-4aa75bd13e89 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:07.156299 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-18d446c3-1252-42ed-bc60-4aa75bd13e89 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:07.290994 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-18d446c3-1252-42ed-bc60-4aa75bd13e89 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:07.299983 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-18d446c3-1252-42ed-bc60-4aa75bd13e89 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.157073 Aug 04 23:27:07.300555 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 594/1218] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:07 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:27:07.489687 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-bee43a1f-2cef-42b4-a2e6-5c1e8393687f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:07.490291 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-bee43a1f-2cef-42b4-a2e6-5c1e8393687f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:07.496228 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bee43a1f-2cef-42b4-a2e6-5c1e8393687f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:07.496700 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bee43a1f-2cef-42b4-a2e6-5c1e8393687f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:07.497164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bee43a1f-2cef-42b4-a2e6-5c1e8393687f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:07.497855 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bee43a1f-2cef-42b4-a2e6-5c1e8393687f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:07.498286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bee43a1f-2cef-42b4-a2e6-5c1e8393687f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:07.498731 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bee43a1f-2cef-42b4-a2e6-5c1e8393687f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:07.639152 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-bee43a1f-2cef-42b4-a2e6-5c1e8393687f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:07.647473 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-bee43a1f-2cef-42b4-a2e6-5c1e8393687f tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.162119 Aug 04 23:27:07.648069 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 625/1219] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:07 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:08.171466 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6a119261-2cde-4311-881b-edba00b88637 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:08.172137 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6a119261-2cde-4311-881b-edba00b88637 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:08.179069 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a119261-2cde-4311-881b-edba00b88637 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:08.179551 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a119261-2cde-4311-881b-edba00b88637 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:08.179989 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a119261-2cde-4311-881b-edba00b88637 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:08.180683 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a119261-2cde-4311-881b-edba00b88637 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:08.181132 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a119261-2cde-4311-881b-edba00b88637 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:08.181555 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a119261-2cde-4311-881b-edba00b88637 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:08.321215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8471981f-9a5b-438c-a266-74b627698dbb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:08.321665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8471981f-9a5b-438c-a266-74b627698dbb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:08.325113 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6a119261-2cde-4311-881b-edba00b88637 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:08.328923 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8471981f-9a5b-438c-a266-74b627698dbb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:08.329677 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8471981f-9a5b-438c-a266-74b627698dbb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:08.330697 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8471981f-9a5b-438c-a266-74b627698dbb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:08.332067 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8471981f-9a5b-438c-a266-74b627698dbb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:08.332511 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8471981f-9a5b-438c-a266-74b627698dbb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:08.332934 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8471981f-9a5b-438c-a266-74b627698dbb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:08.334692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6a119261-2cde-4311-881b-edba00b88637 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.166883 Aug 04 23:27:08.335311 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 595/1220] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:08 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:08.473957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8471981f-9a5b-438c-a266-74b627698dbb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:08.481564 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8471981f-9a5b-438c-a266-74b627698dbb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.164732 Aug 04 23:27:08.482147 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 626/1221] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:08 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:27:08.668744 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c72a41df-9dd7-45c4-a2e0-a186d5e872b0 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:08.669389 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c72a41df-9dd7-45c4-a2e0-a186d5e872b0 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:08.676774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c72a41df-9dd7-45c4-a2e0-a186d5e872b0 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:08.677252 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c72a41df-9dd7-45c4-a2e0-a186d5e872b0 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:08.677684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c72a41df-9dd7-45c4-a2e0-a186d5e872b0 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:08.678404 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c72a41df-9dd7-45c4-a2e0-a186d5e872b0 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:08.678854 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c72a41df-9dd7-45c4-a2e0-a186d5e872b0 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:08.679465 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c72a41df-9dd7-45c4-a2e0-a186d5e872b0 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:08.814997 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c72a41df-9dd7-45c4-a2e0-a186d5e872b0 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:08.822632 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c72a41df-9dd7-45c4-a2e0-a186d5e872b0 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.157702 Aug 04 23:27:08.823204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 596/1222] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:08 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:09.357456 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fe358662-1b97-4b8b-99df-a04aa53acc53 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:09.358049 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-fe358662-1b97-4b8b-99df-a04aa53acc53 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:09.367160 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fe358662-1b97-4b8b-99df-a04aa53acc53 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:09.367681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fe358662-1b97-4b8b-99df-a04aa53acc53 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:09.368218 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fe358662-1b97-4b8b-99df-a04aa53acc53 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:09.369022 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fe358662-1b97-4b8b-99df-a04aa53acc53 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:09.369483 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fe358662-1b97-4b8b-99df-a04aa53acc53 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:09.369907 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fe358662-1b97-4b8b-99df-a04aa53acc53 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:09.504351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3f77b3d7-5afb-4004-857f-a4062be6c06b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:09.505332 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3f77b3d7-5afb-4004-857f-a4062be6c06b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:09.509180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fe358662-1b97-4b8b-99df-a04aa53acc53 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:09.512040 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3f77b3d7-5afb-4004-857f-a4062be6c06b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:09.512516 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3f77b3d7-5afb-4004-857f-a4062be6c06b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:09.512943 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3f77b3d7-5afb-4004-857f-a4062be6c06b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:09.513636 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3f77b3d7-5afb-4004-857f-a4062be6c06b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:09.514080 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3f77b3d7-5afb-4004-857f-a4062be6c06b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:09.514575 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3f77b3d7-5afb-4004-857f-a4062be6c06b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:09.523375 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-fe358662-1b97-4b8b-99df-a04aa53acc53 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.169608 Aug 04 23:27:09.524486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 627/1223] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:09 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:09.650929 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3f77b3d7-5afb-4004-857f-a4062be6c06b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:09.659672 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3f77b3d7-5afb-4004-857f-a4062be6c06b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.158241 Aug 04 23:27:09.660249 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 597/1224] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:09 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:27:09.844115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-aa3ca26c-8df2-4348-8385-8ea55ce2780c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:09.844728 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-aa3ca26c-8df2-4348-8385-8ea55ce2780c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:09.852090 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa3ca26c-8df2-4348-8385-8ea55ce2780c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:09.852574 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa3ca26c-8df2-4348-8385-8ea55ce2780c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:09.853010 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa3ca26c-8df2-4348-8385-8ea55ce2780c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:09.853711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa3ca26c-8df2-4348-8385-8ea55ce2780c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:09.854162 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa3ca26c-8df2-4348-8385-8ea55ce2780c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:09.854615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa3ca26c-8df2-4348-8385-8ea55ce2780c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:10.006926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-aa3ca26c-8df2-4348-8385-8ea55ce2780c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:10.016796 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-aa3ca26c-8df2-4348-8385-8ea55ce2780c tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.176501 Aug 04 23:27:10.018003 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 628/1225] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:09 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:10.552512 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4db86c91-9922-424f-8bbf-910a00fab5a1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:10.553300 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4db86c91-9922-424f-8bbf-910a00fab5a1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:10.560018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4db86c91-9922-424f-8bbf-910a00fab5a1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:10.560422 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4db86c91-9922-424f-8bbf-910a00fab5a1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:10.560854 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4db86c91-9922-424f-8bbf-910a00fab5a1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:10.561549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4db86c91-9922-424f-8bbf-910a00fab5a1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:10.561995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4db86c91-9922-424f-8bbf-910a00fab5a1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:10.562448 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4db86c91-9922-424f-8bbf-910a00fab5a1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:10.680538 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b9e888f6-0ce5-4571-bf4b-f0f3f2510e55 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:10.681231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b9e888f6-0ce5-4571-bf4b-f0f3f2510e55 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:10.688365 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b9e888f6-0ce5-4571-bf4b-f0f3f2510e55 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:10.688833 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b9e888f6-0ce5-4571-bf4b-f0f3f2510e55 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:10.690018 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b9e888f6-0ce5-4571-bf4b-f0f3f2510e55 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:10.691268 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b9e888f6-0ce5-4571-bf4b-f0f3f2510e55 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:10.691736 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b9e888f6-0ce5-4571-bf4b-f0f3f2510e55 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:10.692284 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b9e888f6-0ce5-4571-bf4b-f0f3f2510e55 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:10.697763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4db86c91-9922-424f-8bbf-910a00fab5a1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:10.705856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4db86c91-9922-424f-8bbf-910a00fab5a1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.158081 Aug 04 23:27:10.706656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 598/1226] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:10 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:10.860883 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b9e888f6-0ce5-4571-bf4b-f0f3f2510e55 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:10.869209 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b9e888f6-0ce5-4571-bf4b-f0f3f2510e55 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.192522 Aug 04 23:27:10.869778 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 629/1227] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:10 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:27:11.039152 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9c852088-e819-478d-bcaa-2c1db6d2a2d5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:11.039755 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9c852088-e819-478d-bcaa-2c1db6d2a2d5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:11.045940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9c852088-e819-478d-bcaa-2c1db6d2a2d5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:11.046467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9c852088-e819-478d-bcaa-2c1db6d2a2d5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:11.046904 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9c852088-e819-478d-bcaa-2c1db6d2a2d5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:11.047597 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9c852088-e819-478d-bcaa-2c1db6d2a2d5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:11.048043 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9c852088-e819-478d-bcaa-2c1db6d2a2d5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:11.048459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9c852088-e819-478d-bcaa-2c1db6d2a2d5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:11.185253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9c852088-e819-478d-bcaa-2c1db6d2a2d5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:11.194339 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9c852088-e819-478d-bcaa-2c1db6d2a2d5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.158899 Aug 04 23:27:11.194951 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 599/1228] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:11 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:11.727973 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a8cdca55-8628-4172-aca3-2f8aef12882d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:11.728634 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a8cdca55-8628-4172-aca3-2f8aef12882d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:11.735258 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8cdca55-8628-4172-aca3-2f8aef12882d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:11.735745 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8cdca55-8628-4172-aca3-2f8aef12882d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:11.736930 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8cdca55-8628-4172-aca3-2f8aef12882d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:11.737745 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8cdca55-8628-4172-aca3-2f8aef12882d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:11.738198 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8cdca55-8628-4172-aca3-2f8aef12882d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:11.738643 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8cdca55-8628-4172-aca3-2f8aef12882d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:11.873523 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a8cdca55-8628-4172-aca3-2f8aef12882d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:11.881977 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a8cdca55-8628-4172-aca3-2f8aef12882d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.158001 Aug 04 23:27:11.882579 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 630/1229] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:11 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:11.890197 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d141927b-8626-42a3-aaaa-e0f43620a337 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:11.891080 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d141927b-8626-42a3-aaaa-e0f43620a337 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:11.898166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d141927b-8626-42a3-aaaa-e0f43620a337 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:11.898682 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d141927b-8626-42a3-aaaa-e0f43620a337 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:11.899124 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d141927b-8626-42a3-aaaa-e0f43620a337 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:11.899819 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d141927b-8626-42a3-aaaa-e0f43620a337 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:11.900261 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d141927b-8626-42a3-aaaa-e0f43620a337 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:11.900720 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d141927b-8626-42a3-aaaa-e0f43620a337 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:12.038238 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d141927b-8626-42a3-aaaa-e0f43620a337 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:12.045928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d141927b-8626-42a3-aaaa-e0f43620a337 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.159517 Aug 04 23:27:12.046533 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 600/1230] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:11 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:12.222157 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e77e0c54-f6f4-4fc6-9ed7-77b1a3620751 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:12.222790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e77e0c54-f6f4-4fc6-9ed7-77b1a3620751 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:12.228852 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e77e0c54-f6f4-4fc6-9ed7-77b1a3620751 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:12.229325 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e77e0c54-f6f4-4fc6-9ed7-77b1a3620751 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:12.229750 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e77e0c54-f6f4-4fc6-9ed7-77b1a3620751 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:12.230474 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e77e0c54-f6f4-4fc6-9ed7-77b1a3620751 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:12.230920 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e77e0c54-f6f4-4fc6-9ed7-77b1a3620751 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:12.231335 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e77e0c54-f6f4-4fc6-9ed7-77b1a3620751 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:12.247340 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:27:12.372468 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e77e0c54-f6f4-4fc6-9ed7-77b1a3620751 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:12.380327 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e77e0c54-f6f4-4fc6-9ed7-77b1a3620751 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.162270 Aug 04 23:27:12.380908 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 631/1231] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:12 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:12.904032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8f85a807-33a6-4c0f-9ddd-3efffa5fdd0c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:12.904637 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8f85a807-33a6-4c0f-9ddd-3efffa5fdd0c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:12.911841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8f85a807-33a6-4c0f-9ddd-3efffa5fdd0c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:12.912317 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8f85a807-33a6-4c0f-9ddd-3efffa5fdd0c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:12.912750 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8f85a807-33a6-4c0f-9ddd-3efffa5fdd0c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:12.913452 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8f85a807-33a6-4c0f-9ddd-3efffa5fdd0c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:12.913899 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8f85a807-33a6-4c0f-9ddd-3efffa5fdd0c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:12.914318 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8f85a807-33a6-4c0f-9ddd-3efffa5fdd0c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:13.052308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8f85a807-33a6-4c0f-9ddd-3efffa5fdd0c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:13.059944 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8f85a807-33a6-4c0f-9ddd-3efffa5fdd0c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.159834 Aug 04 23:27:13.060512 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 601/1232] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:12 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:13.067902 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-95362e97-6a3c-4b06-8350-3f3d1fc198b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:13.068510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-95362e97-6a3c-4b06-8350-3f3d1fc198b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:13.075301 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95362e97-6a3c-4b06-8350-3f3d1fc198b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:13.075783 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95362e97-6a3c-4b06-8350-3f3d1fc198b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:13.076226 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95362e97-6a3c-4b06-8350-3f3d1fc198b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:13.076936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95362e97-6a3c-4b06-8350-3f3d1fc198b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:13.077382 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95362e97-6a3c-4b06-8350-3f3d1fc198b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:13.077803 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95362e97-6a3c-4b06-8350-3f3d1fc198b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:13.228906 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-95362e97-6a3c-4b06-8350-3f3d1fc198b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:13.237897 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-95362e97-6a3c-4b06-8350-3f3d1fc198b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.173942 Aug 04 23:27:13.238512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 632/1233] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:13 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:27:13.401923 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2207e3cc-2263-428f-87cd-e96ae41dd364 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:13.402474 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2207e3cc-2263-428f-87cd-e96ae41dd364 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:13.409081 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2207e3cc-2263-428f-87cd-e96ae41dd364 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:13.409576 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2207e3cc-2263-428f-87cd-e96ae41dd364 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:13.410009 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2207e3cc-2263-428f-87cd-e96ae41dd364 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:13.410796 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2207e3cc-2263-428f-87cd-e96ae41dd364 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:13.411246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2207e3cc-2263-428f-87cd-e96ae41dd364 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:13.411665 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2207e3cc-2263-428f-87cd-e96ae41dd364 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:13.544178 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2207e3cc-2263-428f-87cd-e96ae41dd364 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:13.551892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2207e3cc-2263-428f-87cd-e96ae41dd364 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.153983 Aug 04 23:27:13.552468 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 602/1234] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:13 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:14.083633 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2f3e1a3a-9d3b-41f6-83a3-54fec6a75e38 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:14.084885 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2f3e1a3a-9d3b-41f6-83a3-54fec6a75e38 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:14.091675 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f3e1a3a-9d3b-41f6-83a3-54fec6a75e38 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:14.091850 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f3e1a3a-9d3b-41f6-83a3-54fec6a75e38 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:14.092294 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f3e1a3a-9d3b-41f6-83a3-54fec6a75e38 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:14.093004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f3e1a3a-9d3b-41f6-83a3-54fec6a75e38 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:14.093650 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f3e1a3a-9d3b-41f6-83a3-54fec6a75e38 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:14.094265 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f3e1a3a-9d3b-41f6-83a3-54fec6a75e38 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:14.247503 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2f3e1a3a-9d3b-41f6-83a3-54fec6a75e38 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:14.257472 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1bd18f01-bf69-409b-ab25-889e4e8c5bcb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:14.258456 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1bd18f01-bf69-409b-ab25-889e4e8c5bcb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:14.259241 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2f3e1a3a-9d3b-41f6-83a3-54fec6a75e38 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.180638 Aug 04 23:27:14.263543 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 633/1235] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:14 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:14.265347 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1bd18f01-bf69-409b-ab25-889e4e8c5bcb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:14.265951 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1bd18f01-bf69-409b-ab25-889e4e8c5bcb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:14.266914 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1bd18f01-bf69-409b-ab25-889e4e8c5bcb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:14.268060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1bd18f01-bf69-409b-ab25-889e4e8c5bcb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:14.268837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1bd18f01-bf69-409b-ab25-889e4e8c5bcb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:14.269372 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1bd18f01-bf69-409b-ab25-889e4e8c5bcb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:14.287722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:27:14.425262 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1bd18f01-bf69-409b-ab25-889e4e8c5bcb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:14.434058 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1bd18f01-bf69-409b-ab25-889e4e8c5bcb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.180482 Aug 04 23:27:14.434763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 603/1236] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:14 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:27:14.572923 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-16b86af6-34fc-485e-8246-6272028df8e9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:14.573530 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-16b86af6-34fc-485e-8246-6272028df8e9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:14.579828 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-16b86af6-34fc-485e-8246-6272028df8e9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:14.580316 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-16b86af6-34fc-485e-8246-6272028df8e9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:14.580750 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-16b86af6-34fc-485e-8246-6272028df8e9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:14.581453 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-16b86af6-34fc-485e-8246-6272028df8e9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:14.581905 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-16b86af6-34fc-485e-8246-6272028df8e9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:14.582344 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-16b86af6-34fc-485e-8246-6272028df8e9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:14.724932 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-16b86af6-34fc-485e-8246-6272028df8e9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:14.734498 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-16b86af6-34fc-485e-8246-6272028df8e9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.165166 Aug 04 23:27:14.735102 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 634/1237] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:14 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:15.285824 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c0c99d4d-b8f8-4b95-8871-4f80ba583276 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:15.286585 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c0c99d4d-b8f8-4b95-8871-4f80ba583276 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:15.293818 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0c99d4d-b8f8-4b95-8871-4f80ba583276 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:15.294405 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0c99d4d-b8f8-4b95-8871-4f80ba583276 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:15.294939 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0c99d4d-b8f8-4b95-8871-4f80ba583276 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:15.295715 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0c99d4d-b8f8-4b95-8871-4f80ba583276 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:15.296323 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0c99d4d-b8f8-4b95-8871-4f80ba583276 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:15.296815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0c99d4d-b8f8-4b95-8871-4f80ba583276 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:15.440649 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c0c99d4d-b8f8-4b95-8871-4f80ba583276 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:15.451063 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c0c99d4d-b8f8-4b95-8871-4f80ba583276 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1578 microversion: 2.1 time: 0.170288 Aug 04 23:27:15.451641 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 604/1238] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:15 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:15.457837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3ca05c43-2f21-4458-803c-0578160ac193 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:15.458553 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3ca05c43-2f21-4458-803c-0578160ac193 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:15.464788 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ca05c43-2f21-4458-803c-0578160ac193 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:15.465269 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ca05c43-2f21-4458-803c-0578160ac193 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:15.465693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ca05c43-2f21-4458-803c-0578160ac193 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:15.466607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ca05c43-2f21-4458-803c-0578160ac193 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:15.467053 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ca05c43-2f21-4458-803c-0578160ac193 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:15.467468 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ca05c43-2f21-4458-803c-0578160ac193 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:15.625272 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3ca05c43-2f21-4458-803c-0578160ac193 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:15.633147 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3ca05c43-2f21-4458-803c-0578160ac193 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.182122 Aug 04 23:27:15.633863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 635/1239] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:15 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:15.756856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-fbddf48a-06b6-4e9f-893b-5c8d182e85da tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:15.758118 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-fbddf48a-06b6-4e9f-893b-5c8d182e85da tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:15.765135 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbddf48a-06b6-4e9f-893b-5c8d182e85da tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:15.765620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbddf48a-06b6-4e9f-893b-5c8d182e85da tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:15.766083 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbddf48a-06b6-4e9f-893b-5c8d182e85da tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:15.766816 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbddf48a-06b6-4e9f-893b-5c8d182e85da tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:15.767960 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbddf48a-06b6-4e9f-893b-5c8d182e85da tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:15.768389 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbddf48a-06b6-4e9f-893b-5c8d182e85da tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:15.865474 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-a4e8d091-5439-4684-bf27-42428cdc926d req-4f05e499-0209-48f5-a67d-dd63ee31bf9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d", "name": "network-vif-deleted", "tag": "17de7e5d-00f0-4cfb-bf74-3a9d56f6471d"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:27:15.877034 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-a4e8d091-5439-4684-bf27-42428cdc926d req-4f05e499-0209-48f5-a67d-dd63ee31bf9a service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:15.878471 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-a4e8d091-5439-4684-bf27-42428cdc926d req-4f05e499-0209-48f5-a67d-dd63ee31bf9a service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:15.879092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-a4e8d091-5439-4684-bf27-42428cdc926d req-4f05e499-0209-48f5-a67d-dd63ee31bf9a service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:15.897231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-a4e8d091-5439-4684-bf27-42428cdc926d req-4f05e499-0209-48f5-a67d-dd63ee31bf9a service nova] Creating event network-vif-deleted:17de7e5d-00f0-4cfb-bf74-3a9d56f6471d for instance 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d on hv-cinder-85221 Aug 04 23:27:15.903029 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-a4e8d091-5439-4684-bf27-42428cdc926d req-4f05e499-0209-48f5-a67d-dd63ee31bf9a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041313 Aug 04 23:27:15.904402 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 636/1240] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:27:15.947406 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-fbddf48a-06b6-4e9f-893b-5c8d182e85da tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:15.955553 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-fbddf48a-06b6-4e9f-893b-5c8d182e85da tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 200 len: 1674 microversion: 2.1 time: 0.202901 Aug 04 23:27:15.956406 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 605/1241] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:15 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 1674 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:16.363173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-bc419ac1-a6f9-4078-a317-66f7d95022fb req-995a5a6c-f039-4da3-abe4-edd9e8ef2f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a0c9ea5-2710-4533-b166-010d46ab0027", "name": "network-vif-plugged", "status": "completed", "tag": "288e902d-3b66-41d9-a3c5-5e1bbfb5e18b"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:27:16.375296 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-bc419ac1-a6f9-4078-a317-66f7d95022fb req-995a5a6c-f039-4da3-abe4-edd9e8ef2f32 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:16.375880 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-bc419ac1-a6f9-4078-a317-66f7d95022fb req-995a5a6c-f039-4da3-abe4-edd9e8ef2f32 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:16.376377 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-bc419ac1-a6f9-4078-a317-66f7d95022fb req-995a5a6c-f039-4da3-abe4-edd9e8ef2f32 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:16.391234 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-bc419ac1-a6f9-4078-a317-66f7d95022fb req-995a5a6c-f039-4da3-abe4-edd9e8ef2f32 service nova] Creating event network-vif-plugged:288e902d-3b66-41d9-a3c5-5e1bbfb5e18b for instance 7a0c9ea5-2710-4533-b166-010d46ab0027 on hv-cinder-85221 Aug 04 23:27:16.398501 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-bc419ac1-a6f9-4078-a317-66f7d95022fb req-995a5a6c-f039-4da3-abe4-edd9e8ef2f32 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042967 Aug 04 23:27:16.399663 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 637/1242] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:27:16.473338 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d3d9941f-b467-4396-b387-26c69c31a8ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:16.474241 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d3d9941f-b467-4396-b387-26c69c31a8ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:16.480811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3d9941f-b467-4396-b387-26c69c31a8ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:16.481642 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3d9941f-b467-4396-b387-26c69c31a8ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:16.482315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3d9941f-b467-4396-b387-26c69c31a8ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:16.483383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3d9941f-b467-4396-b387-26c69c31a8ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:16.484072 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3d9941f-b467-4396-b387-26c69c31a8ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:16.484577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3d9941f-b467-4396-b387-26c69c31a8ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:16.568742 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d3d9941f-b467-4396-b387-26c69c31a8ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:16.576499 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d3d9941f-b467-4396-b387-26c69c31a8ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.107227 Aug 04 23:27:16.577364 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 606/1243] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:16 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:16.656156 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-019e7145-4228-4bab-a65f-9580318d239e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:16.656809 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-019e7145-4228-4bab-a65f-9580318d239e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:16.663766 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-019e7145-4228-4bab-a65f-9580318d239e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:16.664470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-019e7145-4228-4bab-a65f-9580318d239e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:16.665057 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-019e7145-4228-4bab-a65f-9580318d239e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:16.665771 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-019e7145-4228-4bab-a65f-9580318d239e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:16.666229 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-019e7145-4228-4bab-a65f-9580318d239e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:16.666683 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-019e7145-4228-4bab-a65f-9580318d239e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:16.833929 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-019e7145-4228-4bab-a65f-9580318d239e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:16.843112 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-019e7145-4228-4bab-a65f-9580318d239e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.191862 Aug 04 23:27:16.843732 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 638/1244] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:16 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:16.977405 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-64f3ab19-4c77-4036-9869-151a8c3b61c7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:16.978053 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-64f3ab19-4c77-4036-9869-151a8c3b61c7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:16.984105 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64f3ab19-4c77-4036-9869-151a8c3b61c7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:16.984590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64f3ab19-4c77-4036-9869-151a8c3b61c7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:16.985026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64f3ab19-4c77-4036-9869-151a8c3b61c7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:16.985722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64f3ab19-4c77-4036-9869-151a8c3b61c7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:16.986737 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64f3ab19-4c77-4036-9869-151a8c3b61c7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:16.987168 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64f3ab19-4c77-4036-9869-151a8c3b61c7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:17.000960 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-64f3ab19-4c77-4036-9869-151a8c3b61c7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] HTTP exception thrown: Instance 46a7e2be-71c5-4d64-b02a-a8d125d790e2 could not be found. Aug 04 23:27:17.002705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-64f3ab19-4c77-4036-9869-151a8c3b61c7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Request method failure captured: Aug 04 23:27:17.002705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 HTTP/1.1 Aug 04 23:27:17.002705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:27:17.002705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:27:17.002705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:27:17.002705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:27:17.002705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:27:17.002705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:27:17.002705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:27:17.002705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:27:17.002705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FRJZMt_ovgBvylQQkOcY773MPZMsH8E61Dm1eLB6D0DgOOyRBI6G0yizu_QS-puIt--Wzz0jIf7la2DtjZkT40s5ZQw8pt2ehw_CTLUmEDuF9PwY_Sam_5zdViqLq68DjmONE54QtGf94GQ2KGKeOyXIby2fSy9S1J2kzxo2Jyuz1g Aug 04 23:27:17.002705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:27:17.002705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:27:17.002705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:27:17.002705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:27:17.002705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:27:17.002705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:27:17.002705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: c5dd21e824d843aea197d84ef1ab1319 Aug 04 23:27:17.002705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-AttachVolumeTestJSON-2132667042 Aug 04 23:27:17.002705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:27:17.002705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:27:17.004400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c5dd21e824d843aea197d84ef1ab1319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c5dd21e824d843aea197d84ef1ab1319"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c5dd21e824d843aea197d84ef1ab1319"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c5dd21e824d843aea197d84ef1ab1319"}]}] Aug 04 23:27:17.004400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-AttachVolumeTestJSON-2132667042 Aug 04 23:27:17.004400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: c5dd21e824d843aea197d84ef1ab1319 Aug 04 23:27:17.004400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2132667042 Aug 04 23:27:17.004400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-AttachVolumeTestJSON-2132667042-project Aug 04 23:27:17.004400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:27:17.004400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:27:17.004400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: 3a00aba057b548b1bc81e68acffea150 Aug 04 23:27:17.004400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-AttachVolumeTestJSON-2132667042-project Aug 04 23:27:17.004400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:27:17.004400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Instance 46a7e2be-71c5-4d64-b02a-a8d125d790e2 could not be found. Aug 04 23:27:17.004400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': '46a7e2be-71c5-4d64-b02a-a8d125d790e2'} Aug 04 23:27:17.005293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:27:17.005293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:27:17.005293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:27:17.005293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:27:17.005293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:27:17.005293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:27:17.005293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:27:17.005293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:27:17.005293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:27:17.005293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:27:17.005293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46a7e2be-71c5-4d64-b02a-a8d125d790e2 could not be found. Aug 04 23:27:17.005293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:27:17.005293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:27:17.005293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:27:17.005293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:27:17.005293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:27:17.005293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:27:17.005293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:27:17.005293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:27:17.005293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:27:17.006650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:27:17.006650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:27:17.006650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:27:17.006650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:27:17.006650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:27:17.006650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:27:17.006650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:27:17.006650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46a7e2be-71c5-4d64-b02a-a8d125d790e2 could not be found. Aug 04 23:27:17.006650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:27:17.006650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:27:17.006650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:27:17.006650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:27:17.006650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:27:17.006650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:27:17.006650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:27:17.006650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:27:17.006650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46a7e2be-71c5-4d64-b02a-a8d125d790e2 could not be found. Aug 04 23:27:17.006650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:27:17.008780 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-64f3ab19-4c77-4036-9869-151a8c3b61c7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Returning 404 to user: Instance 46a7e2be-71c5-4d64-b02a-a8d125d790e2 could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:27:17.008780 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-64f3ab19-4c77-4036-9869-151a8c3b61c7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 404 len: 111 microversion: 2.1 time: 0.030632 Aug 04 23:27:17.008780 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 607/1245] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:16 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:27:17.014008 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f704ccad-2a16-4e46-a186-d3a597dedec9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '.version_select at 0x7f6d25f63700>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:17.034412 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f704ccad-2a16-4e46-a186-d3a597dedec9 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-718283364" status: 202 len: 0 microversion: 2.1 time: 0.024097 Aug 04 23:27:17.035006 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 639/1246] 10.222.0.33 () {58 vars in 1218 bytes} [Thu Aug 4 23:27:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-718283364 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:27:17.597785 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-dbf2fc0e-8a8b-4e3b-9f86-68abea9559cc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:17.598387 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-dbf2fc0e-8a8b-4e3b-9f86-68abea9559cc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:17.605176 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dbf2fc0e-8a8b-4e3b-9f86-68abea9559cc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:17.605663 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dbf2fc0e-8a8b-4e3b-9f86-68abea9559cc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:17.606095 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dbf2fc0e-8a8b-4e3b-9f86-68abea9559cc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:17.606837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dbf2fc0e-8a8b-4e3b-9f86-68abea9559cc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:17.607298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dbf2fc0e-8a8b-4e3b-9f86-68abea9559cc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:17.607714 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dbf2fc0e-8a8b-4e3b-9f86-68abea9559cc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:17.673450 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-dbf2fc0e-8a8b-4e3b-9f86-68abea9559cc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:17.681559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-dbf2fc0e-8a8b-4e3b-9f86-68abea9559cc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.088065 Aug 04 23:27:17.682145 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 608/1247] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:17 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:17.878236 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9c7d7af7-f750-4d76-93f3-b9dcf6f376fb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:17.878855 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9c7d7af7-f750-4d76-93f3-b9dcf6f376fb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:17.887038 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c7d7af7-f750-4d76-93f3-b9dcf6f376fb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:17.887517 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c7d7af7-f750-4d76-93f3-b9dcf6f376fb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:17.888380 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c7d7af7-f750-4d76-93f3-b9dcf6f376fb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:17.889007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c7d7af7-f750-4d76-93f3-b9dcf6f376fb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:17.889450 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c7d7af7-f750-4d76-93f3-b9dcf6f376fb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:17.889865 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c7d7af7-f750-4d76-93f3-b9dcf6f376fb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:17.937580 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-94821eaf-a6aa-4d02-b62f-06164772a91d req-037220ea-c5f9-4f9d-9434-337d866ac05c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46a7e2be-71c5-4d64-b02a-a8d125d790e2", "name": "network-vif-deleted", "tag": "c464267b-2d09-4900-8144-503866c46cf3"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:27:17.947786 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-94821eaf-a6aa-4d02-b62f-06164772a91d req-037220ea-c5f9-4f9d-9434-337d866ac05c service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:17.948189 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-94821eaf-a6aa-4d02-b62f-06164772a91d req-037220ea-c5f9-4f9d-9434-337d866ac05c service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:17.948611 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-94821eaf-a6aa-4d02-b62f-06164772a91d req-037220ea-c5f9-4f9d-9434-337d866ac05c service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:17.967241 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-94821eaf-a6aa-4d02-b62f-06164772a91d req-037220ea-c5f9-4f9d-9434-337d866ac05c service nova] Creating event network-vif-deleted:c464267b-2d09-4900-8144-503866c46cf3 for instance 46a7e2be-71c5-4d64-b02a-a8d125d790e2 on hv-cinder-85221 Aug 04 23:27:17.973542 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-94821eaf-a6aa-4d02-b62f-06164772a91d req-037220ea-c5f9-4f9d-9434-337d866ac05c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039541 Aug 04 23:27:17.974151 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 609/1248] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:27:17.979250 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1d79c122-0e3c-4333-a039-096501944eb5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Action: 'create', calling method: .version_select at 0x7f6d260405e0>, body: {"keypair": {"name": "tempest-keypair-1056720062", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5gmu8pB1L1STNuov6Tb4FH6ULI1ntvFeBPOQVrfPYa6wQ5P5TikOwL74yfvqrUB5e0OY4TVAGItWod7rCjDSquLczcpa7NZvm2GkIdl3pMlfx6fqwpFHUig/YaigrKIQ=="}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:27:17.995828 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-1d79c122-0e3c-4333-a039-096501944eb5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Getting quotas for project c5dd21e824d843aea197d84ef1ab1319. Resources: {'key_pairs'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:27:18.000108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-1d79c122-0e3c-4333-a039-096501944eb5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Getting quotas for user 3a00aba057b548b1bc81e68acffea150 and project c5dd21e824d843aea197d84ef1ab1319. Resources: {'key_pairs'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:27:18.012694 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1d79c122-0e3c-4333-a039-096501944eb5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [b96003f9-b314-4a23-b8ad-ce66a5546d8b] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 23:27:18.269777 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9c7d7af7-f750-4d76-93f3-b9dcf6f376fb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:18.277412 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9c7d7af7-f750-4d76-93f3-b9dcf6f376fb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1259 microversion: 2.1 time: 0.404144 Aug 04 23:27:18.277979 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 640/1249] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:17 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1259 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:18.703399 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-15e8c571-c95c-4254-97a8-6acf7d9b08ae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:18.704393 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-15e8c571-c95c-4254-97a8-6acf7d9b08ae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:18.712080 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-15e8c571-c95c-4254-97a8-6acf7d9b08ae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:18.712569 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-15e8c571-c95c-4254-97a8-6acf7d9b08ae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:18.713023 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-15e8c571-c95c-4254-97a8-6acf7d9b08ae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:18.713726 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-15e8c571-c95c-4254-97a8-6acf7d9b08ae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:18.714183 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-15e8c571-c95c-4254-97a8-6acf7d9b08ae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:18.714638 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-15e8c571-c95c-4254-97a8-6acf7d9b08ae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:18.781191 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-15e8c571-c95c-4254-97a8-6acf7d9b08ae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:18.789705 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-15e8c571-c95c-4254-97a8-6acf7d9b08ae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.090233 Aug 04 23:27:18.790265 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 641/1250] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:18 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:27:19.020850 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [None req-1d79c122-0e3c-4333-a039-096501944eb5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [b96003f9-b314-4a23-b8ad-ce66a5546d8b] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 34014. Aug 04 23:27:19.035527 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1d79c122-0e3c-4333-a039-096501944eb5 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.060169 Aug 04 23:27:19.036130 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 610/1251] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Aug 4 23:27:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:27:19.299418 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-53a5f251-2599-4d55-aad1-0f6ae7d4f082 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:19.300097 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-53a5f251-2599-4d55-aad1-0f6ae7d4f082 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:19.306952 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-53a5f251-2599-4d55-aad1-0f6ae7d4f082 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:19.307438 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-53a5f251-2599-4d55-aad1-0f6ae7d4f082 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:19.307872 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-53a5f251-2599-4d55-aad1-0f6ae7d4f082 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:19.308580 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-53a5f251-2599-4d55-aad1-0f6ae7d4f082 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:19.309034 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-53a5f251-2599-4d55-aad1-0f6ae7d4f082 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:19.309460 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-53a5f251-2599-4d55-aad1-0f6ae7d4f082 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:19.502127 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-53a5f251-2599-4d55-aad1-0f6ae7d4f082 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:19.510107 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-53a5f251-2599-4d55-aad1-0f6ae7d4f082 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1444 microversion: 2.1 time: 0.216801 Aug 04 23:27:19.510724 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 642/1252] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:19 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1444 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:27:19.531754 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c45f3ae4-e095-4577-b3e0-5f53a155ac26 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:19.532418 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c45f3ae4-e095-4577-b3e0-5f53a155ac26 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:19.539435 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c45f3ae4-e095-4577-b3e0-5f53a155ac26 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:19.539917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c45f3ae4-e095-4577-b3e0-5f53a155ac26 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:19.540349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c45f3ae4-e095-4577-b3e0-5f53a155ac26 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:19.541043 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c45f3ae4-e095-4577-b3e0-5f53a155ac26 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:19.541493 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c45f3ae4-e095-4577-b3e0-5f53a155ac26 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:19.541913 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c45f3ae4-e095-4577-b3e0-5f53a155ac26 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:19.682527 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c45f3ae4-e095-4577-b3e0-5f53a155ac26 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:19.690507 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c45f3ae4-e095-4577-b3e0-5f53a155ac26 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1444 microversion: 2.1 time: 0.162676 Aug 04 23:27:19.691085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 611/1253] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:19 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1444 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:19.811526 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fcda03b5-b207-4939-8c23-2c1aa6df17c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:19.812461 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-fcda03b5-b207-4939-8c23-2c1aa6df17c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:19.822537 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fcda03b5-b207-4939-8c23-2c1aa6df17c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:19.823285 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fcda03b5-b207-4939-8c23-2c1aa6df17c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:19.823892 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fcda03b5-b207-4939-8c23-2c1aa6df17c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:19.824794 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fcda03b5-b207-4939-8c23-2c1aa6df17c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:19.825289 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fcda03b5-b207-4939-8c23-2c1aa6df17c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:19.825893 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fcda03b5-b207-4939-8c23-2c1aa6df17c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:19.951626 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fcda03b5-b207-4939-8c23-2c1aa6df17c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:19.975768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-fcda03b5-b207-4939-8c23-2c1aa6df17c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.166179 Aug 04 23:27:19.982589 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 643/1254] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:19 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:20.405674 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d380a52a-2ce3-4468-ba23-08dfe8824936 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-819020939", "imageRef": "e1e9d70e-b252-44e5-9ecd-bf73cbf00160", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d7f9022-75c8-4e4b-87c1-156284fe0318"}], "security_groups": [{"name": "tempest-securitygroup--473602555"}], "key_name": "tempest-keypair-1056720062", "user_data": "}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:27:20.593714 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.network.neutron [None req-d380a52a-2ce3-4468-ba23-08dfe8824936 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] validate_networks() for [('0d7f9022-75c8-4e4b-87c1-156284fe0318', None, None, None, None, None)] {{(pid=129790) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 23:27:20.995963 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-04323dad-bc60-4410-8259-ef8212e9a688 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:20.996786 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-04323dad-bc60-4410-8259-ef8212e9a688 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:21.009145 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-04323dad-bc60-4410-8259-ef8212e9a688 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:21.009145 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-04323dad-bc60-4410-8259-ef8212e9a688 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:21.009145 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-04323dad-bc60-4410-8259-ef8212e9a688 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:21.009145 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-04323dad-bc60-4410-8259-ef8212e9a688 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:21.009923 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-04323dad-bc60-4410-8259-ef8212e9a688 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:21.009923 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-04323dad-bc60-4410-8259-ef8212e9a688 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:21.097510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-04323dad-bc60-4410-8259-ef8212e9a688 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:21.105338 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-04323dad-bc60-4410-8259-ef8212e9a688 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.113080 Aug 04 23:27:21.106117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 644/1255] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:20 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:27:21.295218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-d380a52a-2ce3-4468-ba23-08dfe8824936 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Flavor limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 23:27:21.295703 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-d380a52a-2ce3-4468-ba23-08dfe8824936 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Image limits 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 23:27:21.296368 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-d380a52a-2ce3-4468-ba23-08dfe8824936 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Flavor pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 23:27:21.296942 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-d380a52a-2ce3-4468-ba23-08dfe8824936 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Image pref 0:0:0 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 23:27:21.297677 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.virt.hardware [None req-d380a52a-2ce3-4468-ba23-08dfe8824936 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129790) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 23:27:21.309335 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d380a52a-2ce3-4468-ba23-08dfe8824936 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:21.310952 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d380a52a-2ce3-4468-ba23-08dfe8824936 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:21.311393 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d380a52a-2ce3-4468-ba23-08dfe8824936 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:21.312495 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d380a52a-2ce3-4468-ba23-08dfe8824936 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:21.313088 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d380a52a-2ce3-4468-ba23-08dfe8824936 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:21.313518 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d380a52a-2ce3-4468-ba23-08dfe8824936 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:21.336052 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-d380a52a-2ce3-4468-ba23-08dfe8824936 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Getting quotas for project c5dd21e824d843aea197d84ef1ab1319. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 23:27:21.340294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.quota [None req-d380a52a-2ce3-4468-ba23-08dfe8824936 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Getting quotas for user 3a00aba057b548b1bc81e68acffea150 and project c5dd21e824d843aea197d84ef1ab1319. Resources: {'ram', 'instances', 'cores'} {{(pid=129790) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 23:27:21.353846 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d380a52a-2ce3-4468-ba23-08dfe8824936 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Going to run 1 instances... {{(pid=129790) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 23:27:21.356163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d380a52a-2ce3-4468-ba23-08dfe8824936 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: e5609e6d-20ca-45b4-8edf-9b0eff540469] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1e9d70e-b252-44e5-9ecd-bf73cbf00160',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129790) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 23:27:21.380002 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:27:21.413666 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d380a52a-2ce3-4468-ba23-08dfe8824936 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.012151 Aug 04 23:27:21.414763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 612/1256] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Aug 4 23:27:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 23:27:21.426704 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1eecece6-5669-4696-ad21-49b25ae6de7a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:21.427572 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1eecece6-5669-4696-ad21-49b25ae6de7a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: e5609e6d-20ca-45b4-8edf-9b0eff540469] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:21.529779 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1eecece6-5669-4696-ad21-49b25ae6de7a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:21.540760 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1eecece6-5669-4696-ad21-49b25ae6de7a tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469" status: 200 len: 1237 microversion: 2.1 time: 0.118350 Aug 04 23:27:21.541408 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 645/1257] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:21 2022] GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469 => generated 1237 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:27:22.013898 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-490f6fc8-c846-463f-ae8d-99e71c54a7b6 req-fb529b40-3a2a-468b-9172-400e5925679c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a0c9ea5-2710-4533-b166-010d46ab0027", "tag": "288e902d-3b66-41d9-a3c5-5e1bbfb5e18b"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:27:22.027554 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-490f6fc8-c846-463f-ae8d-99e71c54a7b6 req-fb529b40-3a2a-468b-9172-400e5925679c service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:22.027554 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-490f6fc8-c846-463f-ae8d-99e71c54a7b6 req-fb529b40-3a2a-468b-9172-400e5925679c service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:22.027554 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-490f6fc8-c846-463f-ae8d-99e71c54a7b6 req-fb529b40-3a2a-468b-9172-400e5925679c service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:22.039537 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-490f6fc8-c846-463f-ae8d-99e71c54a7b6 req-fb529b40-3a2a-468b-9172-400e5925679c service nova] Creating event network-changed:288e902d-3b66-41d9-a3c5-5e1bbfb5e18b for instance 7a0c9ea5-2710-4533-b166-010d46ab0027 on hv-cinder-85221 Aug 04 23:27:22.049997 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-490f6fc8-c846-463f-ae8d-99e71c54a7b6 req-fb529b40-3a2a-468b-9172-400e5925679c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041637 Aug 04 23:27:22.050640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 613/1258] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:27:22.129572 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fb4b376e-36c5-4848-8785-7d126f01c88f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:22.131077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-fb4b376e-36c5-4848-8785-7d126f01c88f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:22.138195 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fb4b376e-36c5-4848-8785-7d126f01c88f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:22.138789 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fb4b376e-36c5-4848-8785-7d126f01c88f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:22.139321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fb4b376e-36c5-4848-8785-7d126f01c88f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:22.140128 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fb4b376e-36c5-4848-8785-7d126f01c88f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:22.140819 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fb4b376e-36c5-4848-8785-7d126f01c88f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:22.141306 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fb4b376e-36c5-4848-8785-7d126f01c88f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:22.215431 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fb4b376e-36c5-4848-8785-7d126f01c88f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:22.225028 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-fb4b376e-36c5-4848-8785-7d126f01c88f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.103051 Aug 04 23:27:22.226095 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 646/1259] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:22 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:22.569892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-168f32b3-9961-4d91-a772-dd3b627608ff tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:22.572271 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-168f32b3-9961-4d91-a772-dd3b627608ff tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: e5609e6d-20ca-45b4-8edf-9b0eff540469] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:22.586073 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-168f32b3-9961-4d91-a772-dd3b627608ff tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:22.587696 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-168f32b3-9961-4d91-a772-dd3b627608ff tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:22.588690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-168f32b3-9961-4d91-a772-dd3b627608ff tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:22.592127 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-168f32b3-9961-4d91-a772-dd3b627608ff tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:22.593330 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-168f32b3-9961-4d91-a772-dd3b627608ff tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:22.594466 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-168f32b3-9961-4d91-a772-dd3b627608ff tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:22.691296 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-168f32b3-9961-4d91-a772-dd3b627608ff tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:22.699477 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-168f32b3-9961-4d91-a772-dd3b627608ff tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469" status: 200 len: 1307 microversion: 2.1 time: 0.138959 Aug 04 23:27:22.700373 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 614/1260] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:22 2022] GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469 => generated 1307 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:23.247846 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e476156a-9126-4efa-b0b9-4c4046c664cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:23.248470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e476156a-9126-4efa-b0b9-4c4046c664cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:23.250644 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:27:23.258730 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e476156a-9126-4efa-b0b9-4c4046c664cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:23.259226 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e476156a-9126-4efa-b0b9-4c4046c664cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:23.259722 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e476156a-9126-4efa-b0b9-4c4046c664cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:23.260450 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e476156a-9126-4efa-b0b9-4c4046c664cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:23.260905 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e476156a-9126-4efa-b0b9-4c4046c664cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:23.261331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e476156a-9126-4efa-b0b9-4c4046c664cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:23.352825 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e476156a-9126-4efa-b0b9-4c4046c664cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:23.363707 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e476156a-9126-4efa-b0b9-4c4046c664cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.119784 Aug 04 23:27:23.378655 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 647/1261] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:23 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:23.723062 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-48673290-e0aa-4c58-adf0-ebb2dab4e2d4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:23.724104 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-48673290-e0aa-4c58-adf0-ebb2dab4e2d4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: e5609e6d-20ca-45b4-8edf-9b0eff540469] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:23.733271 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48673290-e0aa-4c58-adf0-ebb2dab4e2d4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:23.734215 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48673290-e0aa-4c58-adf0-ebb2dab4e2d4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:23.735299 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48673290-e0aa-4c58-adf0-ebb2dab4e2d4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:23.737256 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48673290-e0aa-4c58-adf0-ebb2dab4e2d4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:23.738423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48673290-e0aa-4c58-adf0-ebb2dab4e2d4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:23.739461 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48673290-e0aa-4c58-adf0-ebb2dab4e2d4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:23.922194 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-48673290-e0aa-4c58-adf0-ebb2dab4e2d4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:23.930471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-48673290-e0aa-4c58-adf0-ebb2dab4e2d4 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469" status: 200 len: 1362 microversion: 2.1 time: 0.212635 Aug 04 23:27:23.931047 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 615/1262] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:23 2022] GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:24.312231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-5b1cdbc1-87b0-4341-bcd0-214a53018695 req-9bc59c1d-b4e0-4347-b173-c39858b339b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5609e6d-20ca-45b4-8edf-9b0eff540469", "tag": "9a91d1e1-4dd3-4c52-9e85-b40ec734aa85"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:27:24.344214 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-5b1cdbc1-87b0-4341-bcd0-214a53018695 req-9bc59c1d-b4e0-4347-b173-c39858b339b6 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:24.344704 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-5b1cdbc1-87b0-4341-bcd0-214a53018695 req-9bc59c1d-b4e0-4347-b173-c39858b339b6 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:24.345719 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-5b1cdbc1-87b0-4341-bcd0-214a53018695 req-9bc59c1d-b4e0-4347-b173-c39858b339b6 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:24.370730 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-5b1cdbc1-87b0-4341-bcd0-214a53018695 req-9bc59c1d-b4e0-4347-b173-c39858b339b6 service nova] Creating event network-changed:9a91d1e1-4dd3-4c52-9e85-b40ec734aa85 for instance e5609e6d-20ca-45b4-8edf-9b0eff540469 on hv-cinder-85221 Aug 04 23:27:24.379313 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-5b1cdbc1-87b0-4341-bcd0-214a53018695 req-9bc59c1d-b4e0-4347-b173-c39858b339b6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073913 Aug 04 23:27:24.380421 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 648/1263] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:27:24.392955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8f5a4614-3c8e-4e36-8099-012343669111 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:24.394043 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8f5a4614-3c8e-4e36-8099-012343669111 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:24.404460 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8f5a4614-3c8e-4e36-8099-012343669111 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:24.405234 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8f5a4614-3c8e-4e36-8099-012343669111 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:24.406019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8f5a4614-3c8e-4e36-8099-012343669111 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:24.407205 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8f5a4614-3c8e-4e36-8099-012343669111 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:24.408930 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8f5a4614-3c8e-4e36-8099-012343669111 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:24.409679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8f5a4614-3c8e-4e36-8099-012343669111 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:24.490825 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8f5a4614-3c8e-4e36-8099-012343669111 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:24.502594 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8f5a4614-3c8e-4e36-8099-012343669111 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.116110 Aug 04 23:27:24.503292 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 616/1264] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:24 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:24.953786 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-62b60676-5d2e-4590-8974-7073d7550281 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:24.955487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-62b60676-5d2e-4590-8974-7073d7550281 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: e5609e6d-20ca-45b4-8edf-9b0eff540469] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:24.961913 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62b60676-5d2e-4590-8974-7073d7550281 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:24.962546 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62b60676-5d2e-4590-8974-7073d7550281 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:24.963052 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62b60676-5d2e-4590-8974-7073d7550281 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:24.963859 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62b60676-5d2e-4590-8974-7073d7550281 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:24.964445 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62b60676-5d2e-4590-8974-7073d7550281 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:24.964865 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62b60676-5d2e-4590-8974-7073d7550281 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:25.099321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-62b60676-5d2e-4590-8974-7073d7550281 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:25.107896 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-62b60676-5d2e-4590-8974-7073d7550281 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469" status: 200 len: 1362 microversion: 2.1 time: 0.158151 Aug 04 23:27:25.108126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 649/1265] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:24 2022] GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:25.524763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1dd73eba-17d6-4a1e-add4-5a90c8d3d872 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:25.525406 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1dd73eba-17d6-4a1e-add4-5a90c8d3d872 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:25.533503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1dd73eba-17d6-4a1e-add4-5a90c8d3d872 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:25.534187 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1dd73eba-17d6-4a1e-add4-5a90c8d3d872 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:25.534692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1dd73eba-17d6-4a1e-add4-5a90c8d3d872 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:25.535434 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1dd73eba-17d6-4a1e-add4-5a90c8d3d872 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:25.535964 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1dd73eba-17d6-4a1e-add4-5a90c8d3d872 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:25.536467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1dd73eba-17d6-4a1e-add4-5a90c8d3d872 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:25.603717 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1dd73eba-17d6-4a1e-add4-5a90c8d3d872 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:25.612297 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1dd73eba-17d6-4a1e-add4-5a90c8d3d872 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.091462 Aug 04 23:27:25.612874 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 617/1266] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:25 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:26.129885 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2b63bea8-105b-4692-ad8d-60be77ac61fc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:26.130664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2b63bea8-105b-4692-ad8d-60be77ac61fc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: e5609e6d-20ca-45b4-8edf-9b0eff540469] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:26.137452 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2b63bea8-105b-4692-ad8d-60be77ac61fc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:26.137916 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2b63bea8-105b-4692-ad8d-60be77ac61fc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:26.138399 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2b63bea8-105b-4692-ad8d-60be77ac61fc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:26.139112 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2b63bea8-105b-4692-ad8d-60be77ac61fc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:26.139565 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2b63bea8-105b-4692-ad8d-60be77ac61fc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:26.139995 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2b63bea8-105b-4692-ad8d-60be77ac61fc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:26.278732 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2b63bea8-105b-4692-ad8d-60be77ac61fc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:26.287071 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2b63bea8-105b-4692-ad8d-60be77ac61fc tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469" status: 200 len: 1362 microversion: 2.1 time: 0.162006 Aug 04 23:27:26.287656 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 650/1267] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:26 2022] GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:26.633699 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2c4f2216-28f7-4c60-9305-34ef7f580b60 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:26.634313 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2c4f2216-28f7-4c60-9305-34ef7f580b60 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:26.640870 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c4f2216-28f7-4c60-9305-34ef7f580b60 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:26.641351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c4f2216-28f7-4c60-9305-34ef7f580b60 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:26.642470 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c4f2216-28f7-4c60-9305-34ef7f580b60 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:26.643179 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c4f2216-28f7-4c60-9305-34ef7f580b60 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:26.643632 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c4f2216-28f7-4c60-9305-34ef7f580b60 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:26.644058 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c4f2216-28f7-4c60-9305-34ef7f580b60 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:26.707979 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2c4f2216-28f7-4c60-9305-34ef7f580b60 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:26.715730 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2c4f2216-28f7-4c60-9305-34ef7f580b60 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085890 Aug 04 23:27:26.716286 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 618/1268] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:26 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:27:27.309998 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3972b6df-f1b1-4145-affd-1b7547aee650 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:27.310759 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3972b6df-f1b1-4145-affd-1b7547aee650 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: e5609e6d-20ca-45b4-8edf-9b0eff540469] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:27.318596 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3972b6df-f1b1-4145-affd-1b7547aee650 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:27.319178 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3972b6df-f1b1-4145-affd-1b7547aee650 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:27.319692 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3972b6df-f1b1-4145-affd-1b7547aee650 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:27.320417 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3972b6df-f1b1-4145-affd-1b7547aee650 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:27.320896 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3972b6df-f1b1-4145-affd-1b7547aee650 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:27.321320 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3972b6df-f1b1-4145-affd-1b7547aee650 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:27.457098 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3972b6df-f1b1-4145-affd-1b7547aee650 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:27.464582 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3972b6df-f1b1-4145-affd-1b7547aee650 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469" status: 200 len: 1362 microversion: 2.1 time: 0.160826 Aug 04 23:27:27.465160 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 651/1269] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:27 2022] GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:27.737357 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ba04f06f-b786-43c1-bf4d-4ab6e3a6c6bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:27.737885 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ba04f06f-b786-43c1-bf4d-4ab6e3a6c6bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:27.744377 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba04f06f-b786-43c1-bf4d-4ab6e3a6c6bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:27.744858 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba04f06f-b786-43c1-bf4d-4ab6e3a6c6bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:27.745292 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba04f06f-b786-43c1-bf4d-4ab6e3a6c6bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:27.746007 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba04f06f-b786-43c1-bf4d-4ab6e3a6c6bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:27.746469 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba04f06f-b786-43c1-bf4d-4ab6e3a6c6bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:27.746893 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba04f06f-b786-43c1-bf4d-4ab6e3a6c6bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:27.813964 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ba04f06f-b786-43c1-bf4d-4ab6e3a6c6bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:27.822569 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ba04f06f-b786-43c1-bf4d-4ab6e3a6c6bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089106 Aug 04 23:27:27.823154 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 619/1270] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:27 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:28.485783 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a3d6fcce-27e8-4175-a332-8a20ae2abbea tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:28.486960 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a3d6fcce-27e8-4175-a332-8a20ae2abbea tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: e5609e6d-20ca-45b4-8edf-9b0eff540469] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:28.493361 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3d6fcce-27e8-4175-a332-8a20ae2abbea tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:28.493831 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3d6fcce-27e8-4175-a332-8a20ae2abbea tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:28.494255 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3d6fcce-27e8-4175-a332-8a20ae2abbea tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:28.494972 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3d6fcce-27e8-4175-a332-8a20ae2abbea tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:28.495412 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3d6fcce-27e8-4175-a332-8a20ae2abbea tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:28.495828 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3d6fcce-27e8-4175-a332-8a20ae2abbea tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:28.498480 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:27:28.629233 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a3d6fcce-27e8-4175-a332-8a20ae2abbea tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:28.636848 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a3d6fcce-27e8-4175-a332-8a20ae2abbea tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469" status: 200 len: 1362 microversion: 2.1 time: 0.155389 Aug 04 23:27:28.637428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 652/1271] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:28 2022] GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:28.843641 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1c3a8c6a-681e-4d7d-b790-79a1be3d3e6d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:28.844373 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1c3a8c6a-681e-4d7d-b790-79a1be3d3e6d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:28.851451 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c3a8c6a-681e-4d7d-b790-79a1be3d3e6d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:28.851936 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c3a8c6a-681e-4d7d-b790-79a1be3d3e6d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:28.852373 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c3a8c6a-681e-4d7d-b790-79a1be3d3e6d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:28.853082 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c3a8c6a-681e-4d7d-b790-79a1be3d3e6d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:28.853533 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c3a8c6a-681e-4d7d-b790-79a1be3d3e6d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:28.853960 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c3a8c6a-681e-4d7d-b790-79a1be3d3e6d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:28.917248 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1c3a8c6a-681e-4d7d-b790-79a1be3d3e6d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:28.925421 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1c3a8c6a-681e-4d7d-b790-79a1be3d3e6d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086026 Aug 04 23:27:28.925982 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 620/1272] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:28 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:29.659088 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-aa14e3df-d50f-47a7-a41f-46812c66c582 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:29.659716 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-aa14e3df-d50f-47a7-a41f-46812c66c582 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: e5609e6d-20ca-45b4-8edf-9b0eff540469] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:29.666340 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa14e3df-d50f-47a7-a41f-46812c66c582 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:29.666853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa14e3df-d50f-47a7-a41f-46812c66c582 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:29.667286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa14e3df-d50f-47a7-a41f-46812c66c582 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:29.667994 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa14e3df-d50f-47a7-a41f-46812c66c582 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:29.668444 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa14e3df-d50f-47a7-a41f-46812c66c582 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:29.668868 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa14e3df-d50f-47a7-a41f-46812c66c582 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:29.802299 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-aa14e3df-d50f-47a7-a41f-46812c66c582 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:29.809704 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-aa14e3df-d50f-47a7-a41f-46812c66c582 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469" status: 200 len: 1362 microversion: 2.1 time: 0.155258 Aug 04 23:27:29.810256 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 653/1273] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:29 2022] GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:29.947244 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-83108f91-e1cf-4338-9204-30f774042b92 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:29.947860 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-83108f91-e1cf-4338-9204-30f774042b92 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:29.955341 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-83108f91-e1cf-4338-9204-30f774042b92 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:29.955823 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-83108f91-e1cf-4338-9204-30f774042b92 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:29.956260 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-83108f91-e1cf-4338-9204-30f774042b92 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:29.956960 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-83108f91-e1cf-4338-9204-30f774042b92 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:29.957411 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-83108f91-e1cf-4338-9204-30f774042b92 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:29.957834 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-83108f91-e1cf-4338-9204-30f774042b92 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:30.038824 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-83108f91-e1cf-4338-9204-30f774042b92 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:30.046717 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-83108f91-e1cf-4338-9204-30f774042b92 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.103318 Aug 04 23:27:30.047277 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 621/1274] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:29 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:30.370794 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-b34ebc92-73cb-40b2-ad64-44645da6b10b req-a3f196c4-7295-4d30-a40b-35d72ad674ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5609e6d-20ca-45b4-8edf-9b0eff540469", "name": "network-vif-plugged", "status": "completed", "tag": "9a91d1e1-4dd3-4c52-9e85-b40ec734aa85"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:27:30.383060 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-b34ebc92-73cb-40b2-ad64-44645da6b10b req-a3f196c4-7295-4d30-a40b-35d72ad674ca service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:30.384181 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-b34ebc92-73cb-40b2-ad64-44645da6b10b req-a3f196c4-7295-4d30-a40b-35d72ad674ca service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:30.384776 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-b34ebc92-73cb-40b2-ad64-44645da6b10b req-a3f196c4-7295-4d30-a40b-35d72ad674ca service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:30.397631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-b34ebc92-73cb-40b2-ad64-44645da6b10b req-a3f196c4-7295-4d30-a40b-35d72ad674ca service nova] Creating event network-vif-plugged:9a91d1e1-4dd3-4c52-9e85-b40ec734aa85 for instance e5609e6d-20ca-45b4-8edf-9b0eff540469 on hv-cinder-85221 Aug 04 23:27:30.402777 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-b34ebc92-73cb-40b2-ad64-44645da6b10b req-a3f196c4-7295-4d30-a40b-35d72ad674ca service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035609 Aug 04 23:27:30.403621 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 654/1275] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:27:30.829982 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9cd0138e-79c8-4493-80dc-060d8c28ca37 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:30.830655 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9cd0138e-79c8-4493-80dc-060d8c28ca37 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: e5609e6d-20ca-45b4-8edf-9b0eff540469] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:30.837345 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cd0138e-79c8-4493-80dc-060d8c28ca37 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:30.837803 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cd0138e-79c8-4493-80dc-060d8c28ca37 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:30.838230 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cd0138e-79c8-4493-80dc-060d8c28ca37 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:30.838964 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cd0138e-79c8-4493-80dc-060d8c28ca37 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:30.839421 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cd0138e-79c8-4493-80dc-060d8c28ca37 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:30.839848 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cd0138e-79c8-4493-80dc-060d8c28ca37 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:30.973266 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9cd0138e-79c8-4493-80dc-060d8c28ca37 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:30.980760 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9cd0138e-79c8-4493-80dc-060d8c28ca37 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469" status: 200 len: 1362 microversion: 2.1 time: 0.155071 Aug 04 23:27:30.981323 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 622/1276] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:30 2022] GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:31.069548 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d2a83176-db4e-4601-8af5-59ab7d9755f6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:31.070255 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d2a83176-db4e-4601-8af5-59ab7d9755f6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:31.076982 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d2a83176-db4e-4601-8af5-59ab7d9755f6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:31.077462 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d2a83176-db4e-4601-8af5-59ab7d9755f6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:31.077896 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d2a83176-db4e-4601-8af5-59ab7d9755f6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:31.078895 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d2a83176-db4e-4601-8af5-59ab7d9755f6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:31.080120 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d2a83176-db4e-4601-8af5-59ab7d9755f6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:31.080328 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d2a83176-db4e-4601-8af5-59ab7d9755f6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:31.144753 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d2a83176-db4e-4601-8af5-59ab7d9755f6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:31.152245 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d2a83176-db4e-4601-8af5-59ab7d9755f6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086955 Aug 04 23:27:31.152803 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 655/1277] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:31 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:27:32.003233 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1507fce1-c473-425d-9cb7-035cbd71e027 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:32.003842 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1507fce1-c473-425d-9cb7-035cbd71e027 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: e5609e6d-20ca-45b4-8edf-9b0eff540469] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:32.005669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=2 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:27:32.006336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell0:SELECT=10 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:27:32.013370 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1507fce1-c473-425d-9cb7-035cbd71e027 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:32.013852 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1507fce1-c473-425d-9cb7-035cbd71e027 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:32.014287 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1507fce1-c473-425d-9cb7-035cbd71e027 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:32.015011 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1507fce1-c473-425d-9cb7-035cbd71e027 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:32.015462 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1507fce1-c473-425d-9cb7-035cbd71e027 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:32.015882 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1507fce1-c473-425d-9cb7-035cbd71e027 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:32.149161 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1507fce1-c473-425d-9cb7-035cbd71e027 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:32.151393 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:27:32.158518 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1507fce1-c473-425d-9cb7-035cbd71e027 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469" status: 200 len: 1362 microversion: 2.1 time: 0.159754 Aug 04 23:27:32.159091 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 623/1278] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:31 2022] GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:32.172252 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-46ea4e5f-6e67-4756-936b-ab1875632865 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:32.173438 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-46ea4e5f-6e67-4756-936b-ab1875632865 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:32.175421 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell0:SELECT=2 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:27:32.181072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-46ea4e5f-6e67-4756-936b-ab1875632865 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:32.181554 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-46ea4e5f-6e67-4756-936b-ab1875632865 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:32.181991 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-46ea4e5f-6e67-4756-936b-ab1875632865 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:32.182741 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-46ea4e5f-6e67-4756-936b-ab1875632865 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:32.183193 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-46ea4e5f-6e67-4756-936b-ab1875632865 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:32.183621 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-46ea4e5f-6e67-4756-936b-ab1875632865 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:32.245311 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-46ea4e5f-6e67-4756-936b-ab1875632865 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:32.254210 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-46ea4e5f-6e67-4756-936b-ab1875632865 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085710 Aug 04 23:27:32.254736 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 656/1279] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:32 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:33.179980 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6261afe4-114a-4393-a299-9a992d228350 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:33.180601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6261afe4-114a-4393-a299-9a992d228350 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: e5609e6d-20ca-45b4-8edf-9b0eff540469] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:33.187037 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6261afe4-114a-4393-a299-9a992d228350 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:33.187520 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6261afe4-114a-4393-a299-9a992d228350 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:33.187961 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6261afe4-114a-4393-a299-9a992d228350 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:33.188802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6261afe4-114a-4393-a299-9a992d228350 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:33.189695 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6261afe4-114a-4393-a299-9a992d228350 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:33.190126 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6261afe4-114a-4393-a299-9a992d228350 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:33.275237 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-310ed1c8-6477-4efc-a84e-3ee8b4338653 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:33.275940 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-310ed1c8-6477-4efc-a84e-3ee8b4338653 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:33.283668 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-310ed1c8-6477-4efc-a84e-3ee8b4338653 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:33.284258 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-310ed1c8-6477-4efc-a84e-3ee8b4338653 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:33.284758 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-310ed1c8-6477-4efc-a84e-3ee8b4338653 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:33.285469 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-310ed1c8-6477-4efc-a84e-3ee8b4338653 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:33.285920 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-310ed1c8-6477-4efc-a84e-3ee8b4338653 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:33.286339 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-310ed1c8-6477-4efc-a84e-3ee8b4338653 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:33.568266 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6261afe4-114a-4393-a299-9a992d228350 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:33.575927 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6261afe4-114a-4393-a299-9a992d228350 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469" status: 200 len: 1548 microversion: 2.1 time: 0.399814 Aug 04 23:27:33.576505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 624/1280] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:33 2022] GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469 => generated 1548 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:33.584981 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-310ed1c8-6477-4efc-a84e-3ee8b4338653 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:33.592662 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-310ed1c8-6477-4efc-a84e-3ee8b4338653 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.321318 Aug 04 23:27:33.593222 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 657/1281] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:33 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:27:33.597842 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d00bc9a3-60bd-424a-8a35-5b810fa19716 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:33.598374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d00bc9a3-60bd-424a-8a35-5b810fa19716 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: e5609e6d-20ca-45b4-8edf-9b0eff540469] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:33.604277 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d00bc9a3-60bd-424a-8a35-5b810fa19716 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:33.604746 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d00bc9a3-60bd-424a-8a35-5b810fa19716 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:33.605173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d00bc9a3-60bd-424a-8a35-5b810fa19716 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:33.605856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d00bc9a3-60bd-424a-8a35-5b810fa19716 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:33.606296 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d00bc9a3-60bd-424a-8a35-5b810fa19716 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:33.606752 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d00bc9a3-60bd-424a-8a35-5b810fa19716 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:33.688024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d00bc9a3-60bd-424a-8a35-5b810fa19716 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095109 Aug 04 23:27:33.688757 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 625/1282] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Aug 4 23:27:33 2022] GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:27:34.613800 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b88c40eb-c09f-4601-9dfc-53a957934f16 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:34.614572 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b88c40eb-c09f-4601-9dfc-53a957934f16 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:34.621671 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b88c40eb-c09f-4601-9dfc-53a957934f16 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:34.622163 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b88c40eb-c09f-4601-9dfc-53a957934f16 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:34.622666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b88c40eb-c09f-4601-9dfc-53a957934f16 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:34.623377 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b88c40eb-c09f-4601-9dfc-53a957934f16 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:34.623867 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b88c40eb-c09f-4601-9dfc-53a957934f16 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:34.624291 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b88c40eb-c09f-4601-9dfc-53a957934f16 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:34.645196 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-59458e17-286a-4f6b-a295-3a56f0ebe9f4 req-d02127a5-c3ee-4e81-9ea7-8ae48966ca7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5609e6d-20ca-45b4-8edf-9b0eff540469", "tag": "9a91d1e1-4dd3-4c52-9e85-b40ec734aa85"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:27:34.654938 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-59458e17-286a-4f6b-a295-3a56f0ebe9f4 req-d02127a5-c3ee-4e81-9ea7-8ae48966ca7a service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:34.656221 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-59458e17-286a-4f6b-a295-3a56f0ebe9f4 req-d02127a5-c3ee-4e81-9ea7-8ae48966ca7a service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:34.656221 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-59458e17-286a-4f6b-a295-3a56f0ebe9f4 req-d02127a5-c3ee-4e81-9ea7-8ae48966ca7a service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:34.676257 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-59458e17-286a-4f6b-a295-3a56f0ebe9f4 req-d02127a5-c3ee-4e81-9ea7-8ae48966ca7a service nova] Creating event network-changed:9a91d1e1-4dd3-4c52-9e85-b40ec734aa85 for instance e5609e6d-20ca-45b4-8edf-9b0eff540469 on hv-cinder-85221 Aug 04 23:27:34.682555 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-59458e17-286a-4f6b-a295-3a56f0ebe9f4 req-d02127a5-c3ee-4e81-9ea7-8ae48966ca7a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042839 Aug 04 23:27:34.683696 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 626/1283] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:27:34.699046 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b88c40eb-c09f-4601-9dfc-53a957934f16 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:34.708499 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b88c40eb-c09f-4601-9dfc-53a957934f16 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.099050 Aug 04 23:27:34.709337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 658/1284] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:34 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:35.731714 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a06970b1-48c7-4941-8dca-f417b5a047c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:35.732322 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a06970b1-48c7-4941-8dca-f417b5a047c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:35.739648 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a06970b1-48c7-4941-8dca-f417b5a047c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:35.740110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a06970b1-48c7-4941-8dca-f417b5a047c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:35.740541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a06970b1-48c7-4941-8dca-f417b5a047c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:35.741231 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a06970b1-48c7-4941-8dca-f417b5a047c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:35.741679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a06970b1-48c7-4941-8dca-f417b5a047c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:35.742094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a06970b1-48c7-4941-8dca-f417b5a047c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:35.807170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a06970b1-48c7-4941-8dca-f417b5a047c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:35.815495 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a06970b1-48c7-4941-8dca-f417b5a047c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.088573 Aug 04 23:27:35.816067 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 627/1285] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:35 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:36.837957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1a21da81-32cc-4c57-8b6d-4d33df8b55ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:36.838608 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1a21da81-32cc-4c57-8b6d-4d33df8b55ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:36.845709 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a21da81-32cc-4c57-8b6d-4d33df8b55ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:36.846187 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a21da81-32cc-4c57-8b6d-4d33df8b55ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:36.846666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a21da81-32cc-4c57-8b6d-4d33df8b55ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:36.847364 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a21da81-32cc-4c57-8b6d-4d33df8b55ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:36.847817 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a21da81-32cc-4c57-8b6d-4d33df8b55ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:36.848239 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a21da81-32cc-4c57-8b6d-4d33df8b55ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:36.914514 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1a21da81-32cc-4c57-8b6d-4d33df8b55ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:36.922107 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1a21da81-32cc-4c57-8b6d-4d33df8b55ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.088011 Aug 04 23:27:36.922715 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 659/1286] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:36 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:37.942930 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c142964c-266e-43d7-a974-c054179c706b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:37.943531 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c142964c-266e-43d7-a974-c054179c706b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:37.949963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c142964c-266e-43d7-a974-c054179c706b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:37.950470 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c142964c-266e-43d7-a974-c054179c706b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:37.950906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c142964c-266e-43d7-a974-c054179c706b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:37.951591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c142964c-266e-43d7-a974-c054179c706b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:37.952041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c142964c-266e-43d7-a974-c054179c706b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:37.952465 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c142964c-266e-43d7-a974-c054179c706b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:38.014809 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c142964c-266e-43d7-a974-c054179c706b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:38.022321 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c142964c-266e-43d7-a974-c054179c706b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083218 Aug 04 23:27:38.022903 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 628/1287] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:37 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:39.043655 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c82f273d-aa71-4292-a51f-546e5ec8c785 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:39.044250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c82f273d-aa71-4292-a51f-546e5ec8c785 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:39.050959 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c82f273d-aa71-4292-a51f-546e5ec8c785 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:39.051432 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c82f273d-aa71-4292-a51f-546e5ec8c785 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:39.051857 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c82f273d-aa71-4292-a51f-546e5ec8c785 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:39.052538 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c82f273d-aa71-4292-a51f-546e5ec8c785 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:39.052986 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c82f273d-aa71-4292-a51f-546e5ec8c785 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:39.053397 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c82f273d-aa71-4292-a51f-546e5ec8c785 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:39.117073 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c82f273d-aa71-4292-a51f-546e5ec8c785 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:39.124590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c82f273d-aa71-4292-a51f-546e5ec8c785 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084857 Aug 04 23:27:39.125145 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 660/1288] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:39 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:40.144980 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b5d9a914-f458-454a-a541-dfb3e52c0107 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:40.145549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b5d9a914-f458-454a-a541-dfb3e52c0107 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:40.152004 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5d9a914-f458-454a-a541-dfb3e52c0107 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:40.152488 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5d9a914-f458-454a-a541-dfb3e52c0107 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:40.152925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5d9a914-f458-454a-a541-dfb3e52c0107 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:40.153622 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5d9a914-f458-454a-a541-dfb3e52c0107 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:40.154080 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5d9a914-f458-454a-a541-dfb3e52c0107 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:40.154533 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5d9a914-f458-454a-a541-dfb3e52c0107 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:40.218045 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b5d9a914-f458-454a-a541-dfb3e52c0107 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:40.226791 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b5d9a914-f458-454a-a541-dfb3e52c0107 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085735 Aug 04 23:27:40.227366 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 629/1289] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:40 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:41.248297 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-eddfe25e-f840-4e7e-854e-87456c83dc5d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:41.248909 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-eddfe25e-f840-4e7e-854e-87456c83dc5d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:41.255518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eddfe25e-f840-4e7e-854e-87456c83dc5d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:41.255997 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eddfe25e-f840-4e7e-854e-87456c83dc5d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:41.256432 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eddfe25e-f840-4e7e-854e-87456c83dc5d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:41.257125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eddfe25e-f840-4e7e-854e-87456c83dc5d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:41.257603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eddfe25e-f840-4e7e-854e-87456c83dc5d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:41.258010 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eddfe25e-f840-4e7e-854e-87456c83dc5d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:41.324020 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-eddfe25e-f840-4e7e-854e-87456c83dc5d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:41.336301 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-eddfe25e-f840-4e7e-854e-87456c83dc5d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.091547 Aug 04 23:27:41.337287 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 661/1290] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:41 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:42.361581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3630ea06-ac1f-4bb3-9943-87d1bacf976f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:42.362144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3630ea06-ac1f-4bb3-9943-87d1bacf976f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:42.369050 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3630ea06-ac1f-4bb3-9943-87d1bacf976f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:42.369526 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3630ea06-ac1f-4bb3-9943-87d1bacf976f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:42.369964 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3630ea06-ac1f-4bb3-9943-87d1bacf976f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:42.370689 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3630ea06-ac1f-4bb3-9943-87d1bacf976f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:42.371136 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3630ea06-ac1f-4bb3-9943-87d1bacf976f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:42.371562 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3630ea06-ac1f-4bb3-9943-87d1bacf976f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:42.433280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3630ea06-ac1f-4bb3-9943-87d1bacf976f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:42.441453 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3630ea06-ac1f-4bb3-9943-87d1bacf976f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085221 Aug 04 23:27:42.442034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 630/1291] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:42 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:43.463425 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6885f765-97db-4bc4-8e76-82b00629a77f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:43.464075 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6885f765-97db-4bc4-8e76-82b00629a77f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:43.470819 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6885f765-97db-4bc4-8e76-82b00629a77f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:43.471395 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6885f765-97db-4bc4-8e76-82b00629a77f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:43.471827 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6885f765-97db-4bc4-8e76-82b00629a77f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:43.472531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6885f765-97db-4bc4-8e76-82b00629a77f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:43.472975 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6885f765-97db-4bc4-8e76-82b00629a77f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:43.473395 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6885f765-97db-4bc4-8e76-82b00629a77f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:43.540350 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6885f765-97db-4bc4-8e76-82b00629a77f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:43.548556 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6885f765-97db-4bc4-8e76-82b00629a77f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.088978 Aug 04 23:27:43.549110 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 662/1292] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:43 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:44.569249 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ab31b82d-b7b0-4fb8-b239-caea7326b496 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:44.569838 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ab31b82d-b7b0-4fb8-b239-caea7326b496 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:44.576356 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab31b82d-b7b0-4fb8-b239-caea7326b496 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:44.576840 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab31b82d-b7b0-4fb8-b239-caea7326b496 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:44.577278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab31b82d-b7b0-4fb8-b239-caea7326b496 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:44.578242 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab31b82d-b7b0-4fb8-b239-caea7326b496 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:44.578720 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab31b82d-b7b0-4fb8-b239-caea7326b496 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:44.579751 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab31b82d-b7b0-4fb8-b239-caea7326b496 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:44.640737 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ab31b82d-b7b0-4fb8-b239-caea7326b496 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:44.649620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ab31b82d-b7b0-4fb8-b239-caea7326b496 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084176 Aug 04 23:27:44.650185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 631/1293] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:44 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:45.671700 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7d33e6a4-4237-4b86-a031-52bc44b3441f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:45.672330 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7d33e6a4-4237-4b86-a031-52bc44b3441f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:45.679042 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7d33e6a4-4237-4b86-a031-52bc44b3441f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:45.679577 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7d33e6a4-4237-4b86-a031-52bc44b3441f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:45.680005 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7d33e6a4-4237-4b86-a031-52bc44b3441f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:45.680690 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7d33e6a4-4237-4b86-a031-52bc44b3441f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:45.681164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7d33e6a4-4237-4b86-a031-52bc44b3441f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:45.681579 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7d33e6a4-4237-4b86-a031-52bc44b3441f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:45.747917 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7d33e6a4-4237-4b86-a031-52bc44b3441f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:45.755777 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7d33e6a4-4237-4b86-a031-52bc44b3441f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089469 Aug 04 23:27:45.756263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 663/1294] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:45 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:46.914520 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-90d7717c-1c25-4386-af48-5b2aaaa84f2e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:46.915135 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-90d7717c-1c25-4386-af48-5b2aaaa84f2e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:46.921018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-90d7717c-1c25-4386-af48-5b2aaaa84f2e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:46.921488 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-90d7717c-1c25-4386-af48-5b2aaaa84f2e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:46.921911 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-90d7717c-1c25-4386-af48-5b2aaaa84f2e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:46.922638 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-90d7717c-1c25-4386-af48-5b2aaaa84f2e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:46.923057 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-90d7717c-1c25-4386-af48-5b2aaaa84f2e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:46.923516 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-90d7717c-1c25-4386-af48-5b2aaaa84f2e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:47.037733 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-90d7717c-1c25-4386-af48-5b2aaaa84f2e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:47.045342 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-90d7717c-1c25-4386-af48-5b2aaaa84f2e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.272489 Aug 04 23:27:47.045899 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 632/1295] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:46 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:48.067087 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c38ac7e7-c9c1-4ed7-a323-fedcdb859ba3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:48.067648 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c38ac7e7-c9c1-4ed7-a323-fedcdb859ba3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:48.074012 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c38ac7e7-c9c1-4ed7-a323-fedcdb859ba3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:48.074515 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c38ac7e7-c9c1-4ed7-a323-fedcdb859ba3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:48.074941 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c38ac7e7-c9c1-4ed7-a323-fedcdb859ba3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:48.075627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c38ac7e7-c9c1-4ed7-a323-fedcdb859ba3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:48.076067 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c38ac7e7-c9c1-4ed7-a323-fedcdb859ba3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:48.076482 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c38ac7e7-c9c1-4ed7-a323-fedcdb859ba3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:48.190528 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c38ac7e7-c9c1-4ed7-a323-fedcdb859ba3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:48.198200 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c38ac7e7-c9c1-4ed7-a323-fedcdb859ba3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.135787 Aug 04 23:27:48.198792 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 664/1296] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:48 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:49.219225 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-609679ff-455d-48d5-9793-70f13d44d78e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:49.219882 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-609679ff-455d-48d5-9793-70f13d44d78e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:49.226965 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-609679ff-455d-48d5-9793-70f13d44d78e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:49.227446 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-609679ff-455d-48d5-9793-70f13d44d78e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:49.227880 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-609679ff-455d-48d5-9793-70f13d44d78e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:49.228572 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-609679ff-455d-48d5-9793-70f13d44d78e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:49.229023 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-609679ff-455d-48d5-9793-70f13d44d78e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:49.229441 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-609679ff-455d-48d5-9793-70f13d44d78e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:49.291662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-609679ff-455d-48d5-9793-70f13d44d78e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:49.299733 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-609679ff-455d-48d5-9793-70f13d44d78e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084406 Aug 04 23:27:49.300290 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 633/1297] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:49 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:50.320334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-68cfe218-fb5e-4742-ac69-dac6b34754e3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:50.320951 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-68cfe218-fb5e-4742-ac69-dac6b34754e3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:50.328131 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68cfe218-fb5e-4742-ac69-dac6b34754e3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:50.328606 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68cfe218-fb5e-4742-ac69-dac6b34754e3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:50.329032 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68cfe218-fb5e-4742-ac69-dac6b34754e3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:50.330254 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68cfe218-fb5e-4742-ac69-dac6b34754e3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:50.331041 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68cfe218-fb5e-4742-ac69-dac6b34754e3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:50.331513 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68cfe218-fb5e-4742-ac69-dac6b34754e3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:50.398104 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-68cfe218-fb5e-4742-ac69-dac6b34754e3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:50.405808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-68cfe218-fb5e-4742-ac69-dac6b34754e3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089350 Aug 04 23:27:50.406386 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 665/1298] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:50 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:51.427609 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-da4cb489-c213-4990-a2e9-f827aff86e2b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:51.428206 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-da4cb489-c213-4990-a2e9-f827aff86e2b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:51.434774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-da4cb489-c213-4990-a2e9-f827aff86e2b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:51.435253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-da4cb489-c213-4990-a2e9-f827aff86e2b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:51.435685 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-da4cb489-c213-4990-a2e9-f827aff86e2b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:51.436381 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-da4cb489-c213-4990-a2e9-f827aff86e2b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:51.436828 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-da4cb489-c213-4990-a2e9-f827aff86e2b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:51.437249 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-da4cb489-c213-4990-a2e9-f827aff86e2b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:51.500286 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-da4cb489-c213-4990-a2e9-f827aff86e2b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:51.508609 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-da4cb489-c213-4990-a2e9-f827aff86e2b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085085 Aug 04 23:27:51.509176 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 634/1299] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:51 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:52.530801 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-beaba996-39e1-4e45-883f-4add303bea30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:52.531409 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-beaba996-39e1-4e45-883f-4add303bea30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:52.538098 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-beaba996-39e1-4e45-883f-4add303bea30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:52.538612 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-beaba996-39e1-4e45-883f-4add303bea30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:52.539043 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-beaba996-39e1-4e45-883f-4add303bea30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:52.539728 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-beaba996-39e1-4e45-883f-4add303bea30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:52.540176 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-beaba996-39e1-4e45-883f-4add303bea30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:52.540596 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-beaba996-39e1-4e45-883f-4add303bea30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:52.604582 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-beaba996-39e1-4e45-883f-4add303bea30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:52.613034 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-beaba996-39e1-4e45-883f-4add303bea30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086316 Aug 04 23:27:52.613592 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 666/1300] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:52 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:53.633756 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4c7a2ecb-8784-4758-a13f-8c2918164bb5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:53.634386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4c7a2ecb-8784-4758-a13f-8c2918164bb5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:53.636914 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=45 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:27:53.642997 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c7a2ecb-8784-4758-a13f-8c2918164bb5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:53.643595 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c7a2ecb-8784-4758-a13f-8c2918164bb5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:53.644044 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c7a2ecb-8784-4758-a13f-8c2918164bb5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:53.644745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c7a2ecb-8784-4758-a13f-8c2918164bb5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:53.645202 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c7a2ecb-8784-4758-a13f-8c2918164bb5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:53.645630 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c7a2ecb-8784-4758-a13f-8c2918164bb5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:53.714488 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4c7a2ecb-8784-4758-a13f-8c2918164bb5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:53.722349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4c7a2ecb-8784-4758-a13f-8c2918164bb5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.092412 Aug 04 23:27:53.722939 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 635/1301] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:53 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:54.743009 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6af21808-dbb0-4299-ad76-b89633e1aadd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:54.743613 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6af21808-dbb0-4299-ad76-b89633e1aadd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:54.745974 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=40 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:27:54.751373 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6af21808-dbb0-4299-ad76-b89633e1aadd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:54.752185 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6af21808-dbb0-4299-ad76-b89633e1aadd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:54.752633 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6af21808-dbb0-4299-ad76-b89633e1aadd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:54.753325 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6af21808-dbb0-4299-ad76-b89633e1aadd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:54.753767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6af21808-dbb0-4299-ad76-b89633e1aadd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:54.754184 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6af21808-dbb0-4299-ad76-b89633e1aadd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:54.819984 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6af21808-dbb0-4299-ad76-b89633e1aadd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:54.827505 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6af21808-dbb0-4299-ad76-b89633e1aadd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.088401 Aug 04 23:27:54.828339 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 667/1302] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:54 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:55.848374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-643f590f-acda-40a4-b623-3db7058dcb52 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:55.848989 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-643f590f-acda-40a4-b623-3db7058dcb52 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:55.854986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-643f590f-acda-40a4-b623-3db7058dcb52 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:55.855465 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-643f590f-acda-40a4-b623-3db7058dcb52 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:55.855903 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-643f590f-acda-40a4-b623-3db7058dcb52 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:55.856592 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-643f590f-acda-40a4-b623-3db7058dcb52 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:55.857041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-643f590f-acda-40a4-b623-3db7058dcb52 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:55.857461 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-643f590f-acda-40a4-b623-3db7058dcb52 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:55.920531 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-643f590f-acda-40a4-b623-3db7058dcb52 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:55.928437 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-643f590f-acda-40a4-b623-3db7058dcb52 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084412 Aug 04 23:27:55.928997 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 636/1303] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:55 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:56.949773 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ef65849c-17b4-4ae4-a967-30e62dc1ab20 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:56.950403 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ef65849c-17b4-4ae4-a967-30e62dc1ab20 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:56.957642 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef65849c-17b4-4ae4-a967-30e62dc1ab20 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:56.958118 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef65849c-17b4-4ae4-a967-30e62dc1ab20 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:56.958579 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef65849c-17b4-4ae4-a967-30e62dc1ab20 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:56.959267 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef65849c-17b4-4ae4-a967-30e62dc1ab20 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:56.959714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef65849c-17b4-4ae4-a967-30e62dc1ab20 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:56.960132 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef65849c-17b4-4ae4-a967-30e62dc1ab20 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:57.025491 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ef65849c-17b4-4ae4-a967-30e62dc1ab20 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:57.033205 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ef65849c-17b4-4ae4-a967-30e62dc1ab20 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087245 Aug 04 23:27:57.033769 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 668/1304] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:56 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:58.053338 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6fbfd434-3751-4ba3-a7a7-f7817af288a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:58.053956 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6fbfd434-3751-4ba3-a7a7-f7817af288a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:58.060509 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6fbfd434-3751-4ba3-a7a7-f7817af288a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:58.060996 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6fbfd434-3751-4ba3-a7a7-f7817af288a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:58.061435 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6fbfd434-3751-4ba3-a7a7-f7817af288a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:58.062134 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6fbfd434-3751-4ba3-a7a7-f7817af288a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:58.062615 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6fbfd434-3751-4ba3-a7a7-f7817af288a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:58.063040 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6fbfd434-3751-4ba3-a7a7-f7817af288a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:58.125547 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6fbfd434-3751-4ba3-a7a7-f7817af288a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:58.133715 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6fbfd434-3751-4ba3-a7a7-f7817af288a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084814 Aug 04 23:27:58.134271 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 637/1305] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:58 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:27:59.155269 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1b6a9f63-7273-4a5f-83a0-b1883cae1247 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:27:59.155877 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1b6a9f63-7273-4a5f-83a0-b1883cae1247 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:27:59.163095 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b6a9f63-7273-4a5f-83a0-b1883cae1247 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:59.163574 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b6a9f63-7273-4a5f-83a0-b1883cae1247 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:59.164004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b6a9f63-7273-4a5f-83a0-b1883cae1247 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:59.164694 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b6a9f63-7273-4a5f-83a0-b1883cae1247 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:27:59.165142 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b6a9f63-7273-4a5f-83a0-b1883cae1247 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:27:59.165574 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b6a9f63-7273-4a5f-83a0-b1883cae1247 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:27:59.168140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=98 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:27:59.230778 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1b6a9f63-7273-4a5f-83a0-b1883cae1247 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:27:59.238574 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1b6a9f63-7273-4a5f-83a0-b1883cae1247 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087145 Aug 04 23:27:59.239136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 669/1306] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:27:59 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:00.259245 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b5cee4ca-7db1-42c9-a329-eb495618e9ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:00.259848 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b5cee4ca-7db1-42c9-a329-eb495618e9ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:00.267359 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5cee4ca-7db1-42c9-a329-eb495618e9ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:00.267848 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5cee4ca-7db1-42c9-a329-eb495618e9ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:00.268321 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5cee4ca-7db1-42c9-a329-eb495618e9ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:00.269037 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5cee4ca-7db1-42c9-a329-eb495618e9ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:00.269493 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5cee4ca-7db1-42c9-a329-eb495618e9ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:00.269918 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5cee4ca-7db1-42c9-a329-eb495618e9ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:00.333825 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b5cee4ca-7db1-42c9-a329-eb495618e9ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:00.341609 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b5cee4ca-7db1-42c9-a329-eb495618e9ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086342 Aug 04 23:28:00.342237 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 638/1307] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:00 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:01.363310 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-542c2ca7-2613-4d2c-94b8-89077ee8ad9c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:01.363857 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-542c2ca7-2613-4d2c-94b8-89077ee8ad9c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:01.370254 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-542c2ca7-2613-4d2c-94b8-89077ee8ad9c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:01.370766 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-542c2ca7-2613-4d2c-94b8-89077ee8ad9c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:01.371204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-542c2ca7-2613-4d2c-94b8-89077ee8ad9c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:01.371900 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-542c2ca7-2613-4d2c-94b8-89077ee8ad9c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:01.372354 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-542c2ca7-2613-4d2c-94b8-89077ee8ad9c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:01.372781 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-542c2ca7-2613-4d2c-94b8-89077ee8ad9c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:01.433687 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-542c2ca7-2613-4d2c-94b8-89077ee8ad9c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:01.441520 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-542c2ca7-2613-4d2c-94b8-89077ee8ad9c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.082791 Aug 04 23:28:01.442083 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 670/1308] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:01 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:02.462661 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a32d76db-ba28-4e55-8cce-ed99fb3a46d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:02.463276 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a32d76db-ba28-4e55-8cce-ed99fb3a46d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:02.470512 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a32d76db-ba28-4e55-8cce-ed99fb3a46d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:02.471172 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a32d76db-ba28-4e55-8cce-ed99fb3a46d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:02.471627 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a32d76db-ba28-4e55-8cce-ed99fb3a46d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:02.472320 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a32d76db-ba28-4e55-8cce-ed99fb3a46d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:02.472770 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a32d76db-ba28-4e55-8cce-ed99fb3a46d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:02.473194 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a32d76db-ba28-4e55-8cce-ed99fb3a46d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:02.476206 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=86 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:28:02.541449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a32d76db-ba28-4e55-8cce-ed99fb3a46d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:02.550961 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a32d76db-ba28-4e55-8cce-ed99fb3a46d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.092119 Aug 04 23:28:02.552314 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 639/1309] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:02 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:03.571232 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-32efdc69-123b-445e-9a43-dcd61f0ae147 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:03.571758 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-32efdc69-123b-445e-9a43-dcd61f0ae147 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:03.578470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32efdc69-123b-445e-9a43-dcd61f0ae147 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:03.578948 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32efdc69-123b-445e-9a43-dcd61f0ae147 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:03.580125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32efdc69-123b-445e-9a43-dcd61f0ae147 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:03.581053 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32efdc69-123b-445e-9a43-dcd61f0ae147 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:03.581503 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32efdc69-123b-445e-9a43-dcd61f0ae147 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:03.581922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32efdc69-123b-445e-9a43-dcd61f0ae147 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:03.646644 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-32efdc69-123b-445e-9a43-dcd61f0ae147 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:03.654124 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-32efdc69-123b-445e-9a43-dcd61f0ae147 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086891 Aug 04 23:28:03.654706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 671/1310] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:03 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:04.675851 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7767431f-4951-4add-a60b-7c960a64be89 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:04.676464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7767431f-4951-4add-a60b-7c960a64be89 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:04.683138 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7767431f-4951-4add-a60b-7c960a64be89 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:04.683621 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7767431f-4951-4add-a60b-7c960a64be89 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:04.684063 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7767431f-4951-4add-a60b-7c960a64be89 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:04.684762 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7767431f-4951-4add-a60b-7c960a64be89 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:04.685209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7767431f-4951-4add-a60b-7c960a64be89 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:04.685633 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7767431f-4951-4add-a60b-7c960a64be89 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:04.748593 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7767431f-4951-4add-a60b-7c960a64be89 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:04.756953 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7767431f-4951-4add-a60b-7c960a64be89 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085554 Aug 04 23:28:04.757523 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 640/1311] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:04 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:05.777140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-48ccba63-bf85-4ef9-b904-ce7eade973d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:05.777758 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-48ccba63-bf85-4ef9-b904-ce7eade973d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:05.784477 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-48ccba63-bf85-4ef9-b904-ce7eade973d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:05.784957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-48ccba63-bf85-4ef9-b904-ce7eade973d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:05.785397 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-48ccba63-bf85-4ef9-b904-ce7eade973d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:05.786096 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-48ccba63-bf85-4ef9-b904-ce7eade973d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:05.786588 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-48ccba63-bf85-4ef9-b904-ce7eade973d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:05.787012 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-48ccba63-bf85-4ef9-b904-ce7eade973d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:05.850887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-48ccba63-bf85-4ef9-b904-ce7eade973d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:05.858393 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-48ccba63-bf85-4ef9-b904-ce7eade973d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085078 Aug 04 23:28:05.859027 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 672/1312] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:05 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:06.879279 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6a7d72c4-969c-446c-a632-ec1daaffcdd7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:06.879899 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6a7d72c4-969c-446c-a632-ec1daaffcdd7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:06.886484 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a7d72c4-969c-446c-a632-ec1daaffcdd7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:06.886972 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a7d72c4-969c-446c-a632-ec1daaffcdd7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:06.887410 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a7d72c4-969c-446c-a632-ec1daaffcdd7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:06.888103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a7d72c4-969c-446c-a632-ec1daaffcdd7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:06.888556 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a7d72c4-969c-446c-a632-ec1daaffcdd7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:06.888981 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a7d72c4-969c-446c-a632-ec1daaffcdd7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:06.950338 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6a7d72c4-969c-446c-a632-ec1daaffcdd7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:06.959134 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6a7d72c4-969c-446c-a632-ec1daaffcdd7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083612 Aug 04 23:28:06.959645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 641/1313] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:06 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:07.979483 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-bab66371-7351-4fe0-b10a-7ee0f0069dd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:07.980095 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-bab66371-7351-4fe0-b10a-7ee0f0069dd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:07.987376 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bab66371-7351-4fe0-b10a-7ee0f0069dd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:07.987854 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bab66371-7351-4fe0-b10a-7ee0f0069dd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:07.988289 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bab66371-7351-4fe0-b10a-7ee0f0069dd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:07.988973 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bab66371-7351-4fe0-b10a-7ee0f0069dd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:07.989418 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bab66371-7351-4fe0-b10a-7ee0f0069dd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:07.989864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bab66371-7351-4fe0-b10a-7ee0f0069dd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:08.056157 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-bab66371-7351-4fe0-b10a-7ee0f0069dd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:08.064435 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-bab66371-7351-4fe0-b10a-7ee0f0069dd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.088179 Aug 04 23:28:08.064936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 673/1314] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:07 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:28:09.085389 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-cf8aa15a-1e44-49c0-b8f6-f5ba36991d94 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:09.085934 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-cf8aa15a-1e44-49c0-b8f6-f5ba36991d94 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:09.092614 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf8aa15a-1e44-49c0-b8f6-f5ba36991d94 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:09.093088 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf8aa15a-1e44-49c0-b8f6-f5ba36991d94 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:09.093515 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf8aa15a-1e44-49c0-b8f6-f5ba36991d94 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:09.094202 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf8aa15a-1e44-49c0-b8f6-f5ba36991d94 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:09.094669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf8aa15a-1e44-49c0-b8f6-f5ba36991d94 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:09.095701 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf8aa15a-1e44-49c0-b8f6-f5ba36991d94 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:09.159843 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-cf8aa15a-1e44-49c0-b8f6-f5ba36991d94 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:09.167365 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-cf8aa15a-1e44-49c0-b8f6-f5ba36991d94 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085903 Aug 04 23:28:09.167921 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 642/1315] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:09 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:10.187746 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1760229a-c8cf-4275-8687-e5027174ae09 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:10.188362 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1760229a-c8cf-4275-8687-e5027174ae09 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:10.194832 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1760229a-c8cf-4275-8687-e5027174ae09 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:10.195312 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1760229a-c8cf-4275-8687-e5027174ae09 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:10.195750 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1760229a-c8cf-4275-8687-e5027174ae09 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:10.196440 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1760229a-c8cf-4275-8687-e5027174ae09 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:10.196892 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1760229a-c8cf-4275-8687-e5027174ae09 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:10.197310 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1760229a-c8cf-4275-8687-e5027174ae09 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:10.260145 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1760229a-c8cf-4275-8687-e5027174ae09 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:10.267717 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1760229a-c8cf-4275-8687-e5027174ae09 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083793 Aug 04 23:28:10.268218 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 674/1316] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:10 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:11.288300 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0be8cac7-1015-4879-a507-33590e5d742e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:11.288910 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0be8cac7-1015-4879-a507-33590e5d742e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:11.295345 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0be8cac7-1015-4879-a507-33590e5d742e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:11.295824 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0be8cac7-1015-4879-a507-33590e5d742e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:11.296261 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0be8cac7-1015-4879-a507-33590e5d742e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:11.296980 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0be8cac7-1015-4879-a507-33590e5d742e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:11.297432 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0be8cac7-1015-4879-a507-33590e5d742e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:11.297854 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0be8cac7-1015-4879-a507-33590e5d742e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:11.359591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0be8cac7-1015-4879-a507-33590e5d742e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:11.367786 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0be8cac7-1015-4879-a507-33590e5d742e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083332 Aug 04 23:28:11.368346 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 643/1317] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:11 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:12.389322 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e489155a-7215-4d8d-8b26-f8ffed0cb32f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:12.389951 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e489155a-7215-4d8d-8b26-f8ffed0cb32f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:12.396497 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e489155a-7215-4d8d-8b26-f8ffed0cb32f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:12.396976 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e489155a-7215-4d8d-8b26-f8ffed0cb32f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:12.397411 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e489155a-7215-4d8d-8b26-f8ffed0cb32f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:12.398104 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e489155a-7215-4d8d-8b26-f8ffed0cb32f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:12.398593 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e489155a-7215-4d8d-8b26-f8ffed0cb32f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:12.399019 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e489155a-7215-4d8d-8b26-f8ffed0cb32f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:12.462809 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e489155a-7215-4d8d-8b26-f8ffed0cb32f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:12.470600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e489155a-7215-4d8d-8b26-f8ffed0cb32f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085164 Aug 04 23:28:12.471760 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 675/1318] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:12 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:13.492403 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b0edc9af-5768-4ba9-9026-9d2443ad25df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:13.493010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b0edc9af-5768-4ba9-9026-9d2443ad25df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:13.499638 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0edc9af-5768-4ba9-9026-9d2443ad25df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:13.500116 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0edc9af-5768-4ba9-9026-9d2443ad25df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:13.500675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0edc9af-5768-4ba9-9026-9d2443ad25df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:13.501372 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0edc9af-5768-4ba9-9026-9d2443ad25df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:13.501821 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0edc9af-5768-4ba9-9026-9d2443ad25df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:13.502274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0edc9af-5768-4ba9-9026-9d2443ad25df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:13.564949 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b0edc9af-5768-4ba9-9026-9d2443ad25df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:13.572554 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b0edc9af-5768-4ba9-9026-9d2443ad25df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084069 Aug 04 23:28:13.573109 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 644/1319] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:13 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:14.593708 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c8217eba-5b27-438c-9acd-819be04f1d59 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:14.594603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c8217eba-5b27-438c-9acd-819be04f1d59 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:14.601140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8217eba-5b27-438c-9acd-819be04f1d59 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:14.601621 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8217eba-5b27-438c-9acd-819be04f1d59 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:14.602056 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8217eba-5b27-438c-9acd-819be04f1d59 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:14.602772 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8217eba-5b27-438c-9acd-819be04f1d59 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:14.603229 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8217eba-5b27-438c-9acd-819be04f1d59 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:14.603652 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8217eba-5b27-438c-9acd-819be04f1d59 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:14.666227 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c8217eba-5b27-438c-9acd-819be04f1d59 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:14.673928 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c8217eba-5b27-438c-9acd-819be04f1d59 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084084 Aug 04 23:28:14.674642 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 676/1320] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:14 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:15.695888 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1e504281-88eb-49b1-a54a-a112aadf289c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:15.696546 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1e504281-88eb-49b1-a54a-a112aadf289c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:15.703312 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1e504281-88eb-49b1-a54a-a112aadf289c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:15.703724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1e504281-88eb-49b1-a54a-a112aadf289c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:15.704186 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1e504281-88eb-49b1-a54a-a112aadf289c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:15.704888 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1e504281-88eb-49b1-a54a-a112aadf289c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:15.705873 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1e504281-88eb-49b1-a54a-a112aadf289c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:15.706883 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1e504281-88eb-49b1-a54a-a112aadf289c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:15.768909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1e504281-88eb-49b1-a54a-a112aadf289c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:15.776495 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1e504281-88eb-49b1-a54a-a112aadf289c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085534 Aug 04 23:28:15.777060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 645/1321] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:15 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:16.797156 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-378a292c-e426-474b-b935-78a467334446 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:16.797758 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-378a292c-e426-474b-b935-78a467334446 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:16.805496 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-378a292c-e426-474b-b935-78a467334446 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:16.806038 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-378a292c-e426-474b-b935-78a467334446 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:16.806401 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-378a292c-e426-474b-b935-78a467334446 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:16.807074 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-378a292c-e426-474b-b935-78a467334446 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:16.807519 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-378a292c-e426-474b-b935-78a467334446 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:16.807933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-378a292c-e426-474b-b935-78a467334446 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:16.874992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-378a292c-e426-474b-b935-78a467334446 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:16.883091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-378a292c-e426-474b-b935-78a467334446 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089854 Aug 04 23:28:16.883647 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 677/1322] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:16 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:17.902898 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-eeb3e3e7-70e9-4061-9f39-5f395c35d319 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:17.903504 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-eeb3e3e7-70e9-4061-9f39-5f395c35d319 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:17.909992 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eeb3e3e7-70e9-4061-9f39-5f395c35d319 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:17.910502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eeb3e3e7-70e9-4061-9f39-5f395c35d319 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:17.910937 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eeb3e3e7-70e9-4061-9f39-5f395c35d319 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:17.911624 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eeb3e3e7-70e9-4061-9f39-5f395c35d319 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:17.912135 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eeb3e3e7-70e9-4061-9f39-5f395c35d319 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:17.912561 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eeb3e3e7-70e9-4061-9f39-5f395c35d319 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:17.974008 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-eeb3e3e7-70e9-4061-9f39-5f395c35d319 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:17.981693 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-eeb3e3e7-70e9-4061-9f39-5f395c35d319 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.082633 Aug 04 23:28:17.982259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 646/1323] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:17 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:19.003071 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ba10672a-84d4-4d0c-bfd7-8be95a6796e5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:19.003759 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ba10672a-84d4-4d0c-bfd7-8be95a6796e5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:19.010197 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba10672a-84d4-4d0c-bfd7-8be95a6796e5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:19.010699 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba10672a-84d4-4d0c-bfd7-8be95a6796e5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:19.011123 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba10672a-84d4-4d0c-bfd7-8be95a6796e5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:19.011807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba10672a-84d4-4d0c-bfd7-8be95a6796e5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:19.012252 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba10672a-84d4-4d0c-bfd7-8be95a6796e5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:19.012666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba10672a-84d4-4d0c-bfd7-8be95a6796e5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:19.074318 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ba10672a-84d4-4d0c-bfd7-8be95a6796e5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:19.082788 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ba10672a-84d4-4d0c-bfd7-8be95a6796e5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083988 Aug 04 23:28:19.083345 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 678/1324] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:18 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:20.103558 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f4d9f511-f5ce-46bf-8072-adabf7b2f13e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:20.104097 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f4d9f511-f5ce-46bf-8072-adabf7b2f13e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:20.110509 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4d9f511-f5ce-46bf-8072-adabf7b2f13e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:20.110989 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4d9f511-f5ce-46bf-8072-adabf7b2f13e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:20.111518 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4d9f511-f5ce-46bf-8072-adabf7b2f13e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:20.112213 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4d9f511-f5ce-46bf-8072-adabf7b2f13e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:20.112666 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4d9f511-f5ce-46bf-8072-adabf7b2f13e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:20.113089 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4d9f511-f5ce-46bf-8072-adabf7b2f13e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:20.175572 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f4d9f511-f5ce-46bf-8072-adabf7b2f13e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:20.183103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f4d9f511-f5ce-46bf-8072-adabf7b2f13e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083449 Aug 04 23:28:20.183882 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 647/1325] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:20 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:21.207396 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b37df18b-589c-44a6-a537-9b56e3edf9a2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:21.208040 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b37df18b-589c-44a6-a537-9b56e3edf9a2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:21.214610 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b37df18b-589c-44a6-a537-9b56e3edf9a2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:21.215093 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b37df18b-589c-44a6-a537-9b56e3edf9a2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:21.215531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b37df18b-589c-44a6-a537-9b56e3edf9a2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:21.216226 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b37df18b-589c-44a6-a537-9b56e3edf9a2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:21.216685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b37df18b-589c-44a6-a537-9b56e3edf9a2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:21.217104 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b37df18b-589c-44a6-a537-9b56e3edf9a2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:21.284290 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b37df18b-589c-44a6-a537-9b56e3edf9a2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:21.291922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b37df18b-589c-44a6-a537-9b56e3edf9a2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.088470 Aug 04 23:28:21.292484 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 679/1326] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:21 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:22.313115 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-72013fca-2494-4526-90a4-527ffed1d780 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:22.313761 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-72013fca-2494-4526-90a4-527ffed1d780 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:22.321124 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72013fca-2494-4526-90a4-527ffed1d780 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:22.321614 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72013fca-2494-4526-90a4-527ffed1d780 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:22.322060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72013fca-2494-4526-90a4-527ffed1d780 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:22.322795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72013fca-2494-4526-90a4-527ffed1d780 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:22.323252 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72013fca-2494-4526-90a4-527ffed1d780 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:22.323675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72013fca-2494-4526-90a4-527ffed1d780 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:22.386385 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-72013fca-2494-4526-90a4-527ffed1d780 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:22.394652 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-72013fca-2494-4526-90a4-527ffed1d780 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085322 Aug 04 23:28:22.395209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 648/1327] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:22 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:23.415365 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-be946e4b-c90a-4904-9735-9846fc423785 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:23.415969 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-be946e4b-c90a-4904-9735-9846fc423785 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:23.422161 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be946e4b-c90a-4904-9735-9846fc423785 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:23.422677 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be946e4b-c90a-4904-9735-9846fc423785 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:23.423098 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be946e4b-c90a-4904-9735-9846fc423785 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:23.424383 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be946e4b-c90a-4904-9735-9846fc423785 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:23.425494 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be946e4b-c90a-4904-9735-9846fc423785 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:23.425916 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be946e4b-c90a-4904-9735-9846fc423785 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:23.491057 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-be946e4b-c90a-4904-9735-9846fc423785 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:23.499844 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-be946e4b-c90a-4904-9735-9846fc423785 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.088279 Aug 04 23:28:23.500418 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 680/1328] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:23 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:24.521462 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b2fc3ac3-bacf-4dd4-8aed-83a6aa4ceac9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:24.522098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b2fc3ac3-bacf-4dd4-8aed-83a6aa4ceac9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:24.524190 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=28 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:28:24.529686 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b2fc3ac3-bacf-4dd4-8aed-83a6aa4ceac9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:24.530166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b2fc3ac3-bacf-4dd4-8aed-83a6aa4ceac9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:24.530653 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b2fc3ac3-bacf-4dd4-8aed-83a6aa4ceac9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:24.531351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b2fc3ac3-bacf-4dd4-8aed-83a6aa4ceac9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:24.531804 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b2fc3ac3-bacf-4dd4-8aed-83a6aa4ceac9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:24.532226 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b2fc3ac3-bacf-4dd4-8aed-83a6aa4ceac9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:24.596754 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b2fc3ac3-bacf-4dd4-8aed-83a6aa4ceac9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:24.604247 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b2fc3ac3-bacf-4dd4-8aed-83a6aa4ceac9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087041 Aug 04 23:28:24.604807 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 649/1329] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:24 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:25.625748 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-77476b89-4013-4cf2-8b95-dbbcf997f559 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:25.626400 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-77476b89-4013-4cf2-8b95-dbbcf997f559 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:25.628928 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=28 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:28:25.634856 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-77476b89-4013-4cf2-8b95-dbbcf997f559 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:25.635381 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-77476b89-4013-4cf2-8b95-dbbcf997f559 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:25.635819 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-77476b89-4013-4cf2-8b95-dbbcf997f559 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:25.636538 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-77476b89-4013-4cf2-8b95-dbbcf997f559 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:25.637017 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-77476b89-4013-4cf2-8b95-dbbcf997f559 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:25.637448 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-77476b89-4013-4cf2-8b95-dbbcf997f559 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:25.709002 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-77476b89-4013-4cf2-8b95-dbbcf997f559 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:25.716900 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-77476b89-4013-4cf2-8b95-dbbcf997f559 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.094968 Aug 04 23:28:25.717482 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 681/1330] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:25 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:26.738516 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3e6028c3-d7ef-4811-bcec-13b9e8fa1062 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:26.739171 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3e6028c3-d7ef-4811-bcec-13b9e8fa1062 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:26.746301 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e6028c3-d7ef-4811-bcec-13b9e8fa1062 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:26.746824 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e6028c3-d7ef-4811-bcec-13b9e8fa1062 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:26.747265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e6028c3-d7ef-4811-bcec-13b9e8fa1062 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:26.747989 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e6028c3-d7ef-4811-bcec-13b9e8fa1062 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:26.748444 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e6028c3-d7ef-4811-bcec-13b9e8fa1062 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:26.748870 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e6028c3-d7ef-4811-bcec-13b9e8fa1062 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:26.817549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3e6028c3-d7ef-4811-bcec-13b9e8fa1062 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:26.825833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3e6028c3-d7ef-4811-bcec-13b9e8fa1062 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.091244 Aug 04 23:28:26.826461 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 650/1331] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:26 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:27.848215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6a3ff301-13c1-4d1b-9402-c4f0e2cf7937 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:27.849037 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6a3ff301-13c1-4d1b-9402-c4f0e2cf7937 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:27.855682 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6a3ff301-13c1-4d1b-9402-c4f0e2cf7937 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:27.856167 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6a3ff301-13c1-4d1b-9402-c4f0e2cf7937 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:27.856662 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6a3ff301-13c1-4d1b-9402-c4f0e2cf7937 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:27.857376 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6a3ff301-13c1-4d1b-9402-c4f0e2cf7937 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:27.857823 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6a3ff301-13c1-4d1b-9402-c4f0e2cf7937 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:27.858243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6a3ff301-13c1-4d1b-9402-c4f0e2cf7937 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:27.923229 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6a3ff301-13c1-4d1b-9402-c4f0e2cf7937 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:27.933719 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6a3ff301-13c1-4d1b-9402-c4f0e2cf7937 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089824 Aug 04 23:28:27.934303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 682/1332] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:27 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:28:28.956182 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-37bd5f44-d12c-441d-ba19-0938bf7a2916 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:28.956803 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-37bd5f44-d12c-441d-ba19-0938bf7a2916 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:28.964450 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-37bd5f44-d12c-441d-ba19-0938bf7a2916 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:28.965049 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-37bd5f44-d12c-441d-ba19-0938bf7a2916 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:28.965379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-37bd5f44-d12c-441d-ba19-0938bf7a2916 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:28.966086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-37bd5f44-d12c-441d-ba19-0938bf7a2916 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:28.966577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-37bd5f44-d12c-441d-ba19-0938bf7a2916 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:28.967002 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-37bd5f44-d12c-441d-ba19-0938bf7a2916 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:29.030894 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-37bd5f44-d12c-441d-ba19-0938bf7a2916 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:29.040019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-37bd5f44-d12c-441d-ba19-0938bf7a2916 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.088571 Aug 04 23:28:29.040583 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 651/1333] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:28 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:30.061468 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-906ba6e8-b36a-463a-90bf-d6411ade6025 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:30.062075 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-906ba6e8-b36a-463a-90bf-d6411ade6025 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:30.069574 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-906ba6e8-b36a-463a-90bf-d6411ade6025 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:30.070057 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-906ba6e8-b36a-463a-90bf-d6411ade6025 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:30.070540 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-906ba6e8-b36a-463a-90bf-d6411ade6025 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:30.071243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-906ba6e8-b36a-463a-90bf-d6411ade6025 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:30.071688 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-906ba6e8-b36a-463a-90bf-d6411ade6025 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:30.072106 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-906ba6e8-b36a-463a-90bf-d6411ade6025 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:30.074933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=84 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:28:30.140796 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-906ba6e8-b36a-463a-90bf-d6411ade6025 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:30.149539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-906ba6e8-b36a-463a-90bf-d6411ade6025 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.092120 Aug 04 23:28:30.150114 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 683/1334] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:30 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:31.170870 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9a30e80b-4adb-4b44-a5f6-4a32b7aafa7a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:31.171477 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9a30e80b-4adb-4b44-a5f6-4a32b7aafa7a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:31.178768 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a30e80b-4adb-4b44-a5f6-4a32b7aafa7a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:31.179239 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a30e80b-4adb-4b44-a5f6-4a32b7aafa7a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:31.179758 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a30e80b-4adb-4b44-a5f6-4a32b7aafa7a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:31.180349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a30e80b-4adb-4b44-a5f6-4a32b7aafa7a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:31.180790 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a30e80b-4adb-4b44-a5f6-4a32b7aafa7a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:31.181202 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a30e80b-4adb-4b44-a5f6-4a32b7aafa7a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:31.244333 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9a30e80b-4adb-4b44-a5f6-4a32b7aafa7a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:31.252423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9a30e80b-4adb-4b44-a5f6-4a32b7aafa7a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084787 Aug 04 23:28:31.253368 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 652/1335] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:31 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:32.273812 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6eabb3ca-144c-4b2f-a1ba-119cdb9a145a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:32.274442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6eabb3ca-144c-4b2f-a1ba-119cdb9a145a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:32.280806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6eabb3ca-144c-4b2f-a1ba-119cdb9a145a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:32.281278 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6eabb3ca-144c-4b2f-a1ba-119cdb9a145a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:32.281704 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6eabb3ca-144c-4b2f-a1ba-119cdb9a145a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:32.282388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6eabb3ca-144c-4b2f-a1ba-119cdb9a145a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:32.283472 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6eabb3ca-144c-4b2f-a1ba-119cdb9a145a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:32.284218 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6eabb3ca-144c-4b2f-a1ba-119cdb9a145a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:32.346244 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6eabb3ca-144c-4b2f-a1ba-119cdb9a145a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:32.353888 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6eabb3ca-144c-4b2f-a1ba-119cdb9a145a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083868 Aug 04 23:28:32.354769 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 684/1336] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:32 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:33.374328 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-35b86871-db6b-435b-ab69-d6b3aca7044f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:33.374968 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-35b86871-db6b-435b-ab69-d6b3aca7044f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:33.381747 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-35b86871-db6b-435b-ab69-d6b3aca7044f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:33.382230 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-35b86871-db6b-435b-ab69-d6b3aca7044f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:33.382691 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-35b86871-db6b-435b-ab69-d6b3aca7044f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:33.383386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-35b86871-db6b-435b-ab69-d6b3aca7044f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:33.383826 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-35b86871-db6b-435b-ab69-d6b3aca7044f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:33.384245 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-35b86871-db6b-435b-ab69-d6b3aca7044f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:33.386820 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=84 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:28:33.450379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-35b86871-db6b-435b-ab69-d6b3aca7044f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:33.459360 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-35b86871-db6b-435b-ab69-d6b3aca7044f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.088743 Aug 04 23:28:33.460125 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 653/1337] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:33 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:34.480264 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-749c4a84-888f-482a-b94d-99d8c18b83d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:34.480905 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-749c4a84-888f-482a-b94d-99d8c18b83d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:34.487910 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-749c4a84-888f-482a-b94d-99d8c18b83d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:34.488394 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-749c4a84-888f-482a-b94d-99d8c18b83d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:34.488835 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-749c4a84-888f-482a-b94d-99d8c18b83d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:34.489545 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-749c4a84-888f-482a-b94d-99d8c18b83d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:34.489996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-749c4a84-888f-482a-b94d-99d8c18b83d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:34.490452 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-749c4a84-888f-482a-b94d-99d8c18b83d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:34.558521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-749c4a84-888f-482a-b94d-99d8c18b83d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:34.566872 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-749c4a84-888f-482a-b94d-99d8c18b83d3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.090486 Aug 04 23:28:34.567442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 685/1338] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:34 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:35.588331 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1aa5d63e-13cc-4112-a3b1-772285003892 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:35.588926 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1aa5d63e-13cc-4112-a3b1-772285003892 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:35.596166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1aa5d63e-13cc-4112-a3b1-772285003892 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:35.596777 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1aa5d63e-13cc-4112-a3b1-772285003892 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:35.597214 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1aa5d63e-13cc-4112-a3b1-772285003892 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:35.597909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1aa5d63e-13cc-4112-a3b1-772285003892 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:35.598378 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1aa5d63e-13cc-4112-a3b1-772285003892 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:35.598796 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1aa5d63e-13cc-4112-a3b1-772285003892 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:35.662767 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1aa5d63e-13cc-4112-a3b1-772285003892 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:35.670576 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1aa5d63e-13cc-4112-a3b1-772285003892 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086082 Aug 04 23:28:35.671161 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 654/1339] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:35 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:36.692262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-06071d2a-8ef4-44e2-9094-2dab8ac3dd52 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:36.692879 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-06071d2a-8ef4-44e2-9094-2dab8ac3dd52 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:36.699368 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-06071d2a-8ef4-44e2-9094-2dab8ac3dd52 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:36.699814 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-06071d2a-8ef4-44e2-9094-2dab8ac3dd52 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:36.700241 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-06071d2a-8ef4-44e2-9094-2dab8ac3dd52 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:36.700926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-06071d2a-8ef4-44e2-9094-2dab8ac3dd52 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:36.701644 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-06071d2a-8ef4-44e2-9094-2dab8ac3dd52 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:36.702070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-06071d2a-8ef4-44e2-9094-2dab8ac3dd52 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:36.766081 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-06071d2a-8ef4-44e2-9094-2dab8ac3dd52 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:36.774477 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-06071d2a-8ef4-44e2-9094-2dab8ac3dd52 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086270 Aug 04 23:28:36.775051 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 686/1340] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:36 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:37.795664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0e4d8b57-04af-45bf-bd55-b6c2e5668e09 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:37.796235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0e4d8b57-04af-45bf-bd55-b6c2e5668e09 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:37.803596 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0e4d8b57-04af-45bf-bd55-b6c2e5668e09 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:37.804080 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0e4d8b57-04af-45bf-bd55-b6c2e5668e09 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:37.804525 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0e4d8b57-04af-45bf-bd55-b6c2e5668e09 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:37.805226 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0e4d8b57-04af-45bf-bd55-b6c2e5668e09 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:37.805677 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0e4d8b57-04af-45bf-bd55-b6c2e5668e09 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:37.806100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0e4d8b57-04af-45bf-bd55-b6c2e5668e09 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:37.873423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0e4d8b57-04af-45bf-bd55-b6c2e5668e09 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:37.881871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0e4d8b57-04af-45bf-bd55-b6c2e5668e09 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.090077 Aug 04 23:28:37.882475 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 655/1341] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:37 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:38.903277 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f88e3a7b-0bf0-4441-a883-080c5c50cbcd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:38.903890 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f88e3a7b-0bf0-4441-a883-080c5c50cbcd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:38.911066 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f88e3a7b-0bf0-4441-a883-080c5c50cbcd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:38.911549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f88e3a7b-0bf0-4441-a883-080c5c50cbcd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:38.911991 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f88e3a7b-0bf0-4441-a883-080c5c50cbcd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:38.912686 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f88e3a7b-0bf0-4441-a883-080c5c50cbcd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:38.913137 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f88e3a7b-0bf0-4441-a883-080c5c50cbcd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:38.913560 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f88e3a7b-0bf0-4441-a883-080c5c50cbcd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:38.978202 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f88e3a7b-0bf0-4441-a883-080c5c50cbcd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:38.985750 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f88e3a7b-0bf0-4441-a883-080c5c50cbcd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086348 Aug 04 23:28:38.986335 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 687/1342] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:38 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:40.007219 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-51b7af58-6486-4235-b096-a1e816aba0e6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:40.007927 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-51b7af58-6486-4235-b096-a1e816aba0e6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:40.014483 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-51b7af58-6486-4235-b096-a1e816aba0e6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:40.014970 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-51b7af58-6486-4235-b096-a1e816aba0e6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:40.015403 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-51b7af58-6486-4235-b096-a1e816aba0e6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:40.016182 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-51b7af58-6486-4235-b096-a1e816aba0e6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:40.016610 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-51b7af58-6486-4235-b096-a1e816aba0e6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:40.017052 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-51b7af58-6486-4235-b096-a1e816aba0e6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:40.080749 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-51b7af58-6486-4235-b096-a1e816aba0e6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:40.088765 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-51b7af58-6486-4235-b096-a1e816aba0e6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085333 Aug 04 23:28:40.089340 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 656/1343] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:40 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:41.109849 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4427159a-1f81-4fef-ab9a-8bef35f67fe8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:41.110439 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4427159a-1f81-4fef-ab9a-8bef35f67fe8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:41.117239 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4427159a-1f81-4fef-ab9a-8bef35f67fe8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:41.117715 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4427159a-1f81-4fef-ab9a-8bef35f67fe8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:41.118147 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4427159a-1f81-4fef-ab9a-8bef35f67fe8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:41.118879 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4427159a-1f81-4fef-ab9a-8bef35f67fe8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:41.119325 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4427159a-1f81-4fef-ab9a-8bef35f67fe8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:41.119749 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4427159a-1f81-4fef-ab9a-8bef35f67fe8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:41.196170 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4427159a-1f81-4fef-ab9a-8bef35f67fe8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:41.205489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4427159a-1f81-4fef-ab9a-8bef35f67fe8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.098963 Aug 04 23:28:41.206087 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 688/1344] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:41 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:42.229543 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f9030384-856a-496c-a83b-b59f4c2bf719 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:42.230613 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f9030384-856a-496c-a83b-b59f4c2bf719 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:42.241175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f9030384-856a-496c-a83b-b59f4c2bf719 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:42.241656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f9030384-856a-496c-a83b-b59f4c2bf719 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:42.242092 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f9030384-856a-496c-a83b-b59f4c2bf719 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:42.242847 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f9030384-856a-496c-a83b-b59f4c2bf719 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:42.243286 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f9030384-856a-496c-a83b-b59f4c2bf719 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:42.243712 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f9030384-856a-496c-a83b-b59f4c2bf719 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:42.308893 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f9030384-856a-496c-a83b-b59f4c2bf719 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:42.317207 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f9030384-856a-496c-a83b-b59f4c2bf719 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.093720 Aug 04 23:28:42.317786 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 657/1345] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:42 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:43.339368 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-82b005bc-82af-4041-a68f-9888d71c841e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:43.340007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-82b005bc-82af-4041-a68f-9888d71c841e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:43.347213 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82b005bc-82af-4041-a68f-9888d71c841e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:43.347869 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82b005bc-82af-4041-a68f-9888d71c841e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:43.348412 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82b005bc-82af-4041-a68f-9888d71c841e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:43.349229 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82b005bc-82af-4041-a68f-9888d71c841e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:43.349787 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82b005bc-82af-4041-a68f-9888d71c841e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:43.350306 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82b005bc-82af-4041-a68f-9888d71c841e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:43.421964 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-82b005bc-82af-4041-a68f-9888d71c841e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:43.430424 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-82b005bc-82af-4041-a68f-9888d71c841e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.094984 Aug 04 23:28:43.431005 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 689/1346] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:43 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:44.452822 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9ba056ca-8539-4cc0-8efc-6a3f647d9801 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:44.453435 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9ba056ca-8539-4cc0-8efc-6a3f647d9801 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:44.461096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ba056ca-8539-4cc0-8efc-6a3f647d9801 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:44.461576 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ba056ca-8539-4cc0-8efc-6a3f647d9801 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:44.462007 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ba056ca-8539-4cc0-8efc-6a3f647d9801 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:44.462734 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ba056ca-8539-4cc0-8efc-6a3f647d9801 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:44.463179 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ba056ca-8539-4cc0-8efc-6a3f647d9801 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:44.463593 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ba056ca-8539-4cc0-8efc-6a3f647d9801 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:44.527686 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9ba056ca-8539-4cc0-8efc-6a3f647d9801 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:44.535690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9ba056ca-8539-4cc0-8efc-6a3f647d9801 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087020 Aug 04 23:28:44.536274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 658/1347] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:44 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:45.564728 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d1fe8922-9156-46f9-bbfa-36d166921c64 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:45.566015 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d1fe8922-9156-46f9-bbfa-36d166921c64 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:45.574979 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1fe8922-9156-46f9-bbfa-36d166921c64 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:45.575539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1fe8922-9156-46f9-bbfa-36d166921c64 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:45.576509 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1fe8922-9156-46f9-bbfa-36d166921c64 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:45.577308 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1fe8922-9156-46f9-bbfa-36d166921c64 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:45.577800 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1fe8922-9156-46f9-bbfa-36d166921c64 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:45.578264 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1fe8922-9156-46f9-bbfa-36d166921c64 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:45.645215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d1fe8922-9156-46f9-bbfa-36d166921c64 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:45.652987 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d1fe8922-9156-46f9-bbfa-36d166921c64 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.094702 Aug 04 23:28:45.653570 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 690/1348] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:45 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:46.681112 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-dae20984-6bda-4ee6-a0da-097b5fd6a5aa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:46.681728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-dae20984-6bda-4ee6-a0da-097b5fd6a5aa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:46.688338 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dae20984-6bda-4ee6-a0da-097b5fd6a5aa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:46.688822 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dae20984-6bda-4ee6-a0da-097b5fd6a5aa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:46.689902 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dae20984-6bda-4ee6-a0da-097b5fd6a5aa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:46.690747 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dae20984-6bda-4ee6-a0da-097b5fd6a5aa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:46.691204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dae20984-6bda-4ee6-a0da-097b5fd6a5aa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:46.691632 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dae20984-6bda-4ee6-a0da-097b5fd6a5aa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:46.762225 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-dae20984-6bda-4ee6-a0da-097b5fd6a5aa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:46.770930 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-dae20984-6bda-4ee6-a0da-097b5fd6a5aa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.093496 Aug 04 23:28:46.771503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 659/1349] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:46 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:47.792585 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d27b566a-83c4-48d9-a7b1-798ed271d58b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:47.793172 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d27b566a-83c4-48d9-a7b1-798ed271d58b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:47.800108 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d27b566a-83c4-48d9-a7b1-798ed271d58b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:47.800596 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d27b566a-83c4-48d9-a7b1-798ed271d58b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:47.801032 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d27b566a-83c4-48d9-a7b1-798ed271d58b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:47.801744 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d27b566a-83c4-48d9-a7b1-798ed271d58b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:47.802195 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d27b566a-83c4-48d9-a7b1-798ed271d58b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:47.802640 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d27b566a-83c4-48d9-a7b1-798ed271d58b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:47.870251 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d27b566a-83c4-48d9-a7b1-798ed271d58b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:47.881130 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d27b566a-83c4-48d9-a7b1-798ed271d58b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.092551 Aug 04 23:28:47.881738 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 691/1350] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:47 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:48.902940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-758a07b9-b400-4375-9283-e0fd19fd8662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:48.903567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-758a07b9-b400-4375-9283-e0fd19fd8662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:48.910976 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-758a07b9-b400-4375-9283-e0fd19fd8662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:48.911449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-758a07b9-b400-4375-9283-e0fd19fd8662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:48.911886 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-758a07b9-b400-4375-9283-e0fd19fd8662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:48.912566 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-758a07b9-b400-4375-9283-e0fd19fd8662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:48.913010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-758a07b9-b400-4375-9283-e0fd19fd8662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:48.913427 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-758a07b9-b400-4375-9283-e0fd19fd8662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:49.214732 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-758a07b9-b400-4375-9283-e0fd19fd8662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:49.222507 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-758a07b9-b400-4375-9283-e0fd19fd8662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.323383 Aug 04 23:28:49.223087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 660/1351] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:48 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:49.647567 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3ecdd0cf-50e8-4d01-b682-98b1168357c1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:49.648276 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3ecdd0cf-50e8-4d01-b682-98b1168357c1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: e5609e6d-20ca-45b4-8edf-9b0eff540469] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:49.655784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ecdd0cf-50e8-4d01-b682-98b1168357c1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:49.656266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ecdd0cf-50e8-4d01-b682-98b1168357c1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:49.656706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ecdd0cf-50e8-4d01-b682-98b1168357c1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:49.657413 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ecdd0cf-50e8-4d01-b682-98b1168357c1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:49.657882 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ecdd0cf-50e8-4d01-b682-98b1168357c1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:49.658321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3ecdd0cf-50e8-4d01-b682-98b1168357c1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:49.683340 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3ecdd0cf-50e8-4d01-b682-98b1168357c1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469/ips" status: 200 len: 145 microversion: 2.1 time: 0.040593 Aug 04 23:28:49.683929 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 692/1352] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Aug 4 23:28:49 2022] GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:28:50.242935 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b4b2de8c-ca00-45ef-b055-c2162e6c6ccc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:50.243502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b4b2de8c-ca00-45ef-b055-c2162e6c6ccc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:50.250761 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b4b2de8c-ca00-45ef-b055-c2162e6c6ccc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:50.251239 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b4b2de8c-ca00-45ef-b055-c2162e6c6ccc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:50.251668 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b4b2de8c-ca00-45ef-b055-c2162e6c6ccc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:50.252672 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b4b2de8c-ca00-45ef-b055-c2162e6c6ccc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:50.253131 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b4b2de8c-ca00-45ef-b055-c2162e6c6ccc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:50.253549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b4b2de8c-ca00-45ef-b055-c2162e6c6ccc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:50.319940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b4b2de8c-ca00-45ef-b055-c2162e6c6ccc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:50.327957 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b4b2de8c-ca00-45ef-b055-c2162e6c6ccc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.088974 Aug 04 23:28:50.328529 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 661/1353] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:50 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:51.349942 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-82e626d0-ef46-40a3-aae6-cd0057faaff2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:51.350591 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-82e626d0-ef46-40a3-aae6-cd0057faaff2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:51.364118 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82e626d0-ef46-40a3-aae6-cd0057faaff2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:51.364118 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82e626d0-ef46-40a3-aae6-cd0057faaff2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:51.364118 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82e626d0-ef46-40a3-aae6-cd0057faaff2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:51.364118 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82e626d0-ef46-40a3-aae6-cd0057faaff2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:51.364657 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82e626d0-ef46-40a3-aae6-cd0057faaff2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:51.364657 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82e626d0-ef46-40a3-aae6-cd0057faaff2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:51.426955 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-82e626d0-ef46-40a3-aae6-cd0057faaff2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:51.434560 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-82e626d0-ef46-40a3-aae6-cd0057faaff2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089259 Aug 04 23:28:51.435127 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 693/1354] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:51 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:52.457587 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-90d3bed7-9d5b-401a-9ee6-6ec36f3d93a0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:52.458493 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-90d3bed7-9d5b-401a-9ee6-6ec36f3d93a0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:52.465147 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-90d3bed7-9d5b-401a-9ee6-6ec36f3d93a0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:52.465632 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-90d3bed7-9d5b-401a-9ee6-6ec36f3d93a0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:52.466065 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-90d3bed7-9d5b-401a-9ee6-6ec36f3d93a0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:52.466795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-90d3bed7-9d5b-401a-9ee6-6ec36f3d93a0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:52.467239 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-90d3bed7-9d5b-401a-9ee6-6ec36f3d93a0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:52.467654 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-90d3bed7-9d5b-401a-9ee6-6ec36f3d93a0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:52.536705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-90d3bed7-9d5b-401a-9ee6-6ec36f3d93a0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:52.544971 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-90d3bed7-9d5b-401a-9ee6-6ec36f3d93a0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.092557 Aug 04 23:28:52.545547 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 662/1355] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:52 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:53.570872 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b7e0bedb-5cb9-412c-b12d-da6735ce332a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:53.571668 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b7e0bedb-5cb9-412c-b12d-da6735ce332a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:53.577975 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b7e0bedb-5cb9-412c-b12d-da6735ce332a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:53.578475 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b7e0bedb-5cb9-412c-b12d-da6735ce332a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:53.578904 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b7e0bedb-5cb9-412c-b12d-da6735ce332a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:53.579690 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b7e0bedb-5cb9-412c-b12d-da6735ce332a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:53.580400 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b7e0bedb-5cb9-412c-b12d-da6735ce332a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:53.580826 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b7e0bedb-5cb9-412c-b12d-da6735ce332a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:53.653469 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b7e0bedb-5cb9-412c-b12d-da6735ce332a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:53.662581 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b7e0bedb-5cb9-412c-b12d-da6735ce332a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.095425 Aug 04 23:28:53.669162 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 694/1356] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:53 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:54.686033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-930fba0c-7ec8-40cd-87a6-9fdaf929d3e9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:54.686713 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-930fba0c-7ec8-40cd-87a6-9fdaf929d3e9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:54.688998 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=28 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:28:54.696934 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-930fba0c-7ec8-40cd-87a6-9fdaf929d3e9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:54.697509 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-930fba0c-7ec8-40cd-87a6-9fdaf929d3e9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:54.698006 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-930fba0c-7ec8-40cd-87a6-9fdaf929d3e9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:54.698985 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-930fba0c-7ec8-40cd-87a6-9fdaf929d3e9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:54.699571 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-930fba0c-7ec8-40cd-87a6-9fdaf929d3e9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:54.700012 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-930fba0c-7ec8-40cd-87a6-9fdaf929d3e9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:54.770699 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-930fba0c-7ec8-40cd-87a6-9fdaf929d3e9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:54.779488 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-930fba0c-7ec8-40cd-87a6-9fdaf929d3e9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.097223 Aug 04 23:28:54.780085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 663/1357] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:54 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:55.802261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-98823d74-0a56-4a70-9107-fdd15bf36a98 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:55.803022 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-98823d74-0a56-4a70-9107-fdd15bf36a98 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:55.805374 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=28 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:28:55.811184 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98823d74-0a56-4a70-9107-fdd15bf36a98 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:55.811672 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98823d74-0a56-4a70-9107-fdd15bf36a98 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:55.812108 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98823d74-0a56-4a70-9107-fdd15bf36a98 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:55.812836 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98823d74-0a56-4a70-9107-fdd15bf36a98 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:55.813297 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98823d74-0a56-4a70-9107-fdd15bf36a98 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:55.813909 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98823d74-0a56-4a70-9107-fdd15bf36a98 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:55.885267 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-98823d74-0a56-4a70-9107-fdd15bf36a98 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:55.893656 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-98823d74-0a56-4a70-9107-fdd15bf36a98 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.096136 Aug 04 23:28:55.894241 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 695/1358] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:55 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:56.914797 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-392be545-02ce-4519-92a0-3d221c4adbd5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:56.915452 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-392be545-02ce-4519-92a0-3d221c4adbd5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:56.922188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-392be545-02ce-4519-92a0-3d221c4adbd5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:56.922713 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-392be545-02ce-4519-92a0-3d221c4adbd5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:56.923991 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-392be545-02ce-4519-92a0-3d221c4adbd5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:56.924712 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-392be545-02ce-4519-92a0-3d221c4adbd5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:56.925164 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-392be545-02ce-4519-92a0-3d221c4adbd5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:56.925585 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-392be545-02ce-4519-92a0-3d221c4adbd5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:56.992874 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-392be545-02ce-4519-92a0-3d221c4adbd5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:57.000579 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-392be545-02ce-4519-92a0-3d221c4adbd5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089780 Aug 04 23:28:57.001817 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 664/1359] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:56 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:58.021643 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5640b0e7-4afe-44da-9f10-c7c060670d37 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:58.022249 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5640b0e7-4afe-44da-9f10-c7c060670d37 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:58.028902 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5640b0e7-4afe-44da-9f10-c7c060670d37 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:58.029370 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5640b0e7-4afe-44da-9f10-c7c060670d37 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:58.029796 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5640b0e7-4afe-44da-9f10-c7c060670d37 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:58.030532 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5640b0e7-4afe-44da-9f10-c7c060670d37 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:58.030975 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5640b0e7-4afe-44da-9f10-c7c060670d37 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:58.031388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5640b0e7-4afe-44da-9f10-c7c060670d37 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:58.109693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5640b0e7-4afe-44da-9f10-c7c060670d37 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:58.118318 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5640b0e7-4afe-44da-9f10-c7c060670d37 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.100730 Aug 04 23:28:58.118946 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 696/1360] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:58 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:28:59.139514 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-edab5e56-7d49-4da5-81c3-3782357163fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:28:59.140139 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-edab5e56-7d49-4da5-81c3-3782357163fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:28:59.147457 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edab5e56-7d49-4da5-81c3-3782357163fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:59.147934 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edab5e56-7d49-4da5-81c3-3782357163fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:59.148371 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edab5e56-7d49-4da5-81c3-3782357163fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:59.149067 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edab5e56-7d49-4da5-81c3-3782357163fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:28:59.149543 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edab5e56-7d49-4da5-81c3-3782357163fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:28:59.149965 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edab5e56-7d49-4da5-81c3-3782357163fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:28:59.211885 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-edab5e56-7d49-4da5-81c3-3782357163fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:28:59.219451 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-edab5e56-7d49-4da5-81c3-3782357163fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084067 Aug 04 23:28:59.220591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 665/1361] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:28:59 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:00.241023 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-79137dcb-200d-4304-8050-0b54436b9d1d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:00.241660 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-79137dcb-200d-4304-8050-0b54436b9d1d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:00.248172 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79137dcb-200d-4304-8050-0b54436b9d1d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:00.248648 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79137dcb-200d-4304-8050-0b54436b9d1d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:00.249079 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79137dcb-200d-4304-8050-0b54436b9d1d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:00.249771 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79137dcb-200d-4304-8050-0b54436b9d1d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:00.250218 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79137dcb-200d-4304-8050-0b54436b9d1d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:00.250665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79137dcb-200d-4304-8050-0b54436b9d1d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:00.253860 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=82 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:29:00.314823 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-79137dcb-200d-4304-8050-0b54436b9d1d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:00.322672 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-79137dcb-200d-4304-8050-0b54436b9d1d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085456 Aug 04 23:29:00.323429 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 697/1362] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:00 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:01.346154 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4cb6e30c-ee4b-45ce-b9a4-dc27649ddf94 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:01.346802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4cb6e30c-ee4b-45ce-b9a4-dc27649ddf94 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:01.353347 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cb6e30c-ee4b-45ce-b9a4-dc27649ddf94 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:01.353832 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cb6e30c-ee4b-45ce-b9a4-dc27649ddf94 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:01.354271 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cb6e30c-ee4b-45ce-b9a4-dc27649ddf94 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:01.355007 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cb6e30c-ee4b-45ce-b9a4-dc27649ddf94 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:01.355465 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cb6e30c-ee4b-45ce-b9a4-dc27649ddf94 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:01.355923 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cb6e30c-ee4b-45ce-b9a4-dc27649ddf94 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:01.420129 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4cb6e30c-ee4b-45ce-b9a4-dc27649ddf94 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:01.428932 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4cb6e30c-ee4b-45ce-b9a4-dc27649ddf94 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087795 Aug 04 23:29:01.429520 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 666/1363] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:01 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:02.450787 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5672e252-01f4-429a-98fd-fa64807ad871 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:02.451386 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5672e252-01f4-429a-98fd-fa64807ad871 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:02.459711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5672e252-01f4-429a-98fd-fa64807ad871 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:02.460189 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5672e252-01f4-429a-98fd-fa64807ad871 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:02.460613 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5672e252-01f4-429a-98fd-fa64807ad871 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:02.461309 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5672e252-01f4-429a-98fd-fa64807ad871 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:02.461752 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5672e252-01f4-429a-98fd-fa64807ad871 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:02.462167 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5672e252-01f4-429a-98fd-fa64807ad871 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:02.531159 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5672e252-01f4-429a-98fd-fa64807ad871 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:02.545922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5672e252-01f4-429a-98fd-fa64807ad871 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.098851 Aug 04 23:29:02.546975 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 698/1364] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:02 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:03.568100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c821ad93-02d3-44d2-b062-737955ba73d2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:03.568707 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c821ad93-02d3-44d2-b062-737955ba73d2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:03.575369 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c821ad93-02d3-44d2-b062-737955ba73d2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:03.576112 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c821ad93-02d3-44d2-b062-737955ba73d2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:03.576545 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c821ad93-02d3-44d2-b062-737955ba73d2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:03.577240 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c821ad93-02d3-44d2-b062-737955ba73d2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:03.577688 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c821ad93-02d3-44d2-b062-737955ba73d2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:03.578106 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c821ad93-02d3-44d2-b062-737955ba73d2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:03.582005 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=84 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:29:03.643112 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c821ad93-02d3-44d2-b062-737955ba73d2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:03.650527 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c821ad93-02d3-44d2-b062-737955ba73d2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086916 Aug 04 23:29:03.651106 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 667/1365] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:03 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:04.674649 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5c1fb8c4-1dd8-4c63-999a-99873592fa58 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:04.675256 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5c1fb8c4-1dd8-4c63-999a-99873592fa58 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:04.681796 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c1fb8c4-1dd8-4c63-999a-99873592fa58 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:04.682278 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c1fb8c4-1dd8-4c63-999a-99873592fa58 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:04.682757 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c1fb8c4-1dd8-4c63-999a-99873592fa58 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:04.683486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c1fb8c4-1dd8-4c63-999a-99873592fa58 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:04.683937 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c1fb8c4-1dd8-4c63-999a-99873592fa58 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:04.684363 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c1fb8c4-1dd8-4c63-999a-99873592fa58 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:04.746968 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5c1fb8c4-1dd8-4c63-999a-99873592fa58 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:04.755678 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5c1fb8c4-1dd8-4c63-999a-99873592fa58 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086413 Aug 04 23:29:04.755678 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 699/1366] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:04 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:05.777355 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-51832044-42d4-491b-8758-e37eb6b687be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:05.777975 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-51832044-42d4-491b-8758-e37eb6b687be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:05.785104 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-51832044-42d4-491b-8758-e37eb6b687be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:05.785597 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-51832044-42d4-491b-8758-e37eb6b687be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:05.786060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-51832044-42d4-491b-8758-e37eb6b687be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:05.786800 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-51832044-42d4-491b-8758-e37eb6b687be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:05.787254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-51832044-42d4-491b-8758-e37eb6b687be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:05.787676 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-51832044-42d4-491b-8758-e37eb6b687be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:05.858810 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-51832044-42d4-491b-8758-e37eb6b687be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:05.866378 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-51832044-42d4-491b-8758-e37eb6b687be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.093436 Aug 04 23:29:05.866947 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 668/1367] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:05 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:06.887003 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-87bdb97e-aa50-46f3-9bf2-4209dcc4f4fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:06.887641 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-87bdb97e-aa50-46f3-9bf2-4209dcc4f4fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:06.894973 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-87bdb97e-aa50-46f3-9bf2-4209dcc4f4fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:06.895457 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-87bdb97e-aa50-46f3-9bf2-4209dcc4f4fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:06.895896 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-87bdb97e-aa50-46f3-9bf2-4209dcc4f4fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:06.896590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-87bdb97e-aa50-46f3-9bf2-4209dcc4f4fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:06.897038 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-87bdb97e-aa50-46f3-9bf2-4209dcc4f4fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:06.897460 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-87bdb97e-aa50-46f3-9bf2-4209dcc4f4fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:06.964410 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-87bdb97e-aa50-46f3-9bf2-4209dcc4f4fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:06.972859 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-87bdb97e-aa50-46f3-9bf2-4209dcc4f4fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089676 Aug 04 23:29:06.973429 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 700/1368] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:06 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:07.994254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5d48a988-302b-40b4-b1ca-c079be448699 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:07.994883 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5d48a988-302b-40b4-b1ca-c079be448699 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:08.001207 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d48a988-302b-40b4-b1ca-c079be448699 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:08.001675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d48a988-302b-40b4-b1ca-c079be448699 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:08.002102 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d48a988-302b-40b4-b1ca-c079be448699 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:08.002831 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d48a988-302b-40b4-b1ca-c079be448699 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:08.003274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d48a988-302b-40b4-b1ca-c079be448699 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:08.003689 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d48a988-302b-40b4-b1ca-c079be448699 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:08.067489 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5d48a988-302b-40b4-b1ca-c079be448699 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:08.074973 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5d48a988-302b-40b4-b1ca-c079be448699 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084542 Aug 04 23:29:08.075801 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 669/1369] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:07 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:09.097202 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-24a62eae-8f86-4146-a731-2b5a93a76217 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:09.097774 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-24a62eae-8f86-4146-a731-2b5a93a76217 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:09.105259 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24a62eae-8f86-4146-a731-2b5a93a76217 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:09.105736 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24a62eae-8f86-4146-a731-2b5a93a76217 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:09.106162 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24a62eae-8f86-4146-a731-2b5a93a76217 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:09.106893 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24a62eae-8f86-4146-a731-2b5a93a76217 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:09.107329 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24a62eae-8f86-4146-a731-2b5a93a76217 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:09.107743 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24a62eae-8f86-4146-a731-2b5a93a76217 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:09.174817 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-24a62eae-8f86-4146-a731-2b5a93a76217 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:09.183948 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-24a62eae-8f86-4146-a731-2b5a93a76217 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.091177 Aug 04 23:29:09.193653 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 701/1370] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:09 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:10.205841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-949258ca-6a00-4c66-bbcb-65bf8068d371 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:10.206491 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-949258ca-6a00-4c66-bbcb-65bf8068d371 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:10.213085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-949258ca-6a00-4c66-bbcb-65bf8068d371 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:10.213565 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-949258ca-6a00-4c66-bbcb-65bf8068d371 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:10.213999 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-949258ca-6a00-4c66-bbcb-65bf8068d371 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:10.214719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-949258ca-6a00-4c66-bbcb-65bf8068d371 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:10.215171 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-949258ca-6a00-4c66-bbcb-65bf8068d371 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:10.215597 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-949258ca-6a00-4c66-bbcb-65bf8068d371 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:10.277988 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-949258ca-6a00-4c66-bbcb-65bf8068d371 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:10.286219 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-949258ca-6a00-4c66-bbcb-65bf8068d371 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084423 Aug 04 23:29:10.286844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 670/1371] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:10 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:11.306551 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-730a54d8-5e29-4dc1-a412-593480e9e446 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:11.307153 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-730a54d8-5e29-4dc1-a412-593480e9e446 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:11.314585 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-730a54d8-5e29-4dc1-a412-593480e9e446 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:11.315058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-730a54d8-5e29-4dc1-a412-593480e9e446 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:11.315487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-730a54d8-5e29-4dc1-a412-593480e9e446 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:11.316167 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-730a54d8-5e29-4dc1-a412-593480e9e446 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:11.316611 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-730a54d8-5e29-4dc1-a412-593480e9e446 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:11.317024 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-730a54d8-5e29-4dc1-a412-593480e9e446 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:11.381996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-730a54d8-5e29-4dc1-a412-593480e9e446 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:11.389421 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-730a54d8-5e29-4dc1-a412-593480e9e446 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086700 Aug 04 23:29:11.389975 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 702/1372] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:11 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:12.411069 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f797a9d9-aec3-4c70-a9ff-478dabaf084e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:12.411628 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f797a9d9-aec3-4c70-a9ff-478dabaf084e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:12.418211 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f797a9d9-aec3-4c70-a9ff-478dabaf084e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:12.418732 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f797a9d9-aec3-4c70-a9ff-478dabaf084e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:12.419162 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f797a9d9-aec3-4c70-a9ff-478dabaf084e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:12.419866 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f797a9d9-aec3-4c70-a9ff-478dabaf084e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:12.420317 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f797a9d9-aec3-4c70-a9ff-478dabaf084e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:12.420747 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f797a9d9-aec3-4c70-a9ff-478dabaf084e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:12.485805 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f797a9d9-aec3-4c70-a9ff-478dabaf084e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:12.493459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f797a9d9-aec3-4c70-a9ff-478dabaf084e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086794 Aug 04 23:29:12.494033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 671/1373] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:12 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:13.514936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f92ad030-e270-45ee-be10-1b223cf93445 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:13.515567 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f92ad030-e270-45ee-be10-1b223cf93445 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:13.523437 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f92ad030-e270-45ee-be10-1b223cf93445 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:13.524004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f92ad030-e270-45ee-be10-1b223cf93445 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:13.524339 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f92ad030-e270-45ee-be10-1b223cf93445 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:13.525256 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f92ad030-e270-45ee-be10-1b223cf93445 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:13.525714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f92ad030-e270-45ee-be10-1b223cf93445 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:13.526162 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f92ad030-e270-45ee-be10-1b223cf93445 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:13.591695 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f92ad030-e270-45ee-be10-1b223cf93445 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:13.600476 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f92ad030-e270-45ee-be10-1b223cf93445 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089294 Aug 04 23:29:13.601050 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 703/1374] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:13 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:14.621767 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0c6839eb-bb0c-4608-a6fd-2c08e7671bd0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:14.622529 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0c6839eb-bb0c-4608-a6fd-2c08e7671bd0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:14.629430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0c6839eb-bb0c-4608-a6fd-2c08e7671bd0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:14.629918 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0c6839eb-bb0c-4608-a6fd-2c08e7671bd0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:14.630350 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0c6839eb-bb0c-4608-a6fd-2c08e7671bd0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:14.631078 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0c6839eb-bb0c-4608-a6fd-2c08e7671bd0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:14.631526 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0c6839eb-bb0c-4608-a6fd-2c08e7671bd0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:14.631947 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0c6839eb-bb0c-4608-a6fd-2c08e7671bd0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:14.705818 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0c6839eb-bb0c-4608-a6fd-2c08e7671bd0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:14.713800 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0c6839eb-bb0c-4608-a6fd-2c08e7671bd0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.096062 Aug 04 23:29:14.714400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 672/1375] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:14 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:15.736327 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-45eca20e-e07c-4e5f-bddf-183c3b15762b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:15.736958 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-45eca20e-e07c-4e5f-bddf-183c3b15762b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:15.743709 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-45eca20e-e07c-4e5f-bddf-183c3b15762b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:15.744194 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-45eca20e-e07c-4e5f-bddf-183c3b15762b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:15.744660 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-45eca20e-e07c-4e5f-bddf-183c3b15762b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:15.745446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-45eca20e-e07c-4e5f-bddf-183c3b15762b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:15.745897 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-45eca20e-e07c-4e5f-bddf-183c3b15762b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:15.746313 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-45eca20e-e07c-4e5f-bddf-183c3b15762b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:15.812312 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-45eca20e-e07c-4e5f-bddf-183c3b15762b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:15.820865 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-45eca20e-e07c-4e5f-bddf-183c3b15762b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089068 Aug 04 23:29:15.821428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 704/1376] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:15 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:16.842174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b5133eb4-6cec-411a-b4de-8e72164b83d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:16.842817 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b5133eb4-6cec-411a-b4de-8e72164b83d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:16.849358 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5133eb4-6cec-411a-b4de-8e72164b83d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:16.849837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5133eb4-6cec-411a-b4de-8e72164b83d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:16.850274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5133eb4-6cec-411a-b4de-8e72164b83d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:16.850996 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5133eb4-6cec-411a-b4de-8e72164b83d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:16.851474 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5133eb4-6cec-411a-b4de-8e72164b83d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:16.851896 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5133eb4-6cec-411a-b4de-8e72164b83d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:16.912521 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b5133eb4-6cec-411a-b4de-8e72164b83d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:16.919931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b5133eb4-6cec-411a-b4de-8e72164b83d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.081659 Aug 04 23:29:16.920493 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 673/1377] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:16 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:17.939941 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-26eba89d-99d9-4a26-bd18-b01f1784856d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:17.940632 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-26eba89d-99d9-4a26-bd18-b01f1784856d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:17.947229 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26eba89d-99d9-4a26-bd18-b01f1784856d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:17.947707 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26eba89d-99d9-4a26-bd18-b01f1784856d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:17.948160 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26eba89d-99d9-4a26-bd18-b01f1784856d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:17.948839 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26eba89d-99d9-4a26-bd18-b01f1784856d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:17.949288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26eba89d-99d9-4a26-bd18-b01f1784856d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:17.949714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26eba89d-99d9-4a26-bd18-b01f1784856d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:18.012149 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-26eba89d-99d9-4a26-bd18-b01f1784856d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:18.020810 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-26eba89d-99d9-4a26-bd18-b01f1784856d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084913 Aug 04 23:29:18.021434 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 705/1378] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:17 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:19.042736 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-dacfbee0-6826-4156-8218-073f1130ee80 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:19.043327 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-dacfbee0-6826-4156-8218-073f1130ee80 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:19.050661 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dacfbee0-6826-4156-8218-073f1130ee80 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:19.051140 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dacfbee0-6826-4156-8218-073f1130ee80 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:19.051571 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dacfbee0-6826-4156-8218-073f1130ee80 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:19.052262 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dacfbee0-6826-4156-8218-073f1130ee80 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:19.052709 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dacfbee0-6826-4156-8218-073f1130ee80 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:19.053128 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dacfbee0-6826-4156-8218-073f1130ee80 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:19.114212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-dacfbee0-6826-4156-8218-073f1130ee80 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:19.121646 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-dacfbee0-6826-4156-8218-073f1130ee80 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.082852 Aug 04 23:29:19.122205 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 674/1379] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:19 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:20.143345 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6ce3854f-b2c7-4345-8a61-71d33cc8b398 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:20.143882 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6ce3854f-b2c7-4345-8a61-71d33cc8b398 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:20.150325 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ce3854f-b2c7-4345-8a61-71d33cc8b398 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:20.150846 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ce3854f-b2c7-4345-8a61-71d33cc8b398 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:20.151283 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ce3854f-b2c7-4345-8a61-71d33cc8b398 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:20.151982 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ce3854f-b2c7-4345-8a61-71d33cc8b398 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:20.152434 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ce3854f-b2c7-4345-8a61-71d33cc8b398 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:20.152857 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ce3854f-b2c7-4345-8a61-71d33cc8b398 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:20.229003 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6ce3854f-b2c7-4345-8a61-71d33cc8b398 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:20.237318 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6ce3854f-b2c7-4345-8a61-71d33cc8b398 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.098449 Aug 04 23:29:20.237879 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 706/1380] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:20 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:21.257867 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-44bd767a-98bf-4144-b118-ede43da16d29 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:21.258506 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-44bd767a-98bf-4144-b118-ede43da16d29 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:21.264944 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44bd767a-98bf-4144-b118-ede43da16d29 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:21.265413 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44bd767a-98bf-4144-b118-ede43da16d29 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:21.265839 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44bd767a-98bf-4144-b118-ede43da16d29 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:21.266570 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44bd767a-98bf-4144-b118-ede43da16d29 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:21.267016 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44bd767a-98bf-4144-b118-ede43da16d29 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:21.267429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44bd767a-98bf-4144-b118-ede43da16d29 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:21.333040 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-44bd767a-98bf-4144-b118-ede43da16d29 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:21.340517 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-44bd767a-98bf-4144-b118-ede43da16d29 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086556 Aug 04 23:29:21.341077 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 675/1381] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:21 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:22.362211 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9e174226-1517-4e0c-9d4c-b417084426c5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:22.362838 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9e174226-1517-4e0c-9d4c-b417084426c5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:22.369078 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e174226-1517-4e0c-9d4c-b417084426c5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:22.369557 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e174226-1517-4e0c-9d4c-b417084426c5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:22.369984 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e174226-1517-4e0c-9d4c-b417084426c5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:22.370697 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e174226-1517-4e0c-9d4c-b417084426c5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:22.371144 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e174226-1517-4e0c-9d4c-b417084426c5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:22.371590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e174226-1517-4e0c-9d4c-b417084426c5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:22.434877 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9e174226-1517-4e0c-9d4c-b417084426c5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:22.442523 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9e174226-1517-4e0c-9d4c-b417084426c5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084558 Aug 04 23:29:22.443086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 707/1382] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:22 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:23.464267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c618593d-b7c9-433e-93a6-6b406e29f68a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:23.464863 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c618593d-b7c9-433e-93a6-6b406e29f68a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:23.471353 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c618593d-b7c9-433e-93a6-6b406e29f68a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:23.471824 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c618593d-b7c9-433e-93a6-6b406e29f68a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:23.472252 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c618593d-b7c9-433e-93a6-6b406e29f68a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:23.472932 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c618593d-b7c9-433e-93a6-6b406e29f68a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:23.473378 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c618593d-b7c9-433e-93a6-6b406e29f68a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:23.473795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c618593d-b7c9-433e-93a6-6b406e29f68a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:23.536499 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c618593d-b7c9-433e-93a6-6b406e29f68a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:23.543904 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c618593d-b7c9-433e-93a6-6b406e29f68a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083623 Aug 04 23:29:23.544457 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 676/1383] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:23 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:24.565917 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b3090c84-bd52-4328-baeb-1b225f8530c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:24.566543 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b3090c84-bd52-4328-baeb-1b225f8530c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:24.573225 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b3090c84-bd52-4328-baeb-1b225f8530c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:24.573702 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b3090c84-bd52-4328-baeb-1b225f8530c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:24.574153 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b3090c84-bd52-4328-baeb-1b225f8530c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:24.575135 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b3090c84-bd52-4328-baeb-1b225f8530c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:24.575576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b3090c84-bd52-4328-baeb-1b225f8530c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:24.575991 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b3090c84-bd52-4328-baeb-1b225f8530c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:24.640456 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b3090c84-bd52-4328-baeb-1b225f8530c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:24.648870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b3090c84-bd52-4328-baeb-1b225f8530c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086855 Aug 04 23:29:24.649430 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 708/1384] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:24 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:25.670852 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-bdb83965-0d95-45eb-a5be-b89c928e906b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:25.671454 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-bdb83965-0d95-45eb-a5be-b89c928e906b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:25.674235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=28 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:29:25.680032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bdb83965-0d95-45eb-a5be-b89c928e906b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:25.680514 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bdb83965-0d95-45eb-a5be-b89c928e906b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:25.680951 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bdb83965-0d95-45eb-a5be-b89c928e906b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:25.681647 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bdb83965-0d95-45eb-a5be-b89c928e906b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:25.682134 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bdb83965-0d95-45eb-a5be-b89c928e906b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:25.682586 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bdb83965-0d95-45eb-a5be-b89c928e906b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:25.746998 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-bdb83965-0d95-45eb-a5be-b89c928e906b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:25.754992 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-bdb83965-0d95-45eb-a5be-b89c928e906b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.088495 Aug 04 23:29:25.755581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 677/1385] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:25 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:26.776197 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3070c5fc-4203-4cd8-8528-bba7e6f48df2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:26.776736 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3070c5fc-4203-4cd8-8528-bba7e6f48df2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:26.779017 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=28 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:29:26.784245 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3070c5fc-4203-4cd8-8528-bba7e6f48df2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:26.784722 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3070c5fc-4203-4cd8-8528-bba7e6f48df2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:26.785159 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3070c5fc-4203-4cd8-8528-bba7e6f48df2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:26.785852 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3070c5fc-4203-4cd8-8528-bba7e6f48df2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:26.786306 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3070c5fc-4203-4cd8-8528-bba7e6f48df2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:26.786806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3070c5fc-4203-4cd8-8528-bba7e6f48df2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:26.848878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3070c5fc-4203-4cd8-8528-bba7e6f48df2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:26.856348 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3070c5fc-4203-4cd8-8528-bba7e6f48df2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084141 Aug 04 23:29:26.857148 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 709/1386] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:26 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:27.877823 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b3d6f34f-7d8b-429d-bc5b-2d3c4b4d768b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:27.878480 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b3d6f34f-7d8b-429d-bc5b-2d3c4b4d768b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:27.885321 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3d6f34f-7d8b-429d-bc5b-2d3c4b4d768b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:27.885793 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3d6f34f-7d8b-429d-bc5b-2d3c4b4d768b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:27.886233 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3d6f34f-7d8b-429d-bc5b-2d3c4b4d768b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:27.886986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3d6f34f-7d8b-429d-bc5b-2d3c4b4d768b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:27.887433 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3d6f34f-7d8b-429d-bc5b-2d3c4b4d768b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:27.887854 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3d6f34f-7d8b-429d-bc5b-2d3c4b4d768b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:27.954160 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b3d6f34f-7d8b-429d-bc5b-2d3c4b4d768b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:27.962647 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b3d6f34f-7d8b-429d-bc5b-2d3c4b4d768b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089444 Aug 04 23:29:27.963197 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 678/1387] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:27 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:28.983909 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f252b955-bd49-4f1a-94d9-4654d4a552ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:28.984516 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f252b955-bd49-4f1a-94d9-4654d4a552ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:28.991821 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f252b955-bd49-4f1a-94d9-4654d4a552ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:28.992303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f252b955-bd49-4f1a-94d9-4654d4a552ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:28.992788 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f252b955-bd49-4f1a-94d9-4654d4a552ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:28.993486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f252b955-bd49-4f1a-94d9-4654d4a552ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:28.993944 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f252b955-bd49-4f1a-94d9-4654d4a552ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:28.994387 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f252b955-bd49-4f1a-94d9-4654d4a552ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:29.062530 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f252b955-bd49-4f1a-94d9-4654d4a552ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:29.070132 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f252b955-bd49-4f1a-94d9-4654d4a552ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.090073 Aug 04 23:29:29.070716 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 710/1388] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:28 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:30.091602 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d8d22c8c-73ea-4e5c-9ace-73223e80f8fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:30.092155 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d8d22c8c-73ea-4e5c-9ace-73223e80f8fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:30.098966 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d8d22c8c-73ea-4e5c-9ace-73223e80f8fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:30.099441 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d8d22c8c-73ea-4e5c-9ace-73223e80f8fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:30.099871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d8d22c8c-73ea-4e5c-9ace-73223e80f8fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:30.100549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d8d22c8c-73ea-4e5c-9ace-73223e80f8fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:30.101002 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d8d22c8c-73ea-4e5c-9ace-73223e80f8fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:30.101419 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d8d22c8c-73ea-4e5c-9ace-73223e80f8fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:30.164591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d8d22c8c-73ea-4e5c-9ace-73223e80f8fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:30.172222 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d8d22c8c-73ea-4e5c-9ace-73223e80f8fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084499 Aug 04 23:29:30.173049 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 679/1389] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:30 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:31.193141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0c556e6a-d7bd-4138-aa3b-b7cdee8e2e01 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:31.193751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0c556e6a-d7bd-4138-aa3b-b7cdee8e2e01 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:31.200656 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c556e6a-d7bd-4138-aa3b-b7cdee8e2e01 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:31.201137 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c556e6a-d7bd-4138-aa3b-b7cdee8e2e01 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:31.201571 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c556e6a-d7bd-4138-aa3b-b7cdee8e2e01 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:31.202267 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c556e6a-d7bd-4138-aa3b-b7cdee8e2e01 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:31.202813 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c556e6a-d7bd-4138-aa3b-b7cdee8e2e01 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:31.203234 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c556e6a-d7bd-4138-aa3b-b7cdee8e2e01 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:31.206402 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=84 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:29:31.268389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0c556e6a-d7bd-4138-aa3b-b7cdee8e2e01 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:31.275999 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0c556e6a-d7bd-4138-aa3b-b7cdee8e2e01 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086834 Aug 04 23:29:31.276553 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 711/1390] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:31 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:29:32.297073 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8a76e044-25dd-4fcc-8c14-f4d407fe728e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:32.298262 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8a76e044-25dd-4fcc-8c14-f4d407fe728e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:32.305118 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a76e044-25dd-4fcc-8c14-f4d407fe728e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:32.305598 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a76e044-25dd-4fcc-8c14-f4d407fe728e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:32.306029 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a76e044-25dd-4fcc-8c14-f4d407fe728e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:32.306753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a76e044-25dd-4fcc-8c14-f4d407fe728e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:32.307205 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a76e044-25dd-4fcc-8c14-f4d407fe728e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:32.307628 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a76e044-25dd-4fcc-8c14-f4d407fe728e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:32.369666 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8a76e044-25dd-4fcc-8c14-f4d407fe728e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:32.378116 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8a76e044-25dd-4fcc-8c14-f4d407fe728e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084891 Aug 04 23:29:32.378713 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 680/1391] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:32 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:33.398708 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a86b0a50-0277-4490-a8c4-c0a9a8ad3fea tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:33.399301 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a86b0a50-0277-4490-a8c4-c0a9a8ad3fea tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:33.405789 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a86b0a50-0277-4490-a8c4-c0a9a8ad3fea tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:33.406270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a86b0a50-0277-4490-a8c4-c0a9a8ad3fea tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:33.406740 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a86b0a50-0277-4490-a8c4-c0a9a8ad3fea tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:33.407959 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a86b0a50-0277-4490-a8c4-c0a9a8ad3fea tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:33.408404 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a86b0a50-0277-4490-a8c4-c0a9a8ad3fea tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:33.408827 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a86b0a50-0277-4490-a8c4-c0a9a8ad3fea tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:33.474203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a86b0a50-0277-4490-a8c4-c0a9a8ad3fea tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:33.481935 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a86b0a50-0277-4490-a8c4-c0a9a8ad3fea tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087130 Aug 04 23:29:33.482532 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 712/1392] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:33 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:34.504692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9675296f-b5c8-4a3f-82bb-02c5bd41596c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:34.505239 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9675296f-b5c8-4a3f-82bb-02c5bd41596c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:34.512075 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9675296f-b5c8-4a3f-82bb-02c5bd41596c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:34.512559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9675296f-b5c8-4a3f-82bb-02c5bd41596c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:34.512994 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9675296f-b5c8-4a3f-82bb-02c5bd41596c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:34.513687 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9675296f-b5c8-4a3f-82bb-02c5bd41596c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:34.514157 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9675296f-b5c8-4a3f-82bb-02c5bd41596c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:34.514624 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9675296f-b5c8-4a3f-82bb-02c5bd41596c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:34.517774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=84 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:29:34.578336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9675296f-b5c8-4a3f-82bb-02c5bd41596c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:34.586595 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9675296f-b5c8-4a3f-82bb-02c5bd41596c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086013 Aug 04 23:29:34.587149 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 681/1393] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:34 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:35.608329 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-67f12ad8-9bd7-4fb0-bba6-379a466fa912 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:35.608927 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-67f12ad8-9bd7-4fb0-bba6-379a466fa912 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:35.615813 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-67f12ad8-9bd7-4fb0-bba6-379a466fa912 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:35.616290 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-67f12ad8-9bd7-4fb0-bba6-379a466fa912 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:35.616723 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-67f12ad8-9bd7-4fb0-bba6-379a466fa912 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:35.617412 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-67f12ad8-9bd7-4fb0-bba6-379a466fa912 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:35.617858 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-67f12ad8-9bd7-4fb0-bba6-379a466fa912 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:35.618275 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-67f12ad8-9bd7-4fb0-bba6-379a466fa912 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:35.687161 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-67f12ad8-9bd7-4fb0-bba6-379a466fa912 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:35.695623 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-67f12ad8-9bd7-4fb0-bba6-379a466fa912 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.091259 Aug 04 23:29:35.696188 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 713/1394] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:35 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:36.716593 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c39c5a09-ca4a-447d-9ed6-a593b648c823 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:36.717196 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c39c5a09-ca4a-447d-9ed6-a593b648c823 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:36.723957 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c39c5a09-ca4a-447d-9ed6-a593b648c823 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:36.724450 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c39c5a09-ca4a-447d-9ed6-a593b648c823 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:36.724887 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c39c5a09-ca4a-447d-9ed6-a593b648c823 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:36.725590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c39c5a09-ca4a-447d-9ed6-a593b648c823 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:36.726043 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c39c5a09-ca4a-447d-9ed6-a593b648c823 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:36.726500 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c39c5a09-ca4a-447d-9ed6-a593b648c823 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:36.792201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c39c5a09-ca4a-447d-9ed6-a593b648c823 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:36.800515 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c39c5a09-ca4a-447d-9ed6-a593b648c823 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087637 Aug 04 23:29:36.801089 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 682/1395] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:36 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:37.821457 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d5372f61-2deb-4d9d-89e8-4a7b250dde9e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:37.822144 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d5372f61-2deb-4d9d-89e8-4a7b250dde9e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:37.828913 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d5372f61-2deb-4d9d-89e8-4a7b250dde9e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:37.829969 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d5372f61-2deb-4d9d-89e8-4a7b250dde9e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:37.830428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d5372f61-2deb-4d9d-89e8-4a7b250dde9e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:37.831167 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d5372f61-2deb-4d9d-89e8-4a7b250dde9e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:37.831618 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d5372f61-2deb-4d9d-89e8-4a7b250dde9e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:37.832046 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d5372f61-2deb-4d9d-89e8-4a7b250dde9e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:37.899559 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d5372f61-2deb-4d9d-89e8-4a7b250dde9e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:37.907058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d5372f61-2deb-4d9d-89e8-4a7b250dde9e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089621 Aug 04 23:29:37.908645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 714/1396] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:37 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:38.928718 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7b08ab5e-47ad-4724-9f9c-99fe0c8e5e72 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:38.929301 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7b08ab5e-47ad-4724-9f9c-99fe0c8e5e72 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:38.935701 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b08ab5e-47ad-4724-9f9c-99fe0c8e5e72 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:38.936174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b08ab5e-47ad-4724-9f9c-99fe0c8e5e72 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:38.936599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b08ab5e-47ad-4724-9f9c-99fe0c8e5e72 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:38.937275 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b08ab5e-47ad-4724-9f9c-99fe0c8e5e72 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:38.937718 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b08ab5e-47ad-4724-9f9c-99fe0c8e5e72 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:38.938131 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b08ab5e-47ad-4724-9f9c-99fe0c8e5e72 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:39.000448 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7b08ab5e-47ad-4724-9f9c-99fe0c8e5e72 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:39.008717 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7b08ab5e-47ad-4724-9f9c-99fe0c8e5e72 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083815 Aug 04 23:29:39.009280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 683/1397] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:38 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:40.030822 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-883d57cb-6c57-4643-abb4-ba4bf6735b7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:40.031420 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-883d57cb-6c57-4643-abb4-ba4bf6735b7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:40.038228 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-883d57cb-6c57-4643-abb4-ba4bf6735b7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:40.038755 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-883d57cb-6c57-4643-abb4-ba4bf6735b7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:40.039191 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-883d57cb-6c57-4643-abb4-ba4bf6735b7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:40.039888 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-883d57cb-6c57-4643-abb4-ba4bf6735b7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:40.040345 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-883d57cb-6c57-4643-abb4-ba4bf6735b7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:40.040766 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-883d57cb-6c57-4643-abb4-ba4bf6735b7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:40.103882 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-883d57cb-6c57-4643-abb4-ba4bf6735b7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:40.112199 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-883d57cb-6c57-4643-abb4-ba4bf6735b7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085738 Aug 04 23:29:40.112764 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 715/1398] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:40 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:41.132919 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a28819db-14df-44be-82b8-07de3523cbb3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:41.133477 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a28819db-14df-44be-82b8-07de3523cbb3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:41.139853 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a28819db-14df-44be-82b8-07de3523cbb3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:41.140338 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a28819db-14df-44be-82b8-07de3523cbb3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:41.140773 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a28819db-14df-44be-82b8-07de3523cbb3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:41.141505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a28819db-14df-44be-82b8-07de3523cbb3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:41.141959 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a28819db-14df-44be-82b8-07de3523cbb3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:41.142524 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a28819db-14df-44be-82b8-07de3523cbb3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:41.205755 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a28819db-14df-44be-82b8-07de3523cbb3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:41.213933 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a28819db-14df-44be-82b8-07de3523cbb3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084965 Aug 04 23:29:41.214577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 684/1399] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:41 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:42.235372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-30bf27ae-6404-4725-a21b-0a67677b6773 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:42.237049 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-30bf27ae-6404-4725-a21b-0a67677b6773 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:42.243271 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-30bf27ae-6404-4725-a21b-0a67677b6773 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:42.243744 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-30bf27ae-6404-4725-a21b-0a67677b6773 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:42.244168 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-30bf27ae-6404-4725-a21b-0a67677b6773 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:42.244849 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-30bf27ae-6404-4725-a21b-0a67677b6773 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:42.245298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-30bf27ae-6404-4725-a21b-0a67677b6773 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:42.245710 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-30bf27ae-6404-4725-a21b-0a67677b6773 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:42.311004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-30bf27ae-6404-4725-a21b-0a67677b6773 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:42.319442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-30bf27ae-6404-4725-a21b-0a67677b6773 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087923 Aug 04 23:29:42.319992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 716/1400] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:42 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:43.340531 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7d2823b4-4bde-428c-b497-2b53722ca5f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:43.341136 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7d2823b4-4bde-428c-b497-2b53722ca5f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:43.348574 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d2823b4-4bde-428c-b497-2b53722ca5f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:43.349063 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d2823b4-4bde-428c-b497-2b53722ca5f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:43.349532 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d2823b4-4bde-428c-b497-2b53722ca5f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:43.350233 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d2823b4-4bde-428c-b497-2b53722ca5f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:43.350725 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d2823b4-4bde-428c-b497-2b53722ca5f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:43.351157 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d2823b4-4bde-428c-b497-2b53722ca5f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:43.411880 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7d2823b4-4bde-428c-b497-2b53722ca5f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:43.419916 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7d2823b4-4bde-428c-b497-2b53722ca5f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083121 Aug 04 23:29:43.420513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 685/1401] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:43 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:44.442111 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-87d7b28a-61a5-4e29-8404-900d5880e87f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:44.442769 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-87d7b28a-61a5-4e29-8404-900d5880e87f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:44.449665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-87d7b28a-61a5-4e29-8404-900d5880e87f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:44.450140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-87d7b28a-61a5-4e29-8404-900d5880e87f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:44.450598 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-87d7b28a-61a5-4e29-8404-900d5880e87f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:44.451283 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-87d7b28a-61a5-4e29-8404-900d5880e87f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:44.451727 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-87d7b28a-61a5-4e29-8404-900d5880e87f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:44.452139 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-87d7b28a-61a5-4e29-8404-900d5880e87f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:44.514721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-87d7b28a-61a5-4e29-8404-900d5880e87f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:44.522277 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-87d7b28a-61a5-4e29-8404-900d5880e87f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084655 Aug 04 23:29:44.522862 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 717/1402] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:44 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:29:45.542738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f131ab9e-7e3e-441a-bb09-86699bbc8d39 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:45.543345 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f131ab9e-7e3e-441a-bb09-86699bbc8d39 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:45.549771 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f131ab9e-7e3e-441a-bb09-86699bbc8d39 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:45.550494 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f131ab9e-7e3e-441a-bb09-86699bbc8d39 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:45.550939 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f131ab9e-7e3e-441a-bb09-86699bbc8d39 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:45.551635 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f131ab9e-7e3e-441a-bb09-86699bbc8d39 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:45.552092 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f131ab9e-7e3e-441a-bb09-86699bbc8d39 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:45.552519 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f131ab9e-7e3e-441a-bb09-86699bbc8d39 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:45.616781 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f131ab9e-7e3e-441a-bb09-86699bbc8d39 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:45.624682 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f131ab9e-7e3e-441a-bb09-86699bbc8d39 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085932 Aug 04 23:29:45.625254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 686/1403] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:45 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:46.646919 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9a4e1f27-9b61-4933-8dab-cbce6608be82 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:46.647558 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9a4e1f27-9b61-4933-8dab-cbce6608be82 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:46.653886 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9a4e1f27-9b61-4933-8dab-cbce6608be82 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:46.654383 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9a4e1f27-9b61-4933-8dab-cbce6608be82 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:46.654820 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9a4e1f27-9b61-4933-8dab-cbce6608be82 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:46.655499 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9a4e1f27-9b61-4933-8dab-cbce6608be82 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:46.655989 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9a4e1f27-9b61-4933-8dab-cbce6608be82 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:46.656402 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9a4e1f27-9b61-4933-8dab-cbce6608be82 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:46.724499 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9a4e1f27-9b61-4933-8dab-cbce6608be82 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:46.731909 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9a4e1f27-9b61-4933-8dab-cbce6608be82 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089796 Aug 04 23:29:46.732460 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 718/1404] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:46 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:47.752986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3f5c69ba-def0-49b9-9de4-d365378634a8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:47.753745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3f5c69ba-def0-49b9-9de4-d365378634a8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:47.760266 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3f5c69ba-def0-49b9-9de4-d365378634a8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:47.760748 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3f5c69ba-def0-49b9-9de4-d365378634a8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:47.761181 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3f5c69ba-def0-49b9-9de4-d365378634a8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:47.761874 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3f5c69ba-def0-49b9-9de4-d365378634a8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:47.762325 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3f5c69ba-def0-49b9-9de4-d365378634a8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:47.762776 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3f5c69ba-def0-49b9-9de4-d365378634a8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:47.825212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3f5c69ba-def0-49b9-9de4-d365378634a8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:47.833606 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3f5c69ba-def0-49b9-9de4-d365378634a8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084558 Aug 04 23:29:47.834318 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 687/1405] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:47 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:48.855587 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3cb71ab6-4b5c-477b-adf7-2854e2349762 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:48.856195 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3cb71ab6-4b5c-477b-adf7-2854e2349762 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:48.863059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3cb71ab6-4b5c-477b-adf7-2854e2349762 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:48.863531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3cb71ab6-4b5c-477b-adf7-2854e2349762 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:48.863956 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3cb71ab6-4b5c-477b-adf7-2854e2349762 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:48.864638 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3cb71ab6-4b5c-477b-adf7-2854e2349762 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:48.865085 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3cb71ab6-4b5c-477b-adf7-2854e2349762 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:48.865499 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3cb71ab6-4b5c-477b-adf7-2854e2349762 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:48.928818 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3cb71ab6-4b5c-477b-adf7-2854e2349762 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:48.936366 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3cb71ab6-4b5c-477b-adf7-2854e2349762 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084608 Aug 04 23:29:48.936913 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 719/1406] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:48 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:49.401172 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b6d62317-f843-4de0-8c20-61f0cb40570e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:29:49.401780 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b6d62317-f843-4de0-8c20-61f0cb40570e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:49.408131 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b6d62317-f843-4de0-8c20-61f0cb40570e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:49.408603 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b6d62317-f843-4de0-8c20-61f0cb40570e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:49.409035 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b6d62317-f843-4de0-8c20-61f0cb40570e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:49.410863 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b6d62317-f843-4de0-8c20-61f0cb40570e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:49.411275 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b6d62317-f843-4de0-8c20-61f0cb40570e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:49.411695 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b6d62317-f843-4de0-8c20-61f0cb40570e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:49.436082 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.objects.instance [None req-b6d62317-f843-4de0-8c20-61f0cb40570e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lazy-loading 'flavor' on Instance uuid 7a0c9ea5-2710-4533-b166-010d46ab0027 {{(pid=129790) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:29:49.507457 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b6d62317-f843-4de0-8c20-61f0cb40570e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "POST /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027/action" status: 202 len: 0 microversion: 2.1 time: 0.110009 Aug 04 23:29:49.508049 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 688/1407] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Aug 4 23:29:49 2022] POST /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:29:49.517115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7ed01742-ca8c-4686-9e05-b191e5e8e299 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:49.517811 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7ed01742-ca8c-4686-9e05-b191e5e8e299 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:49.524422 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7ed01742-ca8c-4686-9e05-b191e5e8e299 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:49.524955 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7ed01742-ca8c-4686-9e05-b191e5e8e299 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:49.525519 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7ed01742-ca8c-4686-9e05-b191e5e8e299 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:49.526250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7ed01742-ca8c-4686-9e05-b191e5e8e299 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:49.526874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7ed01742-ca8c-4686-9e05-b191e5e8e299 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:49.527328 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7ed01742-ca8c-4686-9e05-b191e5e8e299 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:49.662332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7ed01742-ca8c-4686-9e05-b191e5e8e299 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:49.670003 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7ed01742-ca8c-4686-9e05-b191e5e8e299 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.156995 Aug 04 23:29:49.670596 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 720/1408] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:49 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:49.959315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d1ab09ec-fc02-46d4-accd-bc9177c65560 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:49.960010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d1ab09ec-fc02-46d4-accd-bc9177c65560 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:49.966157 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1ab09ec-fc02-46d4-accd-bc9177c65560 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:49.966653 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1ab09ec-fc02-46d4-accd-bc9177c65560 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:49.967088 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1ab09ec-fc02-46d4-accd-bc9177c65560 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:49.967772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1ab09ec-fc02-46d4-accd-bc9177c65560 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:49.968219 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1ab09ec-fc02-46d4-accd-bc9177c65560 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:49.968686 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1ab09ec-fc02-46d4-accd-bc9177c65560 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:50.038113 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d1ab09ec-fc02-46d4-accd-bc9177c65560 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:50.048608 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d1ab09ec-fc02-46d4-accd-bc9177c65560 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.094073 Aug 04 23:29:50.049177 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 689/1409] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:49 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:50.691922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-dedb22a7-2a9c-44cd-bea2-3ded95c99c4d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:50.692603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-dedb22a7-2a9c-44cd-bea2-3ded95c99c4d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:50.699429 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dedb22a7-2a9c-44cd-bea2-3ded95c99c4d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:50.699909 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dedb22a7-2a9c-44cd-bea2-3ded95c99c4d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:50.700348 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dedb22a7-2a9c-44cd-bea2-3ded95c99c4d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:50.701041 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dedb22a7-2a9c-44cd-bea2-3ded95c99c4d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:50.701494 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dedb22a7-2a9c-44cd-bea2-3ded95c99c4d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:50.701926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dedb22a7-2a9c-44cd-bea2-3ded95c99c4d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:50.834730 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-dedb22a7-2a9c-44cd-bea2-3ded95c99c4d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:50.842347 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-dedb22a7-2a9c-44cd-bea2-3ded95c99c4d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.155433 Aug 04 23:29:50.842933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 721/1410] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:50 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:51.069975 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6a924f71-2bb2-43a9-b5c2-7810d31d916c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:51.070557 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6a924f71-2bb2-43a9-b5c2-7810d31d916c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:51.077145 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a924f71-2bb2-43a9-b5c2-7810d31d916c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:51.077623 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a924f71-2bb2-43a9-b5c2-7810d31d916c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:51.078068 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a924f71-2bb2-43a9-b5c2-7810d31d916c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:51.078775 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a924f71-2bb2-43a9-b5c2-7810d31d916c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:51.079224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a924f71-2bb2-43a9-b5c2-7810d31d916c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:51.079646 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6a924f71-2bb2-43a9-b5c2-7810d31d916c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:51.148546 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6a924f71-2bb2-43a9-b5c2-7810d31d916c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:51.156119 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6a924f71-2bb2-43a9-b5c2-7810d31d916c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.090853 Aug 04 23:29:51.156667 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 690/1411] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:51 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:51.865479 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-44658534-92db-4fc4-9eeb-abbca45005d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:51.866856 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-44658534-92db-4fc4-9eeb-abbca45005d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:51.873681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44658534-92db-4fc4-9eeb-abbca45005d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:51.874164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44658534-92db-4fc4-9eeb-abbca45005d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:51.874697 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44658534-92db-4fc4-9eeb-abbca45005d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:51.875390 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44658534-92db-4fc4-9eeb-abbca45005d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:51.875835 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44658534-92db-4fc4-9eeb-abbca45005d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:51.876252 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44658534-92db-4fc4-9eeb-abbca45005d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:52.009137 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-44658534-92db-4fc4-9eeb-abbca45005d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:52.016631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-44658534-92db-4fc4-9eeb-abbca45005d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.156226 Aug 04 23:29:52.017384 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 722/1412] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:51 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:52.177149 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7a114c3e-92a4-4119-b2cd-b1d0f5777aa8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:52.177811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7a114c3e-92a4-4119-b2cd-b1d0f5777aa8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:52.184368 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a114c3e-92a4-4119-b2cd-b1d0f5777aa8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:52.184851 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a114c3e-92a4-4119-b2cd-b1d0f5777aa8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:52.185278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a114c3e-92a4-4119-b2cd-b1d0f5777aa8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:52.186008 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a114c3e-92a4-4119-b2cd-b1d0f5777aa8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:52.186441 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a114c3e-92a4-4119-b2cd-b1d0f5777aa8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:52.186865 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a114c3e-92a4-4119-b2cd-b1d0f5777aa8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:52.250280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7a114c3e-92a4-4119-b2cd-b1d0f5777aa8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:52.257800 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7a114c3e-92a4-4119-b2cd-b1d0f5777aa8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085376 Aug 04 23:29:52.258372 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 691/1413] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:52 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:53.038117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8e61099e-7573-4d3b-9bea-73ead0205125 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:53.038749 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8e61099e-7573-4d3b-9bea-73ead0205125 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:53.044749 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e61099e-7573-4d3b-9bea-73ead0205125 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:53.045219 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e61099e-7573-4d3b-9bea-73ead0205125 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:53.045647 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e61099e-7573-4d3b-9bea-73ead0205125 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:53.046325 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e61099e-7573-4d3b-9bea-73ead0205125 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:53.046807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e61099e-7573-4d3b-9bea-73ead0205125 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:53.047223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e61099e-7573-4d3b-9bea-73ead0205125 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:53.181829 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8e61099e-7573-4d3b-9bea-73ead0205125 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:53.189272 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8e61099e-7573-4d3b-9bea-73ead0205125 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.156103 Aug 04 23:29:53.189826 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 723/1414] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:53 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:53.283600 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a6762708-2286-4cb8-905d-587a255b513a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:53.284186 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a6762708-2286-4cb8-905d-587a255b513a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:53.291981 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a6762708-2286-4cb8-905d-587a255b513a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:53.292459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a6762708-2286-4cb8-905d-587a255b513a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:53.292886 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a6762708-2286-4cb8-905d-587a255b513a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:53.293570 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a6762708-2286-4cb8-905d-587a255b513a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:53.294014 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a6762708-2286-4cb8-905d-587a255b513a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:53.294460 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a6762708-2286-4cb8-905d-587a255b513a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:53.358733 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a6762708-2286-4cb8-905d-587a255b513a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:53.367175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a6762708-2286-4cb8-905d-587a255b513a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087929 Aug 04 23:29:53.367774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 692/1415] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:53 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:54.211031 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ae790e1a-1a85-4bb2-a287-4fa6b424916f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:54.211644 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ae790e1a-1a85-4bb2-a287-4fa6b424916f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:54.218040 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae790e1a-1a85-4bb2-a287-4fa6b424916f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:54.218562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae790e1a-1a85-4bb2-a287-4fa6b424916f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:54.218995 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae790e1a-1a85-4bb2-a287-4fa6b424916f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:54.219683 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae790e1a-1a85-4bb2-a287-4fa6b424916f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:54.220133 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae790e1a-1a85-4bb2-a287-4fa6b424916f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:54.220551 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae790e1a-1a85-4bb2-a287-4fa6b424916f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:54.359043 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ae790e1a-1a85-4bb2-a287-4fa6b424916f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:54.367260 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ae790e1a-1a85-4bb2-a287-4fa6b424916f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.160042 Aug 04 23:29:54.367818 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 724/1416] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:54 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:54.387578 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c06fa845-be8c-44a8-afc7-cad70fb4231d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:54.388184 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c06fa845-be8c-44a8-afc7-cad70fb4231d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:54.394785 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c06fa845-be8c-44a8-afc7-cad70fb4231d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:54.395278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c06fa845-be8c-44a8-afc7-cad70fb4231d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:54.395687 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c06fa845-be8c-44a8-afc7-cad70fb4231d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:54.396368 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c06fa845-be8c-44a8-afc7-cad70fb4231d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:54.396809 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c06fa845-be8c-44a8-afc7-cad70fb4231d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:54.397226 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c06fa845-be8c-44a8-afc7-cad70fb4231d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:54.462972 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c06fa845-be8c-44a8-afc7-cad70fb4231d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:54.470407 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c06fa845-be8c-44a8-afc7-cad70fb4231d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086581 Aug 04 23:29:54.470970 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 693/1417] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:54 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:55.387620 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-336b3699-f29d-475a-9f50-20214fdd24e5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:55.388233 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-336b3699-f29d-475a-9f50-20214fdd24e5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:55.395360 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-336b3699-f29d-475a-9f50-20214fdd24e5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:55.395841 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-336b3699-f29d-475a-9f50-20214fdd24e5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:55.396269 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-336b3699-f29d-475a-9f50-20214fdd24e5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:55.396958 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-336b3699-f29d-475a-9f50-20214fdd24e5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:55.397404 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-336b3699-f29d-475a-9f50-20214fdd24e5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:55.397823 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-336b3699-f29d-475a-9f50-20214fdd24e5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:55.491707 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9cad123d-da94-45d7-b514-43db5a96f510 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:55.492390 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9cad123d-da94-45d7-b514-43db5a96f510 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:55.499039 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cad123d-da94-45d7-b514-43db5a96f510 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:55.499660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cad123d-da94-45d7-b514-43db5a96f510 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:55.500100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cad123d-da94-45d7-b514-43db5a96f510 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:55.500839 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cad123d-da94-45d7-b514-43db5a96f510 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:55.501486 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cad123d-da94-45d7-b514-43db5a96f510 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:55.501711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cad123d-da94-45d7-b514-43db5a96f510 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:55.530962 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-336b3699-f29d-475a-9f50-20214fdd24e5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:55.539364 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-336b3699-f29d-475a-9f50-20214fdd24e5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.155488 Aug 04 23:29:55.539937 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 725/1418] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:55 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:55.565967 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9cad123d-da94-45d7-b514-43db5a96f510 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:55.574609 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9cad123d-da94-45d7-b514-43db5a96f510 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086327 Aug 04 23:29:55.575398 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 694/1419] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:55 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:29:56.562847 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4204bac9-35c5-47bd-9fe6-a8aee155a542 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:56.563464 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4204bac9-35c5-47bd-9fe6-a8aee155a542 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:56.570264 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4204bac9-35c5-47bd-9fe6-a8aee155a542 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:56.570778 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4204bac9-35c5-47bd-9fe6-a8aee155a542 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:56.571210 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4204bac9-35c5-47bd-9fe6-a8aee155a542 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:56.571907 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4204bac9-35c5-47bd-9fe6-a8aee155a542 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:56.572384 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4204bac9-35c5-47bd-9fe6-a8aee155a542 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:56.572807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4204bac9-35c5-47bd-9fe6-a8aee155a542 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:56.596016 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c90069cc-81be-4c03-8ff0-01b488a36300 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:56.597430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c90069cc-81be-4c03-8ff0-01b488a36300 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:56.599707 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=36 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:29:56.605146 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c90069cc-81be-4c03-8ff0-01b488a36300 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:56.605650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c90069cc-81be-4c03-8ff0-01b488a36300 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:56.606087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c90069cc-81be-4c03-8ff0-01b488a36300 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:56.606815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c90069cc-81be-4c03-8ff0-01b488a36300 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:56.607264 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c90069cc-81be-4c03-8ff0-01b488a36300 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:56.607686 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c90069cc-81be-4c03-8ff0-01b488a36300 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:56.680632 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c90069cc-81be-4c03-8ff0-01b488a36300 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:56.682900 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:29:56.690447 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c90069cc-81be-4c03-8ff0-01b488a36300 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.098169 Aug 04 23:29:56.691029 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 695/1420] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:56 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:29:56.748797 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4204bac9-35c5-47bd-9fe6-a8aee155a542 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:56.758198 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4204bac9-35c5-47bd-9fe6-a8aee155a542 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.199665 Aug 04 23:29:56.758805 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 726/1421] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:56 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:57.720072 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-84806e7f-1835-40d6-bbf9-58fe31a305a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:57.720631 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-84806e7f-1835-40d6-bbf9-58fe31a305a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:57.728365 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-84806e7f-1835-40d6-bbf9-58fe31a305a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:57.728847 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-84806e7f-1835-40d6-bbf9-58fe31a305a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:57.729290 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-84806e7f-1835-40d6-bbf9-58fe31a305a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:57.729984 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-84806e7f-1835-40d6-bbf9-58fe31a305a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:57.730522 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-84806e7f-1835-40d6-bbf9-58fe31a305a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:57.730950 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-84806e7f-1835-40d6-bbf9-58fe31a305a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:57.779067 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f98dc962-346c-40c0-94e7-fdf513c27c56 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:57.779657 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f98dc962-346c-40c0-94e7-fdf513c27c56 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:57.781921 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=36 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:29:57.788626 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f98dc962-346c-40c0-94e7-fdf513c27c56 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:57.789098 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f98dc962-346c-40c0-94e7-fdf513c27c56 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:57.789525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f98dc962-346c-40c0-94e7-fdf513c27c56 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:57.790219 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f98dc962-346c-40c0-94e7-fdf513c27c56 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:57.790686 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f98dc962-346c-40c0-94e7-fdf513c27c56 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:57.791103 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f98dc962-346c-40c0-94e7-fdf513c27c56 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:57.795011 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-84806e7f-1835-40d6-bbf9-58fe31a305a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:57.803221 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-84806e7f-1835-40d6-bbf9-58fe31a305a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087418 Aug 04 23:29:57.803794 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 696/1422] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:57 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:57.929490 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f98dc962-346c-40c0-94e7-fdf513c27c56 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:57.931700 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:29:57.938197 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f98dc962-346c-40c0-94e7-fdf513c27c56 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.162895 Aug 04 23:29:57.938780 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 727/1423] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:57 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:29:58.824421 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9d4282d6-62b8-47d3-a521-5ec909676686 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:58.824950 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9d4282d6-62b8-47d3-a521-5ec909676686 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:58.831921 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d4282d6-62b8-47d3-a521-5ec909676686 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:58.832409 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d4282d6-62b8-47d3-a521-5ec909676686 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:58.832847 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d4282d6-62b8-47d3-a521-5ec909676686 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:58.833546 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d4282d6-62b8-47d3-a521-5ec909676686 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:58.833998 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d4282d6-62b8-47d3-a521-5ec909676686 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:58.834451 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d4282d6-62b8-47d3-a521-5ec909676686 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:58.896002 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9d4282d6-62b8-47d3-a521-5ec909676686 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:58.903511 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9d4282d6-62b8-47d3-a521-5ec909676686 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083313 Aug 04 23:29:58.904074 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 697/1424] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:58 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:58.959781 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-969df931-5f60-47b0-a5c3-5eab9a021733 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:58.960414 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-969df931-5f60-47b0-a5c3-5eab9a021733 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:58.966937 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-969df931-5f60-47b0-a5c3-5eab9a021733 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:58.967439 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-969df931-5f60-47b0-a5c3-5eab9a021733 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:58.967856 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-969df931-5f60-47b0-a5c3-5eab9a021733 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:58.968546 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-969df931-5f60-47b0-a5c3-5eab9a021733 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:58.969001 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-969df931-5f60-47b0-a5c3-5eab9a021733 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:58.969427 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-969df931-5f60-47b0-a5c3-5eab9a021733 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:59.106421 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-969df931-5f60-47b0-a5c3-5eab9a021733 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:29:59.114454 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-969df931-5f60-47b0-a5c3-5eab9a021733 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.159006 Aug 04 23:29:59.115016 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 728/1425] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:58 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:29:59.928583 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-77859846-9b93-4a68-94eb-2c16856cc150 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:29:59.929692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-77859846-9b93-4a68-94eb-2c16856cc150 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:29:59.937713 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77859846-9b93-4a68-94eb-2c16856cc150 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:59.938314 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77859846-9b93-4a68-94eb-2c16856cc150 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:59.938672 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77859846-9b93-4a68-94eb-2c16856cc150 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:29:59.939570 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77859846-9b93-4a68-94eb-2c16856cc150 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:29:59.940558 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77859846-9b93-4a68-94eb-2c16856cc150 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:29:59.941248 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77859846-9b93-4a68-94eb-2c16856cc150 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:00.012707 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-77859846-9b93-4a68-94eb-2c16856cc150 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:00.023257 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-77859846-9b93-4a68-94eb-2c16856cc150 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.102614 Aug 04 23:30:00.029270 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 698/1426] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:29:59 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:00.135690 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-eba53ae3-8cf4-4161-9dcb-47aa354c4fb3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:00.136372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-eba53ae3-8cf4-4161-9dcb-47aa354c4fb3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:00.142819 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eba53ae3-8cf4-4161-9dcb-47aa354c4fb3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:00.143995 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eba53ae3-8cf4-4161-9dcb-47aa354c4fb3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:00.144479 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eba53ae3-8cf4-4161-9dcb-47aa354c4fb3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:00.145361 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eba53ae3-8cf4-4161-9dcb-47aa354c4fb3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:00.145841 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eba53ae3-8cf4-4161-9dcb-47aa354c4fb3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:00.146270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eba53ae3-8cf4-4161-9dcb-47aa354c4fb3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:00.280565 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-eba53ae3-8cf4-4161-9dcb-47aa354c4fb3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:00.288783 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-eba53ae3-8cf4-4161-9dcb-47aa354c4fb3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.156962 Aug 04 23:30:00.289350 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 729/1427] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:00 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:01.045108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3e830ecb-559e-47c3-9c04-feaf03e93350 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:01.045715 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3e830ecb-559e-47c3-9c04-feaf03e93350 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:01.052764 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e830ecb-559e-47c3-9c04-feaf03e93350 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:01.053250 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e830ecb-559e-47c3-9c04-feaf03e93350 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:01.053687 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e830ecb-559e-47c3-9c04-feaf03e93350 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:01.054431 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e830ecb-559e-47c3-9c04-feaf03e93350 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:01.055162 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e830ecb-559e-47c3-9c04-feaf03e93350 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:01.055594 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e830ecb-559e-47c3-9c04-feaf03e93350 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:01.117675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3e830ecb-559e-47c3-9c04-feaf03e93350 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:01.125126 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3e830ecb-559e-47c3-9c04-feaf03e93350 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083927 Aug 04 23:30:01.125686 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 699/1428] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:01 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:01.309493 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4cd9e218-3f5a-4385-baf1-b93eb4016bb5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:01.310096 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4cd9e218-3f5a-4385-baf1-b93eb4016bb5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:01.316674 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4cd9e218-3f5a-4385-baf1-b93eb4016bb5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:01.317166 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4cd9e218-3f5a-4385-baf1-b93eb4016bb5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:01.317566 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4cd9e218-3f5a-4385-baf1-b93eb4016bb5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:01.318244 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4cd9e218-3f5a-4385-baf1-b93eb4016bb5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:01.318721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4cd9e218-3f5a-4385-baf1-b93eb4016bb5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:01.319138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4cd9e218-3f5a-4385-baf1-b93eb4016bb5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:01.459473 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4cd9e218-3f5a-4385-baf1-b93eb4016bb5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:01.468439 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4cd9e218-3f5a-4385-baf1-b93eb4016bb5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.162820 Aug 04 23:30:01.469000 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 730/1429] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:01 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:02.147161 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a469659b-e59a-47ea-8f45-c57b4bc39f9a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:02.147766 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a469659b-e59a-47ea-8f45-c57b4bc39f9a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:02.154140 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a469659b-e59a-47ea-8f45-c57b4bc39f9a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:02.154645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a469659b-e59a-47ea-8f45-c57b4bc39f9a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:02.155094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a469659b-e59a-47ea-8f45-c57b4bc39f9a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:02.155787 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a469659b-e59a-47ea-8f45-c57b4bc39f9a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:02.156237 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a469659b-e59a-47ea-8f45-c57b4bc39f9a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:02.156657 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a469659b-e59a-47ea-8f45-c57b4bc39f9a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:02.218509 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a469659b-e59a-47ea-8f45-c57b4bc39f9a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:02.226085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a469659b-e59a-47ea-8f45-c57b4bc39f9a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083449 Aug 04 23:30:02.226696 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 700/1430] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:02 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:02.490246 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-de244933-8002-487c-a71f-4b86538f056d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:02.490880 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-de244933-8002-487c-a71f-4b86538f056d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:02.497352 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de244933-8002-487c-a71f-4b86538f056d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:02.497824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de244933-8002-487c-a71f-4b86538f056d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:02.498254 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de244933-8002-487c-a71f-4b86538f056d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:02.498974 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de244933-8002-487c-a71f-4b86538f056d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:02.499422 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de244933-8002-487c-a71f-4b86538f056d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:02.499835 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de244933-8002-487c-a71f-4b86538f056d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:02.629977 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-de244933-8002-487c-a71f-4b86538f056d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:02.637784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-de244933-8002-487c-a71f-4b86538f056d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.152020 Aug 04 23:30:02.638348 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 731/1431] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:02 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:03.247906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-81c27888-9731-408d-8690-6dcbc6dfef31 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:03.250014 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-81c27888-9731-408d-8690-6dcbc6dfef31 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:03.260892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81c27888-9731-408d-8690-6dcbc6dfef31 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:03.261377 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81c27888-9731-408d-8690-6dcbc6dfef31 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:03.261804 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81c27888-9731-408d-8690-6dcbc6dfef31 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:03.262526 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81c27888-9731-408d-8690-6dcbc6dfef31 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:03.263182 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81c27888-9731-408d-8690-6dcbc6dfef31 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:03.264015 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81c27888-9731-408d-8690-6dcbc6dfef31 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:03.347380 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-81c27888-9731-408d-8690-6dcbc6dfef31 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:03.356415 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-81c27888-9731-408d-8690-6dcbc6dfef31 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.112933 Aug 04 23:30:03.357346 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 701/1432] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:03 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:03.659688 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-325b2394-d13c-4774-84b3-207c55f806d4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:03.660516 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-325b2394-d13c-4774-84b3-207c55f806d4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:03.667327 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-325b2394-d13c-4774-84b3-207c55f806d4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:03.667830 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-325b2394-d13c-4774-84b3-207c55f806d4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:03.668258 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-325b2394-d13c-4774-84b3-207c55f806d4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:03.668953 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-325b2394-d13c-4774-84b3-207c55f806d4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:03.669397 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-325b2394-d13c-4774-84b3-207c55f806d4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:03.669813 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-325b2394-d13c-4774-84b3-207c55f806d4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:03.803654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-325b2394-d13c-4774-84b3-207c55f806d4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:03.811200 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-325b2394-d13c-4774-84b3-207c55f806d4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.156019 Aug 04 23:30:03.811765 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 732/1433] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:03 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:04.377125 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f689a4f2-2bf8-4946-bdec-5d4a907dff26 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:04.378273 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f689a4f2-2bf8-4946-bdec-5d4a907dff26 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:04.385089 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f689a4f2-2bf8-4946-bdec-5d4a907dff26 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:04.385574 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f689a4f2-2bf8-4946-bdec-5d4a907dff26 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:04.386008 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f689a4f2-2bf8-4946-bdec-5d4a907dff26 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:04.386725 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f689a4f2-2bf8-4946-bdec-5d4a907dff26 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:04.387177 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f689a4f2-2bf8-4946-bdec-5d4a907dff26 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:04.387591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f689a4f2-2bf8-4946-bdec-5d4a907dff26 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:04.449428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f689a4f2-2bf8-4946-bdec-5d4a907dff26 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:04.457692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f689a4f2-2bf8-4946-bdec-5d4a907dff26 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084419 Aug 04 23:30:04.458254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 702/1434] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:04 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:04.831872 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-88415b42-2ca9-4802-99b8-bfa88c40ac46 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:04.832482 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-88415b42-2ca9-4802-99b8-bfa88c40ac46 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:04.838957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-88415b42-2ca9-4802-99b8-bfa88c40ac46 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:04.839433 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-88415b42-2ca9-4802-99b8-bfa88c40ac46 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:04.839864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-88415b42-2ca9-4802-99b8-bfa88c40ac46 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:04.840541 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-88415b42-2ca9-4802-99b8-bfa88c40ac46 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:04.840981 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-88415b42-2ca9-4802-99b8-bfa88c40ac46 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:04.841391 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-88415b42-2ca9-4802-99b8-bfa88c40ac46 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:04.977913 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-88415b42-2ca9-4802-99b8-bfa88c40ac46 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:04.985768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-88415b42-2ca9-4802-99b8-bfa88c40ac46 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.158032 Aug 04 23:30:04.986385 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 733/1435] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:04 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:05.080538 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-c68bef5f-3b32-4299-a37d-b8269284e116 req-22afeb71-aeb1-4e99-9921-15a6df0df9cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a0c9ea5-2710-4533-b166-010d46ab0027", "name": "network-vif-unplugged", "status": "completed", "tag": "288e902d-3b66-41d9-a3c5-5e1bbfb5e18b"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:30:05.090207 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-c68bef5f-3b32-4299-a37d-b8269284e116 req-22afeb71-aeb1-4e99-9921-15a6df0df9cb service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:05.090711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-c68bef5f-3b32-4299-a37d-b8269284e116 req-22afeb71-aeb1-4e99-9921-15a6df0df9cb service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:05.091247 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-c68bef5f-3b32-4299-a37d-b8269284e116 req-22afeb71-aeb1-4e99-9921-15a6df0df9cb service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:05.103236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-c68bef5f-3b32-4299-a37d-b8269284e116 req-22afeb71-aeb1-4e99-9921-15a6df0df9cb service nova] Creating event network-vif-unplugged:288e902d-3b66-41d9-a3c5-5e1bbfb5e18b for instance 7a0c9ea5-2710-4533-b166-010d46ab0027 on hv-cinder-85221 Aug 04 23:30:05.108313 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-c68bef5f-3b32-4299-a37d-b8269284e116 req-22afeb71-aeb1-4e99-9921-15a6df0df9cb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031446 Aug 04 23:30:05.109069 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 703/1436] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:30:05.478847 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-79e61f50-8ae0-4485-8d1d-e027ffb08baa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:05.479453 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-79e61f50-8ae0-4485-8d1d-e027ffb08baa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:05.485492 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79e61f50-8ae0-4485-8d1d-e027ffb08baa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:05.485973 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79e61f50-8ae0-4485-8d1d-e027ffb08baa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:05.486423 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79e61f50-8ae0-4485-8d1d-e027ffb08baa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:05.487167 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79e61f50-8ae0-4485-8d1d-e027ffb08baa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:05.488276 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79e61f50-8ae0-4485-8d1d-e027ffb08baa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:05.488887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79e61f50-8ae0-4485-8d1d-e027ffb08baa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:05.553185 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-79e61f50-8ae0-4485-8d1d-e027ffb08baa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:05.560674 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-79e61f50-8ae0-4485-8d1d-e027ffb08baa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085717 Aug 04 23:30:05.561231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 734/1437] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:05 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:06.010435 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e225d519-4660-48c7-be25-b4166414792c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:06.011239 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e225d519-4660-48c7-be25-b4166414792c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:06.018171 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e225d519-4660-48c7-be25-b4166414792c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:06.019406 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e225d519-4660-48c7-be25-b4166414792c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:06.019847 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e225d519-4660-48c7-be25-b4166414792c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:06.020544 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e225d519-4660-48c7-be25-b4166414792c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:06.020992 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e225d519-4660-48c7-be25-b4166414792c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:06.021523 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e225d519-4660-48c7-be25-b4166414792c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:06.156241 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e225d519-4660-48c7-be25-b4166414792c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:06.164106 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e225d519-4660-48c7-be25-b4166414792c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.158411 Aug 04 23:30:06.164697 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 704/1438] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:06 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:06.581738 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d77c1891-179b-4088-866c-2bc7c75065ca tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:06.582389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d77c1891-179b-4088-866c-2bc7c75065ca tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:06.588983 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d77c1891-179b-4088-866c-2bc7c75065ca tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:06.589461 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d77c1891-179b-4088-866c-2bc7c75065ca tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:06.589950 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d77c1891-179b-4088-866c-2bc7c75065ca tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:06.590669 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d77c1891-179b-4088-866c-2bc7c75065ca tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:06.591107 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d77c1891-179b-4088-866c-2bc7c75065ca tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:06.591522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d77c1891-179b-4088-866c-2bc7c75065ca tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:06.655876 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d77c1891-179b-4088-866c-2bc7c75065ca tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:06.664674 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d77c1891-179b-4088-866c-2bc7c75065ca tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086772 Aug 04 23:30:06.665243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 735/1439] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:06 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:07.185208 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2319b745-44f5-40e0-91f5-b0198fccb946 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:07.185819 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2319b745-44f5-40e0-91f5-b0198fccb946 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:07.192317 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2319b745-44f5-40e0-91f5-b0198fccb946 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:07.192795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2319b745-44f5-40e0-91f5-b0198fccb946 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:07.193229 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2319b745-44f5-40e0-91f5-b0198fccb946 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:07.193917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2319b745-44f5-40e0-91f5-b0198fccb946 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:07.194386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2319b745-44f5-40e0-91f5-b0198fccb946 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:07.194807 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2319b745-44f5-40e0-91f5-b0198fccb946 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:07.329892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2319b745-44f5-40e0-91f5-b0198fccb946 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:07.338262 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2319b745-44f5-40e0-91f5-b0198fccb946 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.156841 Aug 04 23:30:07.338839 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 705/1440] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:07 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:07.686237 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-addec212-6030-4b6e-8ce4-ab27ce1e690a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:07.686852 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-addec212-6030-4b6e-8ce4-ab27ce1e690a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:07.693874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-addec212-6030-4b6e-8ce4-ab27ce1e690a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:07.694354 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-addec212-6030-4b6e-8ce4-ab27ce1e690a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:07.694806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-addec212-6030-4b6e-8ce4-ab27ce1e690a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:07.695497 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-addec212-6030-4b6e-8ce4-ab27ce1e690a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:07.695943 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-addec212-6030-4b6e-8ce4-ab27ce1e690a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:07.696367 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-addec212-6030-4b6e-8ce4-ab27ce1e690a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:07.757800 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-addec212-6030-4b6e-8ce4-ab27ce1e690a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:07.765356 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-addec212-6030-4b6e-8ce4-ab27ce1e690a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.082931 Aug 04 23:30:07.765866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 736/1441] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:07 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:08.359691 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d02d0d58-fc36-4e3d-b4c9-50e8bd84895f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:08.360385 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d02d0d58-fc36-4e3d-b4c9-50e8bd84895f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:08.367852 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d02d0d58-fc36-4e3d-b4c9-50e8bd84895f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:08.368330 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d02d0d58-fc36-4e3d-b4c9-50e8bd84895f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:08.368756 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d02d0d58-fc36-4e3d-b4c9-50e8bd84895f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:08.369436 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d02d0d58-fc36-4e3d-b4c9-50e8bd84895f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:08.369875 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d02d0d58-fc36-4e3d-b4c9-50e8bd84895f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:08.370291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d02d0d58-fc36-4e3d-b4c9-50e8bd84895f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:08.506327 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d02d0d58-fc36-4e3d-b4c9-50e8bd84895f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:08.514301 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d02d0d58-fc36-4e3d-b4c9-50e8bd84895f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.158323 Aug 04 23:30:08.515000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 706/1442] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:08 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:08.786330 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5ba37e79-44d3-4188-8648-a41b3702e4ad tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:08.787002 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5ba37e79-44d3-4188-8648-a41b3702e4ad tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:08.793837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ba37e79-44d3-4188-8648-a41b3702e4ad tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:08.794317 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ba37e79-44d3-4188-8648-a41b3702e4ad tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:08.794784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ba37e79-44d3-4188-8648-a41b3702e4ad tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:08.795494 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ba37e79-44d3-4188-8648-a41b3702e4ad tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:08.795945 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ba37e79-44d3-4188-8648-a41b3702e4ad tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:08.796361 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ba37e79-44d3-4188-8648-a41b3702e4ad tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:08.860003 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5ba37e79-44d3-4188-8648-a41b3702e4ad tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:08.868276 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5ba37e79-44d3-4188-8648-a41b3702e4ad tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086315 Aug 04 23:30:08.868779 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 737/1443] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:08 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:09.535058 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3bd2c02e-75be-4dd6-8a41-2654c95cc452 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:09.535677 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3bd2c02e-75be-4dd6-8a41-2654c95cc452 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:09.542164 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3bd2c02e-75be-4dd6-8a41-2654c95cc452 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:09.542669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3bd2c02e-75be-4dd6-8a41-2654c95cc452 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:09.543112 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3bd2c02e-75be-4dd6-8a41-2654c95cc452 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:09.543801 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3bd2c02e-75be-4dd6-8a41-2654c95cc452 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:09.544262 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3bd2c02e-75be-4dd6-8a41-2654c95cc452 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:09.544682 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3bd2c02e-75be-4dd6-8a41-2654c95cc452 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:09.678604 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3bd2c02e-75be-4dd6-8a41-2654c95cc452 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:09.686527 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3bd2c02e-75be-4dd6-8a41-2654c95cc452 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.155625 Aug 04 23:30:09.687115 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 707/1444] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:09 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:09.889055 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c8ea3d51-cf3e-4293-adf4-2155d8afaa0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:09.889674 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c8ea3d51-cf3e-4293-adf4-2155d8afaa0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:09.896275 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8ea3d51-cf3e-4293-adf4-2155d8afaa0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:09.896755 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8ea3d51-cf3e-4293-adf4-2155d8afaa0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:09.897191 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8ea3d51-cf3e-4293-adf4-2155d8afaa0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:09.897884 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8ea3d51-cf3e-4293-adf4-2155d8afaa0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:09.898336 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8ea3d51-cf3e-4293-adf4-2155d8afaa0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:09.898785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c8ea3d51-cf3e-4293-adf4-2155d8afaa0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:09.966784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c8ea3d51-cf3e-4293-adf4-2155d8afaa0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:09.975590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c8ea3d51-cf3e-4293-adf4-2155d8afaa0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.090348 Aug 04 23:30:09.976167 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 738/1445] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:09 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:10.709177 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7c34555b-cf64-416a-9c4e-335839e1b8eb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:10.709774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7c34555b-cf64-416a-9c4e-335839e1b8eb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:10.716454 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7c34555b-cf64-416a-9c4e-335839e1b8eb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:10.716935 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7c34555b-cf64-416a-9c4e-335839e1b8eb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:10.717371 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7c34555b-cf64-416a-9c4e-335839e1b8eb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:10.718072 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7c34555b-cf64-416a-9c4e-335839e1b8eb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:10.718561 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7c34555b-cf64-416a-9c4e-335839e1b8eb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:10.718988 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7c34555b-cf64-416a-9c4e-335839e1b8eb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:10.857014 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7c34555b-cf64-416a-9c4e-335839e1b8eb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:10.865521 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7c34555b-cf64-416a-9c4e-335839e1b8eb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.160936 Aug 04 23:30:10.866094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 708/1446] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:10 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:10.996795 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-486483d5-ded5-4f81-aef5-5180d0caa8ad tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:10.997356 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-486483d5-ded5-4f81-aef5-5180d0caa8ad tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:11.004091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-486483d5-ded5-4f81-aef5-5180d0caa8ad tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:11.004572 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-486483d5-ded5-4f81-aef5-5180d0caa8ad tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:11.005004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-486483d5-ded5-4f81-aef5-5180d0caa8ad tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:11.005703 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-486483d5-ded5-4f81-aef5-5180d0caa8ad tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:11.006151 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-486483d5-ded5-4f81-aef5-5180d0caa8ad tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:11.006610 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-486483d5-ded5-4f81-aef5-5180d0caa8ad tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:11.069145 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-486483d5-ded5-4f81-aef5-5180d0caa8ad tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:11.076926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-486483d5-ded5-4f81-aef5-5180d0caa8ad tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084151 Aug 04 23:30:11.077478 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 739/1447] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:10 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:11.885574 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6158ad32-0f43-4de3-aa65-fc49eb5414e6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:11.886191 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6158ad32-0f43-4de3-aa65-fc49eb5414e6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:11.892844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6158ad32-0f43-4de3-aa65-fc49eb5414e6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:11.893328 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6158ad32-0f43-4de3-aa65-fc49eb5414e6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:11.893764 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6158ad32-0f43-4de3-aa65-fc49eb5414e6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:11.895106 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6158ad32-0f43-4de3-aa65-fc49eb5414e6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:11.895559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6158ad32-0f43-4de3-aa65-fc49eb5414e6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:11.895992 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6158ad32-0f43-4de3-aa65-fc49eb5414e6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:12.033119 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6158ad32-0f43-4de3-aa65-fc49eb5414e6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:12.041355 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6158ad32-0f43-4de3-aa65-fc49eb5414e6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.159587 Aug 04 23:30:12.041915 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 709/1448] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:11 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:12.099299 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2861f4dc-fe40-4111-8e1d-1c2b8bd81270 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:12.099822 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2861f4dc-fe40-4111-8e1d-1c2b8bd81270 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:12.106529 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2861f4dc-fe40-4111-8e1d-1c2b8bd81270 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:12.107008 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2861f4dc-fe40-4111-8e1d-1c2b8bd81270 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:12.107442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2861f4dc-fe40-4111-8e1d-1c2b8bd81270 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:12.108133 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2861f4dc-fe40-4111-8e1d-1c2b8bd81270 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:12.108577 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2861f4dc-fe40-4111-8e1d-1c2b8bd81270 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:12.108996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2861f4dc-fe40-4111-8e1d-1c2b8bd81270 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:12.177404 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2861f4dc-fe40-4111-8e1d-1c2b8bd81270 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:12.185078 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2861f4dc-fe40-4111-8e1d-1c2b8bd81270 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089839 Aug 04 23:30:12.185637 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 740/1449] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:12 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:13.062983 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-21400184-db4e-4d3d-8f91-8ac4df524543 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:13.063520 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-21400184-db4e-4d3d-8f91-8ac4df524543 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:13.070710 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-21400184-db4e-4d3d-8f91-8ac4df524543 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:13.071195 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-21400184-db4e-4d3d-8f91-8ac4df524543 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:13.071629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-21400184-db4e-4d3d-8f91-8ac4df524543 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:13.072323 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-21400184-db4e-4d3d-8f91-8ac4df524543 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:13.072775 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-21400184-db4e-4d3d-8f91-8ac4df524543 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:13.073448 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-21400184-db4e-4d3d-8f91-8ac4df524543 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:13.205170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-21400184-db4e-4d3d-8f91-8ac4df524543 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:13.205356 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-36836679-bffc-48ec-bb9a-67769f3d260e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:13.205845 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-36836679-bffc-48ec-bb9a-67769f3d260e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:13.213067 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-36836679-bffc-48ec-bb9a-67769f3d260e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:13.213540 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-21400184-db4e-4d3d-8f91-8ac4df524543 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.154475 Aug 04 23:30:13.213665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-36836679-bffc-48ec-bb9a-67769f3d260e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:13.213969 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-36836679-bffc-48ec-bb9a-67769f3d260e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:13.214917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 710/1450] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:13 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:13.215089 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-36836679-bffc-48ec-bb9a-67769f3d260e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:13.215202 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-36836679-bffc-48ec-bb9a-67769f3d260e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:13.215533 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-36836679-bffc-48ec-bb9a-67769f3d260e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:13.283167 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-36836679-bffc-48ec-bb9a-67769f3d260e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:13.291162 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-36836679-bffc-48ec-bb9a-67769f3d260e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089842 Aug 04 23:30:13.291731 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 741/1451] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:13 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:30:14.234163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-87065238-e147-4e2d-b568-5baf26a790e1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:14.234811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-87065238-e147-4e2d-b568-5baf26a790e1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:14.242300 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87065238-e147-4e2d-b568-5baf26a790e1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:14.242822 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87065238-e147-4e2d-b568-5baf26a790e1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:14.243258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87065238-e147-4e2d-b568-5baf26a790e1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:14.243995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87065238-e147-4e2d-b568-5baf26a790e1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:14.244402 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87065238-e147-4e2d-b568-5baf26a790e1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:14.244820 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87065238-e147-4e2d-b568-5baf26a790e1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:14.312538 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2964b166-0535-4fd6-8a3b-f94fd7bee2bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:14.313151 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2964b166-0535-4fd6-8a3b-f94fd7bee2bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:14.320873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2964b166-0535-4fd6-8a3b-f94fd7bee2bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:14.321366 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2964b166-0535-4fd6-8a3b-f94fd7bee2bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:14.321801 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2964b166-0535-4fd6-8a3b-f94fd7bee2bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:14.322776 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2964b166-0535-4fd6-8a3b-f94fd7bee2bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:14.323756 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2964b166-0535-4fd6-8a3b-f94fd7bee2bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:14.324428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2964b166-0535-4fd6-8a3b-f94fd7bee2bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:14.407347 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2964b166-0535-4fd6-8a3b-f94fd7bee2bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:14.412064 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-87065238-e147-4e2d-b568-5baf26a790e1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:14.416989 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2964b166-0535-4fd6-8a3b-f94fd7bee2bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.108292 Aug 04 23:30:14.417792 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 742/1452] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:14 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:30:14.420740 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-87065238-e147-4e2d-b568-5baf26a790e1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.190355 Aug 04 23:30:14.421340 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 711/1453] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:14 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:15.438869 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c48a363b-ed7d-4339-9f1e-0a707eb096cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:15.439518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c48a363b-ed7d-4339-9f1e-0a707eb096cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:15.443298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-09abe7a0-fed0-4a76-8636-1085f5c56c29 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:15.443909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-09abe7a0-fed0-4a76-8636-1085f5c56c29 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:15.446920 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c48a363b-ed7d-4339-9f1e-0a707eb096cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:15.447400 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c48a363b-ed7d-4339-9f1e-0a707eb096cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:15.447824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c48a363b-ed7d-4339-9f1e-0a707eb096cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:15.448773 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c48a363b-ed7d-4339-9f1e-0a707eb096cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:15.449213 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c48a363b-ed7d-4339-9f1e-0a707eb096cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:15.449630 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c48a363b-ed7d-4339-9f1e-0a707eb096cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:15.450601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09abe7a0-fed0-4a76-8636-1085f5c56c29 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:15.451077 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09abe7a0-fed0-4a76-8636-1085f5c56c29 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:15.451511 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09abe7a0-fed0-4a76-8636-1085f5c56c29 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:15.452195 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09abe7a0-fed0-4a76-8636-1085f5c56c29 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:15.452641 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09abe7a0-fed0-4a76-8636-1085f5c56c29 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:15.453061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09abe7a0-fed0-4a76-8636-1085f5c56c29 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:15.526692 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c48a363b-ed7d-4339-9f1e-0a707eb096cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:15.534236 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c48a363b-ed7d-4339-9f1e-0a707eb096cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.099329 Aug 04 23:30:15.534832 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 743/1454] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:15 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:15.613699 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-09abe7a0-fed0-4a76-8636-1085f5c56c29 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:15.621498 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-09abe7a0-fed0-4a76-8636-1085f5c56c29 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.182244 Aug 04 23:30:15.622071 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 712/1455] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:15 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:30:16.555527 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1a438a48-4edf-4bc4-9b4d-aa7918ec6338 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:16.556132 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1a438a48-4edf-4bc4-9b4d-aa7918ec6338 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:16.562579 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a438a48-4edf-4bc4-9b4d-aa7918ec6338 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:16.563073 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a438a48-4edf-4bc4-9b4d-aa7918ec6338 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:16.563497 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a438a48-4edf-4bc4-9b4d-aa7918ec6338 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:16.564186 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a438a48-4edf-4bc4-9b4d-aa7918ec6338 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:16.564821 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a438a48-4edf-4bc4-9b4d-aa7918ec6338 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:16.565092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a438a48-4edf-4bc4-9b4d-aa7918ec6338 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:16.580640 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:30:16.628184 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1a438a48-4edf-4bc4-9b4d-aa7918ec6338 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:16.637018 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1a438a48-4edf-4bc4-9b4d-aa7918ec6338 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085533 Aug 04 23:30:16.637572 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 744/1456] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:16 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:16.642109 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-99077e86-6d50-4cb1-8574-e50bff2c2d8c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:16.642749 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-99077e86-6d50-4cb1-8574-e50bff2c2d8c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:16.649740 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-99077e86-6d50-4cb1-8574-e50bff2c2d8c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:16.650221 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-99077e86-6d50-4cb1-8574-e50bff2c2d8c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:16.650683 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-99077e86-6d50-4cb1-8574-e50bff2c2d8c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:16.651381 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-99077e86-6d50-4cb1-8574-e50bff2c2d8c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:16.651837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-99077e86-6d50-4cb1-8574-e50bff2c2d8c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:16.652259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-99077e86-6d50-4cb1-8574-e50bff2c2d8c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:16.654955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:30:16.793778 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-99077e86-6d50-4cb1-8574-e50bff2c2d8c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:16.802088 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-99077e86-6d50-4cb1-8574-e50bff2c2d8c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.163713 Aug 04 23:30:16.802620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 713/1457] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:16 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:17.658620 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-aecb0ebb-7ae3-44eb-a9a9-1f2829456e24 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:17.659233 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-aecb0ebb-7ae3-44eb-a9a9-1f2829456e24 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:17.666099 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aecb0ebb-7ae3-44eb-a9a9-1f2829456e24 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:17.666631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aecb0ebb-7ae3-44eb-a9a9-1f2829456e24 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:17.667073 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aecb0ebb-7ae3-44eb-a9a9-1f2829456e24 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:17.667773 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aecb0ebb-7ae3-44eb-a9a9-1f2829456e24 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:17.668225 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aecb0ebb-7ae3-44eb-a9a9-1f2829456e24 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:17.668645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aecb0ebb-7ae3-44eb-a9a9-1f2829456e24 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:17.731796 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-aecb0ebb-7ae3-44eb-a9a9-1f2829456e24 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:17.740308 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-aecb0ebb-7ae3-44eb-a9a9-1f2829456e24 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085533 Aug 04 23:30:17.740878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 745/1458] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:17 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:17.823708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7d19f947-cbb4-4c80-a794-138d6b1e05b0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:17.824262 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7d19f947-cbb4-4c80-a794-138d6b1e05b0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:17.831021 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d19f947-cbb4-4c80-a794-138d6b1e05b0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:17.831503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d19f947-cbb4-4c80-a794-138d6b1e05b0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:17.831940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d19f947-cbb4-4c80-a794-138d6b1e05b0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:17.832652 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d19f947-cbb4-4c80-a794-138d6b1e05b0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:17.833099 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d19f947-cbb4-4c80-a794-138d6b1e05b0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:17.833518 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d19f947-cbb4-4c80-a794-138d6b1e05b0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:17.965265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7d19f947-cbb4-4c80-a794-138d6b1e05b0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:17.973714 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7d19f947-cbb4-4c80-a794-138d6b1e05b0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.153844 Aug 04 23:30:17.974290 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 714/1459] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:17 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:18.760900 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-55cd5948-b1d3-467c-9518-cbfd93581fd2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:18.761726 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-55cd5948-b1d3-467c-9518-cbfd93581fd2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:18.768252 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-55cd5948-b1d3-467c-9518-cbfd93581fd2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:18.768727 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-55cd5948-b1d3-467c-9518-cbfd93581fd2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:18.769151 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-55cd5948-b1d3-467c-9518-cbfd93581fd2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:18.770499 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-55cd5948-b1d3-467c-9518-cbfd93581fd2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:18.771051 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-55cd5948-b1d3-467c-9518-cbfd93581fd2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:18.771635 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-55cd5948-b1d3-467c-9518-cbfd93581fd2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:18.852794 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-55cd5948-b1d3-467c-9518-cbfd93581fd2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:18.860429 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-55cd5948-b1d3-467c-9518-cbfd93581fd2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.103512 Aug 04 23:30:18.860993 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 746/1460] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:18 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:18.994669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-fba7504d-b80c-4c53-9d5a-55cdc8392eb4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:18.995277 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-fba7504d-b80c-4c53-9d5a-55cdc8392eb4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:19.001891 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fba7504d-b80c-4c53-9d5a-55cdc8392eb4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:19.002446 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fba7504d-b80c-4c53-9d5a-55cdc8392eb4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:19.002885 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fba7504d-b80c-4c53-9d5a-55cdc8392eb4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:19.003572 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fba7504d-b80c-4c53-9d5a-55cdc8392eb4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:19.005143 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fba7504d-b80c-4c53-9d5a-55cdc8392eb4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:19.005583 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fba7504d-b80c-4c53-9d5a-55cdc8392eb4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:19.145328 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-fba7504d-b80c-4c53-9d5a-55cdc8392eb4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:19.152941 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-fba7504d-b80c-4c53-9d5a-55cdc8392eb4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.162235 Aug 04 23:30:19.153502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 715/1461] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:18 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:19.882111 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-51ea0d33-e2de-4e88-b9f9-cbeeebcef0e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:19.882737 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-51ea0d33-e2de-4e88-b9f9-cbeeebcef0e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:19.889254 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51ea0d33-e2de-4e88-b9f9-cbeeebcef0e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:19.889728 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51ea0d33-e2de-4e88-b9f9-cbeeebcef0e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:19.890157 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51ea0d33-e2de-4e88-b9f9-cbeeebcef0e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:19.890869 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51ea0d33-e2de-4e88-b9f9-cbeeebcef0e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:19.891315 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51ea0d33-e2de-4e88-b9f9-cbeeebcef0e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:19.891731 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51ea0d33-e2de-4e88-b9f9-cbeeebcef0e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:19.958662 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-51ea0d33-e2de-4e88-b9f9-cbeeebcef0e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:19.966423 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-51ea0d33-e2de-4e88-b9f9-cbeeebcef0e4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089028 Aug 04 23:30:19.966998 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 747/1462] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:19 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:20.173071 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-555b62ee-3182-498b-9fb5-a352007dafdf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:20.173678 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-555b62ee-3182-498b-9fb5-a352007dafdf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:20.180777 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-555b62ee-3182-498b-9fb5-a352007dafdf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:20.181250 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-555b62ee-3182-498b-9fb5-a352007dafdf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:20.181678 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-555b62ee-3182-498b-9fb5-a352007dafdf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:20.182379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-555b62ee-3182-498b-9fb5-a352007dafdf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:20.182826 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-555b62ee-3182-498b-9fb5-a352007dafdf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:20.183241 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-555b62ee-3182-498b-9fb5-a352007dafdf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:20.319117 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-555b62ee-3182-498b-9fb5-a352007dafdf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:20.327212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-555b62ee-3182-498b-9fb5-a352007dafdf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.157864 Aug 04 23:30:20.327789 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 716/1463] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:20 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:20.988762 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c4cbe4d7-941b-4570-9b0b-d77b3099b052 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:20.989446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c4cbe4d7-941b-4570-9b0b-d77b3099b052 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:20.995995 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c4cbe4d7-941b-4570-9b0b-d77b3099b052 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:20.996476 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c4cbe4d7-941b-4570-9b0b-d77b3099b052 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:20.996944 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c4cbe4d7-941b-4570-9b0b-d77b3099b052 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:20.997648 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c4cbe4d7-941b-4570-9b0b-d77b3099b052 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:20.998100 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c4cbe4d7-941b-4570-9b0b-d77b3099b052 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:20.998557 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c4cbe4d7-941b-4570-9b0b-d77b3099b052 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:21.062612 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c4cbe4d7-941b-4570-9b0b-d77b3099b052 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:21.071072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c4cbe4d7-941b-4570-9b0b-d77b3099b052 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086674 Aug 04 23:30:21.071682 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 748/1464] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:20 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:21.348552 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c4cfe04e-c28d-4abf-a036-d77f79e5cec5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:21.349235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c4cfe04e-c28d-4abf-a036-d77f79e5cec5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:21.355845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c4cfe04e-c28d-4abf-a036-d77f79e5cec5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:21.356326 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c4cfe04e-c28d-4abf-a036-d77f79e5cec5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:21.356759 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c4cfe04e-c28d-4abf-a036-d77f79e5cec5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:21.357457 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c4cfe04e-c28d-4abf-a036-d77f79e5cec5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:21.357907 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c4cfe04e-c28d-4abf-a036-d77f79e5cec5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:21.358328 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c4cfe04e-c28d-4abf-a036-d77f79e5cec5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:21.496195 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c4cfe04e-c28d-4abf-a036-d77f79e5cec5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:21.504410 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c4cfe04e-c28d-4abf-a036-d77f79e5cec5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.159684 Aug 04 23:30:21.505215 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 717/1465] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:21 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:22.093203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-08d768d9-94d2-438d-83a8-4d3c1ec81ead tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:22.093754 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-08d768d9-94d2-438d-83a8-4d3c1ec81ead tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:22.100875 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-08d768d9-94d2-438d-83a8-4d3c1ec81ead tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:22.101350 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-08d768d9-94d2-438d-83a8-4d3c1ec81ead tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:22.101784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-08d768d9-94d2-438d-83a8-4d3c1ec81ead tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:22.102493 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-08d768d9-94d2-438d-83a8-4d3c1ec81ead tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:22.102946 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-08d768d9-94d2-438d-83a8-4d3c1ec81ead tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:22.103363 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-08d768d9-94d2-438d-83a8-4d3c1ec81ead tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:22.165145 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-08d768d9-94d2-438d-83a8-4d3c1ec81ead tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:22.172687 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-08d768d9-94d2-438d-83a8-4d3c1ec81ead tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083418 Aug 04 23:30:22.173243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 749/1466] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:22 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:22.525836 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f222d0e0-1a74-46a6-8c34-0a6330eaea43 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:22.526493 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f222d0e0-1a74-46a6-8c34-0a6330eaea43 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:22.533257 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f222d0e0-1a74-46a6-8c34-0a6330eaea43 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:22.533747 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f222d0e0-1a74-46a6-8c34-0a6330eaea43 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:22.534184 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f222d0e0-1a74-46a6-8c34-0a6330eaea43 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:22.535639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f222d0e0-1a74-46a6-8c34-0a6330eaea43 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:22.536153 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f222d0e0-1a74-46a6-8c34-0a6330eaea43 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:22.536695 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f222d0e0-1a74-46a6-8c34-0a6330eaea43 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:22.676457 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f222d0e0-1a74-46a6-8c34-0a6330eaea43 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:22.684005 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f222d0e0-1a74-46a6-8c34-0a6330eaea43 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.161996 Aug 04 23:30:22.684568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 718/1467] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:22 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:23.194866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-57834b5f-02d8-4f3b-82b3-5875da6d6927 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:23.195535 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-57834b5f-02d8-4f3b-82b3-5875da6d6927 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:23.201933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-57834b5f-02d8-4f3b-82b3-5875da6d6927 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:23.202452 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-57834b5f-02d8-4f3b-82b3-5875da6d6927 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:23.204509 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-57834b5f-02d8-4f3b-82b3-5875da6d6927 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:23.204509 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-57834b5f-02d8-4f3b-82b3-5875da6d6927 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:23.204509 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-57834b5f-02d8-4f3b-82b3-5875da6d6927 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:23.204509 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-57834b5f-02d8-4f3b-82b3-5875da6d6927 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:23.267292 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-57834b5f-02d8-4f3b-82b3-5875da6d6927 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:23.276435 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-57834b5f-02d8-4f3b-82b3-5875da6d6927 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085361 Aug 04 23:30:23.277015 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 750/1468] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:23 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:23.705243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-21ab52ea-b9c1-406f-bebe-7bab6d6ff100 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:23.705879 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-21ab52ea-b9c1-406f-bebe-7bab6d6ff100 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:23.714701 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-21ab52ea-b9c1-406f-bebe-7bab6d6ff100 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:23.715391 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-21ab52ea-b9c1-406f-bebe-7bab6d6ff100 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:23.715921 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-21ab52ea-b9c1-406f-bebe-7bab6d6ff100 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:23.716907 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-21ab52ea-b9c1-406f-bebe-7bab6d6ff100 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:23.717547 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-21ab52ea-b9c1-406f-bebe-7bab6d6ff100 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:23.718076 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-21ab52ea-b9c1-406f-bebe-7bab6d6ff100 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:23.880896 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-21ab52ea-b9c1-406f-bebe-7bab6d6ff100 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:23.889083 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-21ab52ea-b9c1-406f-bebe-7bab6d6ff100 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.187589 Aug 04 23:30:23.889676 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 719/1469] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:23 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:24.297868 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-cfd44fc1-9ace-469f-bf21-d2ab6d59e48a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:24.298510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-cfd44fc1-9ace-469f-bf21-d2ab6d59e48a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:24.305666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cfd44fc1-9ace-469f-bf21-d2ab6d59e48a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:24.306141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cfd44fc1-9ace-469f-bf21-d2ab6d59e48a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:24.306595 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cfd44fc1-9ace-469f-bf21-d2ab6d59e48a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:24.307295 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cfd44fc1-9ace-469f-bf21-d2ab6d59e48a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:24.307745 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cfd44fc1-9ace-469f-bf21-d2ab6d59e48a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:24.308159 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cfd44fc1-9ace-469f-bf21-d2ab6d59e48a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:24.375879 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cfd44fc1-9ace-469f-bf21-d2ab6d59e48a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:24.384665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-cfd44fc1-9ace-469f-bf21-d2ab6d59e48a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.090715 Aug 04 23:30:24.385238 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 751/1470] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:24 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:24.912787 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-06c2269e-160b-427a-87c9-1ef2f846e30f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:24.913393 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-06c2269e-160b-427a-87c9-1ef2f846e30f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:24.920056 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-06c2269e-160b-427a-87c9-1ef2f846e30f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:24.920525 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-06c2269e-160b-427a-87c9-1ef2f846e30f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:24.920954 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-06c2269e-160b-427a-87c9-1ef2f846e30f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:24.921635 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-06c2269e-160b-427a-87c9-1ef2f846e30f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:24.922094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-06c2269e-160b-427a-87c9-1ef2f846e30f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:24.922542 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-06c2269e-160b-427a-87c9-1ef2f846e30f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:25.055674 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-06c2269e-160b-427a-87c9-1ef2f846e30f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:25.063236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-06c2269e-160b-427a-87c9-1ef2f846e30f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.155403 Aug 04 23:30:25.063799 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 720/1471] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:24 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:25.407206 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e165d873-14e4-4314-a313-78ec439ac6cb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:25.407807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e165d873-14e4-4314-a313-78ec439ac6cb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:25.414668 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e165d873-14e4-4314-a313-78ec439ac6cb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:25.415140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e165d873-14e4-4314-a313-78ec439ac6cb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:25.415567 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e165d873-14e4-4314-a313-78ec439ac6cb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:25.416290 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e165d873-14e4-4314-a313-78ec439ac6cb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:25.416730 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e165d873-14e4-4314-a313-78ec439ac6cb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:25.417149 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e165d873-14e4-4314-a313-78ec439ac6cb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:25.479957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e165d873-14e4-4314-a313-78ec439ac6cb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:25.487948 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e165d873-14e4-4314-a313-78ec439ac6cb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084652 Aug 04 23:30:25.488526 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 752/1472] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:25 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:26.085571 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3738d3b2-4c65-43ef-aa14-d30062979980 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:26.086122 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3738d3b2-4c65-43ef-aa14-d30062979980 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:26.092871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3738d3b2-4c65-43ef-aa14-d30062979980 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:26.093357 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3738d3b2-4c65-43ef-aa14-d30062979980 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:26.093790 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3738d3b2-4c65-43ef-aa14-d30062979980 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:26.094525 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3738d3b2-4c65-43ef-aa14-d30062979980 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:26.094977 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3738d3b2-4c65-43ef-aa14-d30062979980 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:26.095397 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3738d3b2-4c65-43ef-aa14-d30062979980 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:26.244204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3738d3b2-4c65-43ef-aa14-d30062979980 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:26.251965 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3738d3b2-4c65-43ef-aa14-d30062979980 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.171495 Aug 04 23:30:26.252538 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 721/1473] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:26 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:26.510539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1fefd97b-691c-4454-9554-3b152af0b6c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:26.511148 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1fefd97b-691c-4454-9554-3b152af0b6c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:26.517608 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1fefd97b-691c-4454-9554-3b152af0b6c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:26.518078 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1fefd97b-691c-4454-9554-3b152af0b6c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:26.518548 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1fefd97b-691c-4454-9554-3b152af0b6c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:26.519232 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1fefd97b-691c-4454-9554-3b152af0b6c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:26.519678 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1fefd97b-691c-4454-9554-3b152af0b6c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:26.520091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1fefd97b-691c-4454-9554-3b152af0b6c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:26.586718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1fefd97b-691c-4454-9554-3b152af0b6c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:26.594513 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1fefd97b-691c-4454-9554-3b152af0b6c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.088419 Aug 04 23:30:26.595089 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 753/1474] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:26 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:27.273746 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e6078eb2-678c-4b68-a0cc-db12350e454b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:27.274412 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e6078eb2-678c-4b68-a0cc-db12350e454b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:27.276681 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=54 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:30:27.281889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6078eb2-678c-4b68-a0cc-db12350e454b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:27.282389 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6078eb2-678c-4b68-a0cc-db12350e454b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:27.282825 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6078eb2-678c-4b68-a0cc-db12350e454b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:27.283516 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6078eb2-678c-4b68-a0cc-db12350e454b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:27.283966 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6078eb2-678c-4b68-a0cc-db12350e454b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:27.284391 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6078eb2-678c-4b68-a0cc-db12350e454b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:27.418863 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e6078eb2-678c-4b68-a0cc-db12350e454b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:27.426524 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e6078eb2-678c-4b68-a0cc-db12350e454b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.157214 Aug 04 23:30:27.427096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 722/1475] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:27 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:27.616574 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c7d196ee-a769-4f77-a69a-de1d7ad4d620 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:27.617142 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c7d196ee-a769-4f77-a69a-de1d7ad4d620 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:27.623609 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c7d196ee-a769-4f77-a69a-de1d7ad4d620 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:27.624087 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c7d196ee-a769-4f77-a69a-de1d7ad4d620 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:27.624522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c7d196ee-a769-4f77-a69a-de1d7ad4d620 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:27.625222 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c7d196ee-a769-4f77-a69a-de1d7ad4d620 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:27.625671 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c7d196ee-a769-4f77-a69a-de1d7ad4d620 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:27.626090 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c7d196ee-a769-4f77-a69a-de1d7ad4d620 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:27.695204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c7d196ee-a769-4f77-a69a-de1d7ad4d620 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:27.703197 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c7d196ee-a769-4f77-a69a-de1d7ad4d620 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.090577 Aug 04 23:30:27.703765 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 754/1476] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:27 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:28.449977 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1079e617-ca6e-4df1-bfe8-85047828cbbd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:28.450620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1079e617-ca6e-4df1-bfe8-85047828cbbd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:28.457439 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1079e617-ca6e-4df1-bfe8-85047828cbbd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:28.457921 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1079e617-ca6e-4df1-bfe8-85047828cbbd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:28.458371 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1079e617-ca6e-4df1-bfe8-85047828cbbd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:28.459996 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1079e617-ca6e-4df1-bfe8-85047828cbbd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:28.460459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1079e617-ca6e-4df1-bfe8-85047828cbbd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:28.460890 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1079e617-ca6e-4df1-bfe8-85047828cbbd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:28.603553 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1079e617-ca6e-4df1-bfe8-85047828cbbd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:28.611445 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1079e617-ca6e-4df1-bfe8-85047828cbbd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.166058 Aug 04 23:30:28.612012 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 723/1477] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:28 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:28.725602 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-492b8645-17e0-4a35-8fd3-2885898efe9f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:28.726140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-492b8645-17e0-4a35-8fd3-2885898efe9f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:28.728488 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=56 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:30:28.733885 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-492b8645-17e0-4a35-8fd3-2885898efe9f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:28.734386 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-492b8645-17e0-4a35-8fd3-2885898efe9f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:28.734826 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-492b8645-17e0-4a35-8fd3-2885898efe9f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:28.735530 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-492b8645-17e0-4a35-8fd3-2885898efe9f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:28.735987 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-492b8645-17e0-4a35-8fd3-2885898efe9f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:28.736407 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-492b8645-17e0-4a35-8fd3-2885898efe9f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:28.803632 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-492b8645-17e0-4a35-8fd3-2885898efe9f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:28.811648 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-492b8645-17e0-4a35-8fd3-2885898efe9f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089765 Aug 04 23:30:28.812225 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 755/1478] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:28 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:29.504481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:30:29.504769 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:30:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:30:29.633258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ef66c46c-83ee-47c0-9d6c-9b6c4f6798ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:29.634023 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ef66c46c-83ee-47c0-9d6c-9b6c4f6798ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:29.641121 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef66c46c-83ee-47c0-9d6c-9b6c4f6798ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:29.641624 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef66c46c-83ee-47c0-9d6c-9b6c4f6798ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:29.642054 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef66c46c-83ee-47c0-9d6c-9b6c4f6798ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:29.642807 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef66c46c-83ee-47c0-9d6c-9b6c4f6798ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:29.643251 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef66c46c-83ee-47c0-9d6c-9b6c4f6798ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:29.643661 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef66c46c-83ee-47c0-9d6c-9b6c4f6798ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:29.807801 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ef66c46c-83ee-47c0-9d6c-9b6c4f6798ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:29.825989 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ef66c46c-83ee-47c0-9d6c-9b6c4f6798ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.197038 Aug 04 23:30:29.833837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 724/1479] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:29 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:29.839008 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f7a8e844-27c9-4d9f-87dc-10a375e8f10a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:29.839735 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f7a8e844-27c9-4d9f-87dc-10a375e8f10a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:29.850522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7a8e844-27c9-4d9f-87dc-10a375e8f10a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:29.851008 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7a8e844-27c9-4d9f-87dc-10a375e8f10a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:29.851450 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7a8e844-27c9-4d9f-87dc-10a375e8f10a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:29.852172 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7a8e844-27c9-4d9f-87dc-10a375e8f10a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:29.852622 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7a8e844-27c9-4d9f-87dc-10a375e8f10a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:29.853043 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7a8e844-27c9-4d9f-87dc-10a375e8f10a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:29.926215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f7a8e844-27c9-4d9f-87dc-10a375e8f10a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:29.936195 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f7a8e844-27c9-4d9f-87dc-10a375e8f10a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.105864 Aug 04 23:30:29.937031 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 756/1480] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:29 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:30.861300 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e5efe666-fed5-4a65-81e8-e91bb034003e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:30.862353 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e5efe666-fed5-4a65-81e8-e91bb034003e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:30.875096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e5efe666-fed5-4a65-81e8-e91bb034003e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:30.875587 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e5efe666-fed5-4a65-81e8-e91bb034003e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:30.876033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e5efe666-fed5-4a65-81e8-e91bb034003e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:30.876749 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e5efe666-fed5-4a65-81e8-e91bb034003e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:30.877237 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e5efe666-fed5-4a65-81e8-e91bb034003e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:30.877659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e5efe666-fed5-4a65-81e8-e91bb034003e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:30.960579 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9c578906-303f-4c6f-a587-1bce0b59d575 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:30.961593 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9c578906-303f-4c6f-a587-1bce0b59d575 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:30.972558 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c578906-303f-4c6f-a587-1bce0b59d575 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:30.973447 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c578906-303f-4c6f-a587-1bce0b59d575 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:30.974735 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c578906-303f-4c6f-a587-1bce0b59d575 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:30.976215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c578906-303f-4c6f-a587-1bce0b59d575 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:30.976996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c578906-303f-4c6f-a587-1bce0b59d575 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:30.978834 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c578906-303f-4c6f-a587-1bce0b59d575 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:31.053799 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e5efe666-fed5-4a65-81e8-e91bb034003e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:31.068726 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9c578906-303f-4c6f-a587-1bce0b59d575 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:31.069026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e5efe666-fed5-4a65-81e8-e91bb034003e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.214917 Aug 04 23:30:31.069902 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 725/1481] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:30 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:31.077309 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9c578906-303f-4c6f-a587-1bce0b59d575 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.123020 Aug 04 23:30:31.078414 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 757/1482] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:30 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:30:32.094153 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-138cc3cd-8f76-49da-be8d-1630aefe2588 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:32.094906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-138cc3cd-8f76-49da-be8d-1630aefe2588 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:32.098457 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c86a43c4-eecd-4b77-b884-dcac0b9f5ec4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:32.098976 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c86a43c4-eecd-4b77-b884-dcac0b9f5ec4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:32.103941 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-138cc3cd-8f76-49da-be8d-1630aefe2588 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:32.104434 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-138cc3cd-8f76-49da-be8d-1630aefe2588 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:32.104873 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-138cc3cd-8f76-49da-be8d-1630aefe2588 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:32.105711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-138cc3cd-8f76-49da-be8d-1630aefe2588 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:32.106210 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-138cc3cd-8f76-49da-be8d-1630aefe2588 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:32.106352 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c86a43c4-eecd-4b77-b884-dcac0b9f5ec4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:32.106678 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-138cc3cd-8f76-49da-be8d-1630aefe2588 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:32.110482 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c86a43c4-eecd-4b77-b884-dcac0b9f5ec4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:32.110482 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c86a43c4-eecd-4b77-b884-dcac0b9f5ec4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:32.110482 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c86a43c4-eecd-4b77-b884-dcac0b9f5ec4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:32.110482 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c86a43c4-eecd-4b77-b884-dcac0b9f5ec4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:32.111025 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c86a43c4-eecd-4b77-b884-dcac0b9f5ec4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:32.204608 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c86a43c4-eecd-4b77-b884-dcac0b9f5ec4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:32.213110 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c86a43c4-eecd-4b77-b884-dcac0b9f5ec4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.118816 Aug 04 23:30:32.213689 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 758/1483] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:32 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:30:32.280906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-138cc3cd-8f76-49da-be8d-1630aefe2588 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:32.291614 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-138cc3cd-8f76-49da-be8d-1630aefe2588 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.202315 Aug 04 23:30:32.292188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 726/1484] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:32 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:33.234860 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-95952822-bea1-4f5f-a716-740e0b0994be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:33.235577 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-95952822-bea1-4f5f-a716-740e0b0994be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:33.242658 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95952822-bea1-4f5f-a716-740e0b0994be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:33.243145 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95952822-bea1-4f5f-a716-740e0b0994be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:33.243576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95952822-bea1-4f5f-a716-740e0b0994be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:33.244292 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95952822-bea1-4f5f-a716-740e0b0994be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:33.244748 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95952822-bea1-4f5f-a716-740e0b0994be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:33.245172 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95952822-bea1-4f5f-a716-740e0b0994be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:33.313309 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f446b15e-c43c-4394-91ab-dc1ae5a9f9f9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:33.313981 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f446b15e-c43c-4394-91ab-dc1ae5a9f9f9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:33.317414 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-95952822-bea1-4f5f-a716-740e0b0994be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:33.322288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f446b15e-c43c-4394-91ab-dc1ae5a9f9f9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:33.323074 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f446b15e-c43c-4394-91ab-dc1ae5a9f9f9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:33.323515 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f446b15e-c43c-4394-91ab-dc1ae5a9f9f9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:33.324233 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f446b15e-c43c-4394-91ab-dc1ae5a9f9f9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:33.324719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f446b15e-c43c-4394-91ab-dc1ae5a9f9f9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:33.325143 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f446b15e-c43c-4394-91ab-dc1ae5a9f9f9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:33.326475 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-95952822-bea1-4f5f-a716-740e0b0994be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.095465 Aug 04 23:30:33.327322 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 759/1485] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:33 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:33.479526 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f446b15e-c43c-4394-91ab-dc1ae5a9f9f9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:33.487783 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f446b15e-c43c-4394-91ab-dc1ae5a9f9f9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.178345 Aug 04 23:30:33.488631 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 727/1486] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:33 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:34.348635 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-631b2eb1-550d-4521-b53d-774ae13c90dc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:34.349890 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-631b2eb1-550d-4521-b53d-774ae13c90dc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:34.357699 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-631b2eb1-550d-4521-b53d-774ae13c90dc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:34.358182 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-631b2eb1-550d-4521-b53d-774ae13c90dc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:34.358686 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-631b2eb1-550d-4521-b53d-774ae13c90dc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:34.359394 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-631b2eb1-550d-4521-b53d-774ae13c90dc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:34.359836 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-631b2eb1-550d-4521-b53d-774ae13c90dc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:34.360263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-631b2eb1-550d-4521-b53d-774ae13c90dc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:34.436471 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-631b2eb1-550d-4521-b53d-774ae13c90dc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:34.445599 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-631b2eb1-550d-4521-b53d-774ae13c90dc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.101180 Aug 04 23:30:34.446541 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 760/1487] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:34 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:34.510719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d719272c-7cae-4ae1-91f3-717e92031162 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:34.511347 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d719272c-7cae-4ae1-91f3-717e92031162 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:34.519128 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d719272c-7cae-4ae1-91f3-717e92031162 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:34.519623 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d719272c-7cae-4ae1-91f3-717e92031162 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:34.520063 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d719272c-7cae-4ae1-91f3-717e92031162 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:34.520781 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d719272c-7cae-4ae1-91f3-717e92031162 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:34.521824 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d719272c-7cae-4ae1-91f3-717e92031162 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:34.522254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d719272c-7cae-4ae1-91f3-717e92031162 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:34.690227 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d719272c-7cae-4ae1-91f3-717e92031162 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:34.700262 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d719272c-7cae-4ae1-91f3-717e92031162 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.194303 Aug 04 23:30:34.700865 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 728/1488] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:34 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:35.471933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-756bcbda-5e24-4df9-b54f-a6fe3099a5c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:35.473211 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-756bcbda-5e24-4df9-b54f-a6fe3099a5c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:35.483438 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-756bcbda-5e24-4df9-b54f-a6fe3099a5c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:35.484005 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-756bcbda-5e24-4df9-b54f-a6fe3099a5c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:35.484571 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-756bcbda-5e24-4df9-b54f-a6fe3099a5c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:35.485738 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-756bcbda-5e24-4df9-b54f-a6fe3099a5c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:35.486415 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-756bcbda-5e24-4df9-b54f-a6fe3099a5c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:35.486954 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-756bcbda-5e24-4df9-b54f-a6fe3099a5c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:35.490670 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:30:35.563365 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-756bcbda-5e24-4df9-b54f-a6fe3099a5c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:35.576348 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-756bcbda-5e24-4df9-b54f-a6fe3099a5c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.111528 Aug 04 23:30:35.577035 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 761/1489] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:35 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:35.738760 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9589d545-6d76-4869-81c1-fdd05b62aa5f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:35.739605 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9589d545-6d76-4869-81c1-fdd05b62aa5f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:35.748229 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9589d545-6d76-4869-81c1-fdd05b62aa5f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:35.749114 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9589d545-6d76-4869-81c1-fdd05b62aa5f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:35.749902 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9589d545-6d76-4869-81c1-fdd05b62aa5f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:35.751454 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9589d545-6d76-4869-81c1-fdd05b62aa5f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:35.752266 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9589d545-6d76-4869-81c1-fdd05b62aa5f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:35.752887 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9589d545-6d76-4869-81c1-fdd05b62aa5f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:35.920445 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9589d545-6d76-4869-81c1-fdd05b62aa5f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:35.922930 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:30:35.930498 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9589d545-6d76-4869-81c1-fdd05b62aa5f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.197322 Aug 04 23:30:35.931099 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 729/1490] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:35 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:36.610877 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b8c083b5-6479-4184-b83a-c3253a9cbbec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:36.611494 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b8c083b5-6479-4184-b83a-c3253a9cbbec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:36.621719 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b8c083b5-6479-4184-b83a-c3253a9cbbec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:36.622209 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b8c083b5-6479-4184-b83a-c3253a9cbbec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:36.622679 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b8c083b5-6479-4184-b83a-c3253a9cbbec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:36.623496 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b8c083b5-6479-4184-b83a-c3253a9cbbec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:36.623950 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b8c083b5-6479-4184-b83a-c3253a9cbbec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:36.624369 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b8c083b5-6479-4184-b83a-c3253a9cbbec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:36.701030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b8c083b5-6479-4184-b83a-c3253a9cbbec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:36.709575 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b8c083b5-6479-4184-b83a-c3253a9cbbec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.105515 Aug 04 23:30:36.710172 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 762/1491] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:36 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:36.952889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-134c2a86-e9a4-42fa-8c8d-c4c64c5b58b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:36.953911 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-134c2a86-e9a4-42fa-8c8d-c4c64c5b58b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:36.965399 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-134c2a86-e9a4-42fa-8c8d-c4c64c5b58b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:36.965997 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-134c2a86-e9a4-42fa-8c8d-c4c64c5b58b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:36.966741 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-134c2a86-e9a4-42fa-8c8d-c4c64c5b58b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:36.967909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-134c2a86-e9a4-42fa-8c8d-c4c64c5b58b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:36.968666 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-134c2a86-e9a4-42fa-8c8d-c4c64c5b58b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:36.969330 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-134c2a86-e9a4-42fa-8c8d-c4c64c5b58b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:37.136827 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-134c2a86-e9a4-42fa-8c8d-c4c64c5b58b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:37.144930 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-134c2a86-e9a4-42fa-8c8d-c4c64c5b58b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.196140 Aug 04 23:30:37.145525 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 730/1492] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:36 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:30:37.733878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2937ff79-804c-49a2-a0a5-5abe21d0b61e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:37.734748 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2937ff79-804c-49a2-a0a5-5abe21d0b61e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:37.741822 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2937ff79-804c-49a2-a0a5-5abe21d0b61e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:37.742307 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2937ff79-804c-49a2-a0a5-5abe21d0b61e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:37.742778 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2937ff79-804c-49a2-a0a5-5abe21d0b61e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:37.743497 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2937ff79-804c-49a2-a0a5-5abe21d0b61e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:37.743951 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2937ff79-804c-49a2-a0a5-5abe21d0b61e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:37.744379 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2937ff79-804c-49a2-a0a5-5abe21d0b61e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:37.813346 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2937ff79-804c-49a2-a0a5-5abe21d0b61e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:37.822144 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2937ff79-804c-49a2-a0a5-5abe21d0b61e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.093411 Aug 04 23:30:37.823020 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 763/1493] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:37 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:38.170682 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0a9aebbc-24fa-4491-a99f-ab32212f0398 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:38.171688 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0a9aebbc-24fa-4491-a99f-ab32212f0398 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:38.182336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0a9aebbc-24fa-4491-a99f-ab32212f0398 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:38.183229 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0a9aebbc-24fa-4491-a99f-ab32212f0398 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:38.183870 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0a9aebbc-24fa-4491-a99f-ab32212f0398 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:38.184988 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0a9aebbc-24fa-4491-a99f-ab32212f0398 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:38.185741 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0a9aebbc-24fa-4491-a99f-ab32212f0398 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:38.186494 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0a9aebbc-24fa-4491-a99f-ab32212f0398 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:38.353240 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0a9aebbc-24fa-4491-a99f-ab32212f0398 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:38.361382 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0a9aebbc-24fa-4491-a99f-ab32212f0398 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.196785 Aug 04 23:30:38.361966 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 731/1494] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:38 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:38.843405 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-844bd6d2-424a-4e5c-9a85-880bb8a91637 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:38.844126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-844bd6d2-424a-4e5c-9a85-880bb8a91637 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:38.851625 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-844bd6d2-424a-4e5c-9a85-880bb8a91637 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:38.852110 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-844bd6d2-424a-4e5c-9a85-880bb8a91637 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:38.852546 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-844bd6d2-424a-4e5c-9a85-880bb8a91637 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:38.853249 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-844bd6d2-424a-4e5c-9a85-880bb8a91637 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:38.855072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-844bd6d2-424a-4e5c-9a85-880bb8a91637 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:38.861473 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-844bd6d2-424a-4e5c-9a85-880bb8a91637 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:38.926268 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-844bd6d2-424a-4e5c-9a85-880bb8a91637 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:38.935881 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-844bd6d2-424a-4e5c-9a85-880bb8a91637 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.096250 Aug 04 23:30:38.936456 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 764/1495] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:38 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:39.386846 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d6f829a9-f6a8-494f-8beb-6f9409e871b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:39.387516 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d6f829a9-f6a8-494f-8beb-6f9409e871b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:39.394641 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d6f829a9-f6a8-494f-8beb-6f9409e871b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:39.395132 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d6f829a9-f6a8-494f-8beb-6f9409e871b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:39.395575 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d6f829a9-f6a8-494f-8beb-6f9409e871b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:39.396844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d6f829a9-f6a8-494f-8beb-6f9409e871b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:39.397289 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d6f829a9-f6a8-494f-8beb-6f9409e871b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:39.397936 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d6f829a9-f6a8-494f-8beb-6f9409e871b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:39.559616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d6f829a9-f6a8-494f-8beb-6f9409e871b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:39.571017 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d6f829a9-f6a8-494f-8beb-6f9409e871b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.190509 Aug 04 23:30:39.571608 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 732/1496] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:39 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:39.956995 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7e0dfbe9-91f1-4ca9-aac3-24e90fd9d314 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:39.957594 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7e0dfbe9-91f1-4ca9-aac3-24e90fd9d314 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:39.964331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e0dfbe9-91f1-4ca9-aac3-24e90fd9d314 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:39.964806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e0dfbe9-91f1-4ca9-aac3-24e90fd9d314 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:39.965237 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e0dfbe9-91f1-4ca9-aac3-24e90fd9d314 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:39.965939 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e0dfbe9-91f1-4ca9-aac3-24e90fd9d314 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:39.966405 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e0dfbe9-91f1-4ca9-aac3-24e90fd9d314 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:39.966826 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e0dfbe9-91f1-4ca9-aac3-24e90fd9d314 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:40.037172 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7e0dfbe9-91f1-4ca9-aac3-24e90fd9d314 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:40.045793 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7e0dfbe9-91f1-4ca9-aac3-24e90fd9d314 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.092539 Aug 04 23:30:40.046417 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 765/1497] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:39 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:40.647157 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9e5d36d1-d12a-48a7-a022-89128a27ab87 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:40.647965 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9e5d36d1-d12a-48a7-a022-89128a27ab87 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:40.654173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9e5d36d1-d12a-48a7-a022-89128a27ab87 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:40.654733 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9e5d36d1-d12a-48a7-a022-89128a27ab87 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:40.655129 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9e5d36d1-d12a-48a7-a022-89128a27ab87 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:40.655960 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9e5d36d1-d12a-48a7-a022-89128a27ab87 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:40.656263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9e5d36d1-d12a-48a7-a022-89128a27ab87 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:40.656855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9e5d36d1-d12a-48a7-a022-89128a27ab87 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:40.796578 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9e5d36d1-d12a-48a7-a022-89128a27ab87 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:40.804807 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9e5d36d1-d12a-48a7-a022-89128a27ab87 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.215406 Aug 04 23:30:40.805395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 733/1498] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:40 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:41.067941 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1df9c812-d8d7-4ab9-8f3b-c02bd8ac3962 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:41.068693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1df9c812-d8d7-4ab9-8f3b-c02bd8ac3962 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:41.075318 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1df9c812-d8d7-4ab9-8f3b-c02bd8ac3962 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:41.075802 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1df9c812-d8d7-4ab9-8f3b-c02bd8ac3962 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:41.076237 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1df9c812-d8d7-4ab9-8f3b-c02bd8ac3962 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:41.076932 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1df9c812-d8d7-4ab9-8f3b-c02bd8ac3962 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:41.077386 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1df9c812-d8d7-4ab9-8f3b-c02bd8ac3962 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:41.077808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1df9c812-d8d7-4ab9-8f3b-c02bd8ac3962 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:41.142922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1df9c812-d8d7-4ab9-8f3b-c02bd8ac3962 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:41.151241 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1df9c812-d8d7-4ab9-8f3b-c02bd8ac3962 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087129 Aug 04 23:30:41.151808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 766/1499] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:41 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:41.825454 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-39be1e1d-e32b-4847-9936-a15ae66ecf8f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:41.826010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-39be1e1d-e32b-4847-9936-a15ae66ecf8f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:41.832748 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-39be1e1d-e32b-4847-9936-a15ae66ecf8f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:41.833266 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-39be1e1d-e32b-4847-9936-a15ae66ecf8f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:41.833716 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-39be1e1d-e32b-4847-9936-a15ae66ecf8f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:41.834762 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-39be1e1d-e32b-4847-9936-a15ae66ecf8f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:41.835223 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-39be1e1d-e32b-4847-9936-a15ae66ecf8f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:41.835640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-39be1e1d-e32b-4847-9936-a15ae66ecf8f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:41.984020 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-39be1e1d-e32b-4847-9936-a15ae66ecf8f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:41.992360 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-39be1e1d-e32b-4847-9936-a15ae66ecf8f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.171086 Aug 04 23:30:41.992934 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 734/1500] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:41 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:42.172678 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e2c1392b-354c-4b76-ba8d-17cc79f42518 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:42.173297 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e2c1392b-354c-4b76-ba8d-17cc79f42518 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:42.180714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2c1392b-354c-4b76-ba8d-17cc79f42518 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:42.181270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2c1392b-354c-4b76-ba8d-17cc79f42518 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:42.181712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2c1392b-354c-4b76-ba8d-17cc79f42518 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:42.182458 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2c1392b-354c-4b76-ba8d-17cc79f42518 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:42.182914 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2c1392b-354c-4b76-ba8d-17cc79f42518 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:42.183340 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2c1392b-354c-4b76-ba8d-17cc79f42518 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:42.252006 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e2c1392b-354c-4b76-ba8d-17cc79f42518 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:42.259921 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e2c1392b-354c-4b76-ba8d-17cc79f42518 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.091441 Aug 04 23:30:42.260490 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 767/1501] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:42 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:43.013513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d3e687cc-6dd2-45be-bb5e-159b0411e0a6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:43.014543 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d3e687cc-6dd2-45be-bb5e-159b0411e0a6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:43.025645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3e687cc-6dd2-45be-bb5e-159b0411e0a6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:43.026549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3e687cc-6dd2-45be-bb5e-159b0411e0a6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:43.027322 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3e687cc-6dd2-45be-bb5e-159b0411e0a6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:43.028590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3e687cc-6dd2-45be-bb5e-159b0411e0a6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:43.029200 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3e687cc-6dd2-45be-bb5e-159b0411e0a6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:43.029630 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3e687cc-6dd2-45be-bb5e-159b0411e0a6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:43.281191 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-85aceb29-52e0-4595-bd89-34ffcbfafac4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:43.281822 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-85aceb29-52e0-4595-bd89-34ffcbfafac4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:43.288599 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-85aceb29-52e0-4595-bd89-34ffcbfafac4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:43.289183 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-85aceb29-52e0-4595-bd89-34ffcbfafac4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:43.289690 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-85aceb29-52e0-4595-bd89-34ffcbfafac4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:43.290498 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-85aceb29-52e0-4595-bd89-34ffcbfafac4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:43.291017 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-85aceb29-52e0-4595-bd89-34ffcbfafac4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:43.291504 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-85aceb29-52e0-4595-bd89-34ffcbfafac4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:43.319524 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d3e687cc-6dd2-45be-bb5e-159b0411e0a6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:43.327365 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d3e687cc-6dd2-45be-bb5e-159b0411e0a6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.318350 Aug 04 23:30:43.327940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 735/1502] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:43 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:43.356352 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-85aceb29-52e0-4595-bd89-34ffcbfafac4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:43.365271 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-85aceb29-52e0-4595-bd89-34ffcbfafac4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087404 Aug 04 23:30:43.365823 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 768/1503] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:43 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:30:44.351688 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0cd6ff84-2080-4ecb-8c28-edace53d2b20 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:44.352356 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0cd6ff84-2080-4ecb-8c28-edace53d2b20 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:44.358783 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0cd6ff84-2080-4ecb-8c28-edace53d2b20 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:44.359259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0cd6ff84-2080-4ecb-8c28-edace53d2b20 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:44.359691 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0cd6ff84-2080-4ecb-8c28-edace53d2b20 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:44.360374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0cd6ff84-2080-4ecb-8c28-edace53d2b20 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:44.360817 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0cd6ff84-2080-4ecb-8c28-edace53d2b20 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:44.361230 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0cd6ff84-2080-4ecb-8c28-edace53d2b20 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:44.385794 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-35f39e23-1edf-418c-b051-d6923f6ec7b1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:44.386553 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-35f39e23-1edf-418c-b051-d6923f6ec7b1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:44.393179 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35f39e23-1edf-418c-b051-d6923f6ec7b1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:44.393648 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35f39e23-1edf-418c-b051-d6923f6ec7b1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:44.394171 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35f39e23-1edf-418c-b051-d6923f6ec7b1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:44.394968 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35f39e23-1edf-418c-b051-d6923f6ec7b1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:44.395422 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35f39e23-1edf-418c-b051-d6923f6ec7b1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:44.395913 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35f39e23-1edf-418c-b051-d6923f6ec7b1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:44.468832 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-35f39e23-1edf-418c-b051-d6923f6ec7b1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:44.476776 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-35f39e23-1edf-418c-b051-d6923f6ec7b1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.094772 Aug 04 23:30:44.477358 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 769/1504] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:44 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:44.531090 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0cd6ff84-2080-4ecb-8c28-edace53d2b20 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:44.538966 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0cd6ff84-2080-4ecb-8c28-edace53d2b20 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.192041 Aug 04 23:30:44.539522 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 736/1505] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:44 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:45.498414 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9e1efb56-72e9-4d35-8e42-574197175c23 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:45.499079 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9e1efb56-72e9-4d35-8e42-574197175c23 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:45.505550 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e1efb56-72e9-4d35-8e42-574197175c23 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:45.506122 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e1efb56-72e9-4d35-8e42-574197175c23 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:45.506585 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e1efb56-72e9-4d35-8e42-574197175c23 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:45.507285 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e1efb56-72e9-4d35-8e42-574197175c23 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:45.507740 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e1efb56-72e9-4d35-8e42-574197175c23 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:45.508160 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e1efb56-72e9-4d35-8e42-574197175c23 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:45.560615 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-54163def-f124-4da4-8345-8b98f0097bcd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:45.562114 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-54163def-f124-4da4-8345-8b98f0097bcd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:45.569062 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54163def-f124-4da4-8345-8b98f0097bcd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:45.569549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54163def-f124-4da4-8345-8b98f0097bcd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:45.570115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9e1efb56-72e9-4d35-8e42-574197175c23 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:45.570277 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54163def-f124-4da4-8345-8b98f0097bcd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:45.570951 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54163def-f124-4da4-8345-8b98f0097bcd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:45.571663 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54163def-f124-4da4-8345-8b98f0097bcd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:45.572752 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54163def-f124-4da4-8345-8b98f0097bcd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:45.578051 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9e1efb56-72e9-4d35-8e42-574197175c23 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083535 Aug 04 23:30:45.578832 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 770/1506] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:45 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:45.710664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-54163def-f124-4da4-8345-8b98f0097bcd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:45.718341 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-54163def-f124-4da4-8345-8b98f0097bcd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.161647 Aug 04 23:30:45.718979 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 737/1507] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:45 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:30:46.599176 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-97ed092c-9dc7-4d6d-bf08-f2e339145a7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:46.599821 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-97ed092c-9dc7-4d6d-bf08-f2e339145a7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:46.606287 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97ed092c-9dc7-4d6d-bf08-f2e339145a7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:46.606809 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97ed092c-9dc7-4d6d-bf08-f2e339145a7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:46.607240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97ed092c-9dc7-4d6d-bf08-f2e339145a7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:46.607941 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97ed092c-9dc7-4d6d-bf08-f2e339145a7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:46.608389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97ed092c-9dc7-4d6d-bf08-f2e339145a7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:46.608807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97ed092c-9dc7-4d6d-bf08-f2e339145a7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:46.673154 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-97ed092c-9dc7-4d6d-bf08-f2e339145a7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:46.681600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-97ed092c-9dc7-4d6d-bf08-f2e339145a7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086356 Aug 04 23:30:46.682173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 771/1508] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:46 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:46.741402 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-23d0e0e1-073a-4c51-abdb-f34f9dfb8acc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:46.741945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-23d0e0e1-073a-4c51-abdb-f34f9dfb8acc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:46.748721 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-23d0e0e1-073a-4c51-abdb-f34f9dfb8acc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:46.749210 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-23d0e0e1-073a-4c51-abdb-f34f9dfb8acc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:46.749648 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-23d0e0e1-073a-4c51-abdb-f34f9dfb8acc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:46.750381 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-23d0e0e1-073a-4c51-abdb-f34f9dfb8acc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:46.750845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-23d0e0e1-073a-4c51-abdb-f34f9dfb8acc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:46.751273 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-23d0e0e1-073a-4c51-abdb-f34f9dfb8acc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:46.888331 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-23d0e0e1-073a-4c51-abdb-f34f9dfb8acc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:46.895940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-23d0e0e1-073a-4c51-abdb-f34f9dfb8acc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.159163 Aug 04 23:30:46.896491 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 738/1509] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:46 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:47.703433 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9ea7182e-c544-45a7-9041-494907434b5b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:47.704039 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9ea7182e-c544-45a7-9041-494907434b5b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:47.711432 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9ea7182e-c544-45a7-9041-494907434b5b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:47.711913 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9ea7182e-c544-45a7-9041-494907434b5b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:47.712347 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9ea7182e-c544-45a7-9041-494907434b5b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:47.713045 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9ea7182e-c544-45a7-9041-494907434b5b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:47.713492 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9ea7182e-c544-45a7-9041-494907434b5b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:47.713910 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9ea7182e-c544-45a7-9041-494907434b5b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:47.779561 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9ea7182e-c544-45a7-9041-494907434b5b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:47.787445 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9ea7182e-c544-45a7-9041-494907434b5b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087849 Aug 04 23:30:47.788013 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 772/1510] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:47 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:47.917890 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-de3a7c6b-acee-4213-8c73-e224fedc34e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:47.918519 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-de3a7c6b-acee-4213-8c73-e224fedc34e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:47.925017 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de3a7c6b-acee-4213-8c73-e224fedc34e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:47.925564 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de3a7c6b-acee-4213-8c73-e224fedc34e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:47.926001 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de3a7c6b-acee-4213-8c73-e224fedc34e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:47.926762 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de3a7c6b-acee-4213-8c73-e224fedc34e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:47.927837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de3a7c6b-acee-4213-8c73-e224fedc34e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:47.928263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de3a7c6b-acee-4213-8c73-e224fedc34e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:48.069117 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-de3a7c6b-acee-4213-8c73-e224fedc34e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:48.077249 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-de3a7c6b-acee-4213-8c73-e224fedc34e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.163168 Aug 04 23:30:48.077821 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 739/1511] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:47 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:48.809407 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ba49e72f-2923-4065-b528-cf7c0d53b302 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:48.810036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ba49e72f-2923-4065-b528-cf7c0d53b302 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:48.816840 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba49e72f-2923-4065-b528-cf7c0d53b302 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:48.817424 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba49e72f-2923-4065-b528-cf7c0d53b302 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:48.818183 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba49e72f-2923-4065-b528-cf7c0d53b302 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:48.818995 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba49e72f-2923-4065-b528-cf7c0d53b302 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:48.819442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba49e72f-2923-4065-b528-cf7c0d53b302 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:48.819866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba49e72f-2923-4065-b528-cf7c0d53b302 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:48.886768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ba49e72f-2923-4065-b528-cf7c0d53b302 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:48.894734 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ba49e72f-2923-4065-b528-cf7c0d53b302 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089160 Aug 04 23:30:48.896212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 773/1512] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:48 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:49.100692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8c0747f9-9f58-4e55-8513-c82ab4744370 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:49.101255 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8c0747f9-9f58-4e55-8513-c82ab4744370 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:49.107738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c0747f9-9f58-4e55-8513-c82ab4744370 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:49.108216 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c0747f9-9f58-4e55-8513-c82ab4744370 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:49.108642 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c0747f9-9f58-4e55-8513-c82ab4744370 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:49.109331 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c0747f9-9f58-4e55-8513-c82ab4744370 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:49.109777 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c0747f9-9f58-4e55-8513-c82ab4744370 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:49.110195 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c0747f9-9f58-4e55-8513-c82ab4744370 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:49.248366 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8c0747f9-9f58-4e55-8513-c82ab4744370 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:49.256872 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8c0747f9-9f58-4e55-8513-c82ab4744370 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.161292 Aug 04 23:30:49.257447 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 740/1513] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:49 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:49.917773 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f00706cd-cda3-40ea-8680-284013642a07 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:49.918689 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f00706cd-cda3-40ea-8680-284013642a07 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:49.925614 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f00706cd-cda3-40ea-8680-284013642a07 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:49.926108 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f00706cd-cda3-40ea-8680-284013642a07 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:49.926583 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f00706cd-cda3-40ea-8680-284013642a07 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:49.927315 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f00706cd-cda3-40ea-8680-284013642a07 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:49.927772 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f00706cd-cda3-40ea-8680-284013642a07 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:49.928191 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f00706cd-cda3-40ea-8680-284013642a07 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:50.000222 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f00706cd-cda3-40ea-8680-284013642a07 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:50.008781 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f00706cd-cda3-40ea-8680-284013642a07 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.095094 Aug 04 23:30:50.009379 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 774/1514] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:49 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:50.278323 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-fc73fe96-58a1-426f-8548-a8941599c149 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:50.278976 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-fc73fe96-58a1-426f-8548-a8941599c149 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:50.285743 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fc73fe96-58a1-426f-8548-a8941599c149 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:50.286266 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fc73fe96-58a1-426f-8548-a8941599c149 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:50.286737 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fc73fe96-58a1-426f-8548-a8941599c149 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:50.287437 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fc73fe96-58a1-426f-8548-a8941599c149 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:50.287887 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fc73fe96-58a1-426f-8548-a8941599c149 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:50.288309 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fc73fe96-58a1-426f-8548-a8941599c149 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:50.433668 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-fc73fe96-58a1-426f-8548-a8941599c149 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:50.441569 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-fc73fe96-58a1-426f-8548-a8941599c149 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.167247 Aug 04 23:30:50.443523 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 741/1515] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:50 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:51.030467 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2bbaa25a-60e7-4bf6-b097-91b2555d9662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:51.031084 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2bbaa25a-60e7-4bf6-b097-91b2555d9662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:51.038520 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bbaa25a-60e7-4bf6-b097-91b2555d9662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:51.038988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bbaa25a-60e7-4bf6-b097-91b2555d9662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:51.039411 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bbaa25a-60e7-4bf6-b097-91b2555d9662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:51.040085 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bbaa25a-60e7-4bf6-b097-91b2555d9662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:51.040528 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bbaa25a-60e7-4bf6-b097-91b2555d9662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:51.040941 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2bbaa25a-60e7-4bf6-b097-91b2555d9662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:51.332715 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2bbaa25a-60e7-4bf6-b097-91b2555d9662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:51.340305 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2bbaa25a-60e7-4bf6-b097-91b2555d9662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.313697 Aug 04 23:30:51.340868 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 775/1516] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:51 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:51.464263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-53718401-3599-4b5e-9124-035ed2f9f95d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:51.464877 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-53718401-3599-4b5e-9124-035ed2f9f95d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:51.471346 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53718401-3599-4b5e-9124-035ed2f9f95d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:51.471821 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53718401-3599-4b5e-9124-035ed2f9f95d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:51.472262 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53718401-3599-4b5e-9124-035ed2f9f95d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:51.472945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53718401-3599-4b5e-9124-035ed2f9f95d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:51.474002 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53718401-3599-4b5e-9124-035ed2f9f95d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:51.474499 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53718401-3599-4b5e-9124-035ed2f9f95d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:51.606115 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-53718401-3599-4b5e-9124-035ed2f9f95d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:51.613760 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-53718401-3599-4b5e-9124-035ed2f9f95d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.153395 Aug 04 23:30:51.614916 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 742/1517] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:51 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:52.360655 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2d62484c-708c-4481-83ed-0618c38e8a25 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:52.361268 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2d62484c-708c-4481-83ed-0618c38e8a25 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:52.367725 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d62484c-708c-4481-83ed-0618c38e8a25 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:52.368364 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d62484c-708c-4481-83ed-0618c38e8a25 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:52.368800 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d62484c-708c-4481-83ed-0618c38e8a25 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:52.369486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d62484c-708c-4481-83ed-0618c38e8a25 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:52.369942 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d62484c-708c-4481-83ed-0618c38e8a25 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:52.370343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d62484c-708c-4481-83ed-0618c38e8a25 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:52.432804 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2d62484c-708c-4481-83ed-0618c38e8a25 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:52.440256 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2d62484c-708c-4481-83ed-0618c38e8a25 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083633 Aug 04 23:30:52.440818 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 776/1518] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:52 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:52.636089 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-634758aa-ca60-4f46-b3c6-d72e54f5552e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:52.636651 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-634758aa-ca60-4f46-b3c6-d72e54f5552e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:52.643161 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-634758aa-ca60-4f46-b3c6-d72e54f5552e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:52.643640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-634758aa-ca60-4f46-b3c6-d72e54f5552e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:52.644074 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-634758aa-ca60-4f46-b3c6-d72e54f5552e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:52.644762 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-634758aa-ca60-4f46-b3c6-d72e54f5552e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:52.645219 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-634758aa-ca60-4f46-b3c6-d72e54f5552e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:52.645640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-634758aa-ca60-4f46-b3c6-d72e54f5552e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:52.781220 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-634758aa-ca60-4f46-b3c6-d72e54f5552e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:52.789437 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-634758aa-ca60-4f46-b3c6-d72e54f5552e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.157369 Aug 04 23:30:52.789993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 743/1519] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:52 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:53.468949 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-063a9156-6de9-4ed6-82ed-85a29cc0facf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:53.469589 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-063a9156-6de9-4ed6-82ed-85a29cc0facf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:53.476924 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-063a9156-6de9-4ed6-82ed-85a29cc0facf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:53.477403 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-063a9156-6de9-4ed6-82ed-85a29cc0facf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:53.477833 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-063a9156-6de9-4ed6-82ed-85a29cc0facf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:53.478569 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-063a9156-6de9-4ed6-82ed-85a29cc0facf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:53.479022 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-063a9156-6de9-4ed6-82ed-85a29cc0facf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:53.479486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-063a9156-6de9-4ed6-82ed-85a29cc0facf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:53.541573 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-063a9156-6de9-4ed6-82ed-85a29cc0facf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:53.543807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:30:53.550586 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-063a9156-6de9-4ed6-82ed-85a29cc0facf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085452 Aug 04 23:30:53.551173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 777/1520] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:53 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:53.811998 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e3d4dd61-31fd-468a-906a-ce58f6b11bcd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:53.812558 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e3d4dd61-31fd-468a-906a-ce58f6b11bcd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:53.820051 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e3d4dd61-31fd-468a-906a-ce58f6b11bcd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:53.820528 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e3d4dd61-31fd-468a-906a-ce58f6b11bcd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:53.820956 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e3d4dd61-31fd-468a-906a-ce58f6b11bcd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:53.821646 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e3d4dd61-31fd-468a-906a-ce58f6b11bcd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:53.822354 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e3d4dd61-31fd-468a-906a-ce58f6b11bcd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:53.822805 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e3d4dd61-31fd-468a-906a-ce58f6b11bcd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:53.955176 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e3d4dd61-31fd-468a-906a-ce58f6b11bcd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:53.963377 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e3d4dd61-31fd-468a-906a-ce58f6b11bcd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.155475 Aug 04 23:30:53.963940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 744/1521] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:53 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:54.573455 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ccd27c6a-dd77-4dcf-86ed-6ca231f272a2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:54.574065 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ccd27c6a-dd77-4dcf-86ed-6ca231f272a2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:54.580505 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ccd27c6a-dd77-4dcf-86ed-6ca231f272a2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:54.580979 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ccd27c6a-dd77-4dcf-86ed-6ca231f272a2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:54.581408 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ccd27c6a-dd77-4dcf-86ed-6ca231f272a2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:54.582091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ccd27c6a-dd77-4dcf-86ed-6ca231f272a2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:54.582929 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ccd27c6a-dd77-4dcf-86ed-6ca231f272a2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:54.583354 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ccd27c6a-dd77-4dcf-86ed-6ca231f272a2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:54.644867 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ccd27c6a-dd77-4dcf-86ed-6ca231f272a2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:54.652461 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ccd27c6a-dd77-4dcf-86ed-6ca231f272a2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083488 Aug 04 23:30:54.653021 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 778/1522] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:54 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:54.984208 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a884c79a-688e-4c26-b034-83ad3dfaaf72 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:54.984836 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a884c79a-688e-4c26-b034-83ad3dfaaf72 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:54.991301 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a884c79a-688e-4c26-b034-83ad3dfaaf72 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:54.991777 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a884c79a-688e-4c26-b034-83ad3dfaaf72 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:54.992207 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a884c79a-688e-4c26-b034-83ad3dfaaf72 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:54.992896 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a884c79a-688e-4c26-b034-83ad3dfaaf72 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:54.993343 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a884c79a-688e-4c26-b034-83ad3dfaaf72 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:54.993764 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a884c79a-688e-4c26-b034-83ad3dfaaf72 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:55.125835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a884c79a-688e-4c26-b034-83ad3dfaaf72 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:55.136099 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a884c79a-688e-4c26-b034-83ad3dfaaf72 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.154800 Aug 04 23:30:55.136705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 745/1523] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:54 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:55.674339 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-32452623-7590-4005-89b5-4f7808324fae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:55.675509 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-32452623-7590-4005-89b5-4f7808324fae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:55.683986 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32452623-7590-4005-89b5-4f7808324fae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:55.684461 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32452623-7590-4005-89b5-4f7808324fae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:55.684890 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32452623-7590-4005-89b5-4f7808324fae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:55.685584 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32452623-7590-4005-89b5-4f7808324fae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:55.686030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32452623-7590-4005-89b5-4f7808324fae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:55.686471 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32452623-7590-4005-89b5-4f7808324fae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:55.749263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-32452623-7590-4005-89b5-4f7808324fae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:55.758042 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-32452623-7590-4005-89b5-4f7808324fae tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087574 Aug 04 23:30:55.758642 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 779/1524] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:55 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:56.157222 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-348e049f-93e7-4f20-8552-dabcfc2a3daa tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:56.157783 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-348e049f-93e7-4f20-8552-dabcfc2a3daa tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:56.164821 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-348e049f-93e7-4f20-8552-dabcfc2a3daa tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:56.165297 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-348e049f-93e7-4f20-8552-dabcfc2a3daa tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:56.165736 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-348e049f-93e7-4f20-8552-dabcfc2a3daa tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:56.166450 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-348e049f-93e7-4f20-8552-dabcfc2a3daa tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:56.166908 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-348e049f-93e7-4f20-8552-dabcfc2a3daa tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:56.167332 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-348e049f-93e7-4f20-8552-dabcfc2a3daa tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:56.182619 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:30:56.314470 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-348e049f-93e7-4f20-8552-dabcfc2a3daa tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:56.323151 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-348e049f-93e7-4f20-8552-dabcfc2a3daa tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.169977 Aug 04 23:30:56.323719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 746/1525] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:56 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:56.779194 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1edc50d0-c906-4019-8513-75f0f8af3baf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:56.779796 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1edc50d0-c906-4019-8513-75f0f8af3baf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:56.786801 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1edc50d0-c906-4019-8513-75f0f8af3baf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:56.787277 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1edc50d0-c906-4019-8513-75f0f8af3baf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:56.787713 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1edc50d0-c906-4019-8513-75f0f8af3baf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:56.788398 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1edc50d0-c906-4019-8513-75f0f8af3baf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:56.788849 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1edc50d0-c906-4019-8513-75f0f8af3baf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:56.789266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1edc50d0-c906-4019-8513-75f0f8af3baf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:56.852464 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1edc50d0-c906-4019-8513-75f0f8af3baf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:56.859911 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1edc50d0-c906-4019-8513-75f0f8af3baf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084557 Aug 04 23:30:56.860492 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 780/1526] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:56 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:57.344307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-428baf48-d86a-4bda-8881-f89c0dcfd164 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:57.344947 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-428baf48-d86a-4bda-8881-f89c0dcfd164 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:57.347465 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=50 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:30:57.353590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-428baf48-d86a-4bda-8881-f89c0dcfd164 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:57.354079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-428baf48-d86a-4bda-8881-f89c0dcfd164 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:57.354575 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-428baf48-d86a-4bda-8881-f89c0dcfd164 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:57.355272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-428baf48-d86a-4bda-8881-f89c0dcfd164 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:57.355752 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-428baf48-d86a-4bda-8881-f89c0dcfd164 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:57.356176 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-428baf48-d86a-4bda-8881-f89c0dcfd164 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:57.493679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-428baf48-d86a-4bda-8881-f89c0dcfd164 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:57.501339 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-428baf48-d86a-4bda-8881-f89c0dcfd164 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.161079 Aug 04 23:30:57.501898 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 747/1527] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:57 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:57.881699 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-32abfbd9-4034-4678-85a6-672e9a6e3348 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:57.882312 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-32abfbd9-4034-4678-85a6-672e9a6e3348 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:57.888695 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32abfbd9-4034-4678-85a6-672e9a6e3348 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:57.889167 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32abfbd9-4034-4678-85a6-672e9a6e3348 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:57.889593 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32abfbd9-4034-4678-85a6-672e9a6e3348 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:57.890276 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32abfbd9-4034-4678-85a6-672e9a6e3348 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:57.890740 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32abfbd9-4034-4678-85a6-672e9a6e3348 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:57.891155 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32abfbd9-4034-4678-85a6-672e9a6e3348 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:57.953326 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-32abfbd9-4034-4678-85a6-672e9a6e3348 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:57.961696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-32abfbd9-4034-4678-85a6-672e9a6e3348 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084333 Aug 04 23:30:57.962271 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 781/1528] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:57 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:30:58.523217 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-fe7b6366-9ec5-4634-a826-433dda28d7ac tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:58.523813 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-fe7b6366-9ec5-4634-a826-433dda28d7ac tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:58.530198 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fe7b6366-9ec5-4634-a826-433dda28d7ac tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:58.530711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fe7b6366-9ec5-4634-a826-433dda28d7ac tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:58.531138 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fe7b6366-9ec5-4634-a826-433dda28d7ac tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:58.531816 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fe7b6366-9ec5-4634-a826-433dda28d7ac tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:58.532262 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fe7b6366-9ec5-4634-a826-433dda28d7ac tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:58.532673 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fe7b6366-9ec5-4634-a826-433dda28d7ac tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:58.665058 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-fe7b6366-9ec5-4634-a826-433dda28d7ac tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:58.672822 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-fe7b6366-9ec5-4634-a826-433dda28d7ac tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.153776 Aug 04 23:30:58.673421 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 748/1529] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:58 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:30:58.982698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-43c1b21f-259a-4203-a5d2-0de2ee2c9a1d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:58.983313 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-43c1b21f-259a-4203-a5d2-0de2ee2c9a1d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:58.985964 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=54 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:30:58.992093 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-43c1b21f-259a-4203-a5d2-0de2ee2c9a1d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:58.992576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-43c1b21f-259a-4203-a5d2-0de2ee2c9a1d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:58.993014 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-43c1b21f-259a-4203-a5d2-0de2ee2c9a1d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:58.993706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-43c1b21f-259a-4203-a5d2-0de2ee2c9a1d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:58.994164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-43c1b21f-259a-4203-a5d2-0de2ee2c9a1d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:58.994631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-43c1b21f-259a-4203-a5d2-0de2ee2c9a1d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:59.059081 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-43c1b21f-259a-4203-a5d2-0de2ee2c9a1d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:59.066693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-43c1b21f-259a-4203-a5d2-0de2ee2c9a1d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087838 Aug 04 23:30:59.067807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 782/1530] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:58 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:30:59.694948 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ca02ad67-cdd7-4d20-a1d2-a8a85754cb99 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:30:59.695559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ca02ad67-cdd7-4d20-a1d2-a8a85754cb99 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:30:59.702164 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca02ad67-cdd7-4d20-a1d2-a8a85754cb99 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:59.702677 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca02ad67-cdd7-4d20-a1d2-a8a85754cb99 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:59.703111 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca02ad67-cdd7-4d20-a1d2-a8a85754cb99 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:59.703798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca02ad67-cdd7-4d20-a1d2-a8a85754cb99 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:30:59.704247 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca02ad67-cdd7-4d20-a1d2-a8a85754cb99 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:30:59.704669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca02ad67-cdd7-4d20-a1d2-a8a85754cb99 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:30:59.844887 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ca02ad67-cdd7-4d20-a1d2-a8a85754cb99 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:30:59.852534 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ca02ad67-cdd7-4d20-a1d2-a8a85754cb99 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.162060 Aug 04 23:30:59.853082 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 749/1531] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:30:59 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:00.088862 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a065f18f-b2c1-46f4-acfb-72d4396cb6b3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:00.089409 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a065f18f-b2c1-46f4-acfb-72d4396cb6b3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:00.096487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a065f18f-b2c1-46f4-acfb-72d4396cb6b3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:00.097346 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a065f18f-b2c1-46f4-acfb-72d4396cb6b3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:00.098207 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a065f18f-b2c1-46f4-acfb-72d4396cb6b3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:00.099399 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a065f18f-b2c1-46f4-acfb-72d4396cb6b3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:00.100349 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a065f18f-b2c1-46f4-acfb-72d4396cb6b3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:00.101105 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a065f18f-b2c1-46f4-acfb-72d4396cb6b3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:00.163918 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a065f18f-b2c1-46f4-acfb-72d4396cb6b3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:00.171528 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a065f18f-b2c1-46f4-acfb-72d4396cb6b3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086666 Aug 04 23:31:00.172082 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 783/1532] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:00 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:00.873255 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-140e5dee-d703-4850-b5e6-77290a8cc436 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:00.873895 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-140e5dee-d703-4850-b5e6-77290a8cc436 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:00.880809 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-140e5dee-d703-4850-b5e6-77290a8cc436 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:00.881284 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-140e5dee-d703-4850-b5e6-77290a8cc436 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:00.881714 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-140e5dee-d703-4850-b5e6-77290a8cc436 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:00.882427 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-140e5dee-d703-4850-b5e6-77290a8cc436 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:00.882873 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-140e5dee-d703-4850-b5e6-77290a8cc436 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:00.883290 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-140e5dee-d703-4850-b5e6-77290a8cc436 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:01.017318 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-140e5dee-d703-4850-b5e6-77290a8cc436 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:01.025510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-140e5dee-d703-4850-b5e6-77290a8cc436 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.156153 Aug 04 23:31:01.026070 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 750/1533] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:00 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:01.194161 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-25acf658-83b7-47f2-bbab-836efea78576 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:01.194823 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-25acf658-83b7-47f2-bbab-836efea78576 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:01.201521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-25acf658-83b7-47f2-bbab-836efea78576 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:01.201996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-25acf658-83b7-47f2-bbab-836efea78576 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:01.202459 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-25acf658-83b7-47f2-bbab-836efea78576 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:01.203148 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-25acf658-83b7-47f2-bbab-836efea78576 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:01.203591 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-25acf658-83b7-47f2-bbab-836efea78576 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:01.204006 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-25acf658-83b7-47f2-bbab-836efea78576 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:01.269590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-25acf658-83b7-47f2-bbab-836efea78576 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:01.277783 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-25acf658-83b7-47f2-bbab-836efea78576 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089052 Aug 04 23:31:01.278339 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 784/1534] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:01 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:02.047061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-cf1b98fa-31e0-4400-bb84-fc6e977bd82f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:02.047675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-cf1b98fa-31e0-4400-bb84-fc6e977bd82f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:02.055195 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf1b98fa-31e0-4400-bb84-fc6e977bd82f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:02.055670 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf1b98fa-31e0-4400-bb84-fc6e977bd82f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:02.056102 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf1b98fa-31e0-4400-bb84-fc6e977bd82f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:02.056784 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf1b98fa-31e0-4400-bb84-fc6e977bd82f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:02.057224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf1b98fa-31e0-4400-bb84-fc6e977bd82f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:02.057640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf1b98fa-31e0-4400-bb84-fc6e977bd82f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:02.188064 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-cf1b98fa-31e0-4400-bb84-fc6e977bd82f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:02.196199 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-cf1b98fa-31e0-4400-bb84-fc6e977bd82f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.153156 Aug 04 23:31:02.197034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 751/1535] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:02 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:02.298274 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e9d268c5-27ee-4108-aa5c-2a326c93c55d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:02.298921 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e9d268c5-27ee-4108-aa5c-2a326c93c55d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:02.306212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e9d268c5-27ee-4108-aa5c-2a326c93c55d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:02.306789 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e9d268c5-27ee-4108-aa5c-2a326c93c55d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:02.307218 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e9d268c5-27ee-4108-aa5c-2a326c93c55d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:02.307903 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e9d268c5-27ee-4108-aa5c-2a326c93c55d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:02.308351 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e9d268c5-27ee-4108-aa5c-2a326c93c55d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:02.308769 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e9d268c5-27ee-4108-aa5c-2a326c93c55d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:02.370573 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e9d268c5-27ee-4108-aa5c-2a326c93c55d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:02.378181 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e9d268c5-27ee-4108-aa5c-2a326c93c55d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083734 Aug 04 23:31:02.378773 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 785/1536] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:02 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:03.218058 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-92e5e724-d980-43dc-b3db-537e432ab627 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:03.218684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-92e5e724-d980-43dc-b3db-537e432ab627 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:03.225930 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92e5e724-d980-43dc-b3db-537e432ab627 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:03.226430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92e5e724-d980-43dc-b3db-537e432ab627 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:03.226861 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92e5e724-d980-43dc-b3db-537e432ab627 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:03.227557 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92e5e724-d980-43dc-b3db-537e432ab627 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:03.228006 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92e5e724-d980-43dc-b3db-537e432ab627 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:03.228420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92e5e724-d980-43dc-b3db-537e432ab627 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:03.363224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-92e5e724-d980-43dc-b3db-537e432ab627 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:03.371446 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-92e5e724-d980-43dc-b3db-537e432ab627 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.157280 Aug 04 23:31:03.372198 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 752/1537] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:03 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:03.399604 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-228d45c5-a082-4608-846f-1052c6041976 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:03.400243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-228d45c5-a082-4608-846f-1052c6041976 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:03.407764 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-228d45c5-a082-4608-846f-1052c6041976 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:03.408487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-228d45c5-a082-4608-846f-1052c6041976 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:03.408977 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-228d45c5-a082-4608-846f-1052c6041976 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:03.409750 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-228d45c5-a082-4608-846f-1052c6041976 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:03.411023 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-228d45c5-a082-4608-846f-1052c6041976 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:03.411648 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-228d45c5-a082-4608-846f-1052c6041976 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:03.479952 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-228d45c5-a082-4608-846f-1052c6041976 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:03.487685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-228d45c5-a082-4608-846f-1052c6041976 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.093195 Aug 04 23:31:03.488254 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 786/1538] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:03 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:04.392694 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-bf3ae2ec-4739-401e-a91e-2433553d35f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:04.393310 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-bf3ae2ec-4739-401e-a91e-2433553d35f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:04.400515 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bf3ae2ec-4739-401e-a91e-2433553d35f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:04.400991 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bf3ae2ec-4739-401e-a91e-2433553d35f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:04.401426 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bf3ae2ec-4739-401e-a91e-2433553d35f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:04.402116 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bf3ae2ec-4739-401e-a91e-2433553d35f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:04.402595 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bf3ae2ec-4739-401e-a91e-2433553d35f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:04.403017 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bf3ae2ec-4739-401e-a91e-2433553d35f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:04.509120 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4f03a0bc-1684-4255-b8aa-06b65993785c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:04.509719 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4f03a0bc-1684-4255-b8aa-06b65993785c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:04.516344 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f03a0bc-1684-4255-b8aa-06b65993785c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:04.516827 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f03a0bc-1684-4255-b8aa-06b65993785c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:04.517266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f03a0bc-1684-4255-b8aa-06b65993785c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:04.517976 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f03a0bc-1684-4255-b8aa-06b65993785c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:04.518455 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f03a0bc-1684-4255-b8aa-06b65993785c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:04.518882 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f03a0bc-1684-4255-b8aa-06b65993785c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:04.540341 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-bf3ae2ec-4739-401e-a91e-2433553d35f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:04.548249 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-bf3ae2ec-4739-401e-a91e-2433553d35f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.159479 Aug 04 23:31:04.548816 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 753/1539] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:04 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:04.581584 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4f03a0bc-1684-4255-b8aa-06b65993785c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:04.589814 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4f03a0bc-1684-4255-b8aa-06b65993785c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084555 Aug 04 23:31:04.590385 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 787/1540] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:04 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:31:05.569092 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-610eeab3-8af4-4d5c-826a-9c4b00164751 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:05.569707 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-610eeab3-8af4-4d5c-826a-9c4b00164751 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:05.576466 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-610eeab3-8af4-4d5c-826a-9c4b00164751 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:05.576958 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-610eeab3-8af4-4d5c-826a-9c4b00164751 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:05.577396 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-610eeab3-8af4-4d5c-826a-9c4b00164751 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:05.578096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-610eeab3-8af4-4d5c-826a-9c4b00164751 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:05.578589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-610eeab3-8af4-4d5c-826a-9c4b00164751 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:05.579018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-610eeab3-8af4-4d5c-826a-9c4b00164751 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:05.610103 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-dd382346-b9ac-493d-b665-c3939fc4e923 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:05.610749 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-dd382346-b9ac-493d-b665-c3939fc4e923 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:05.618297 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd382346-b9ac-493d-b665-c3939fc4e923 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:05.618818 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd382346-b9ac-493d-b665-c3939fc4e923 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:05.619255 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd382346-b9ac-493d-b665-c3939fc4e923 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:05.619966 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd382346-b9ac-493d-b665-c3939fc4e923 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:05.620423 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd382346-b9ac-493d-b665-c3939fc4e923 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:05.620851 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd382346-b9ac-493d-b665-c3939fc4e923 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:05.694566 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-dd382346-b9ac-493d-b665-c3939fc4e923 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:05.702631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-dd382346-b9ac-493d-b665-c3939fc4e923 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.096263 Aug 04 23:31:05.703196 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 788/1541] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:05 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:31:05.740884 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-610eeab3-8af4-4d5c-826a-9c4b00164751 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:05.748516 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-610eeab3-8af4-4d5c-826a-9c4b00164751 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.183395 Aug 04 23:31:05.749085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 754/1542] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:05 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:06.725459 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d7535b29-8a20-4ac9-94b0-9a212a371b03 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:06.726071 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d7535b29-8a20-4ac9-94b0-9a212a371b03 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:06.732497 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d7535b29-8a20-4ac9-94b0-9a212a371b03 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:06.732973 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d7535b29-8a20-4ac9-94b0-9a212a371b03 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:06.733434 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d7535b29-8a20-4ac9-94b0-9a212a371b03 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:06.734123 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d7535b29-8a20-4ac9-94b0-9a212a371b03 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:06.734607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d7535b29-8a20-4ac9-94b0-9a212a371b03 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:06.735028 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d7535b29-8a20-4ac9-94b0-9a212a371b03 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:06.771120 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-18e46f92-06fa-40e6-9898-50a1bdddafca tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:06.771732 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-18e46f92-06fa-40e6-9898-50a1bdddafca tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:06.779132 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-18e46f92-06fa-40e6-9898-50a1bdddafca tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:06.779649 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-18e46f92-06fa-40e6-9898-50a1bdddafca tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:06.780087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-18e46f92-06fa-40e6-9898-50a1bdddafca tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:06.780828 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-18e46f92-06fa-40e6-9898-50a1bdddafca tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:06.781283 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-18e46f92-06fa-40e6-9898-50a1bdddafca tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:06.781711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-18e46f92-06fa-40e6-9898-50a1bdddafca tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:06.802501 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d7535b29-8a20-4ac9-94b0-9a212a371b03 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:06.809994 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d7535b29-8a20-4ac9-94b0-9a212a371b03 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089302 Aug 04 23:31:06.810818 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 789/1543] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:06 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:06.916354 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-18e46f92-06fa-40e6-9898-50a1bdddafca tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:06.923926 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-18e46f92-06fa-40e6-9898-50a1bdddafca tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.157254 Aug 04 23:31:06.924491 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 755/1544] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:06 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:31:07.833072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2785c993-87b4-4562-b80e-4f771ff134b1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:07.833806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2785c993-87b4-4562-b80e-4f771ff134b1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:07.840334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2785c993-87b4-4562-b80e-4f771ff134b1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:07.840814 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2785c993-87b4-4562-b80e-4f771ff134b1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:07.841250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2785c993-87b4-4562-b80e-4f771ff134b1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:07.841941 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2785c993-87b4-4562-b80e-4f771ff134b1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:07.842428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2785c993-87b4-4562-b80e-4f771ff134b1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:07.842850 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2785c993-87b4-4562-b80e-4f771ff134b1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:07.905384 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2785c993-87b4-4562-b80e-4f771ff134b1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:07.913623 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2785c993-87b4-4562-b80e-4f771ff134b1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085055 Aug 04 23:31:07.914196 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 790/1545] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:07 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:07.945605 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-043ca396-eebd-4824-a5cf-beb13f584ef1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:07.946265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-043ca396-eebd-4824-a5cf-beb13f584ef1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:07.953076 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-043ca396-eebd-4824-a5cf-beb13f584ef1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:07.953556 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-043ca396-eebd-4824-a5cf-beb13f584ef1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:07.954003 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-043ca396-eebd-4824-a5cf-beb13f584ef1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:07.954722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-043ca396-eebd-4824-a5cf-beb13f584ef1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:07.955179 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-043ca396-eebd-4824-a5cf-beb13f584ef1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:07.955605 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-043ca396-eebd-4824-a5cf-beb13f584ef1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:08.090315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-043ca396-eebd-4824-a5cf-beb13f584ef1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:08.098426 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-043ca396-eebd-4824-a5cf-beb13f584ef1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.156682 Aug 04 23:31:08.098992 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 756/1546] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:07 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:08.933964 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6a3da416-c190-4197-b320-8d2a2a4891e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:08.934671 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6a3da416-c190-4197-b320-8d2a2a4891e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:08.941537 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6a3da416-c190-4197-b320-8d2a2a4891e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:08.941537 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6a3da416-c190-4197-b320-8d2a2a4891e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:08.941959 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6a3da416-c190-4197-b320-8d2a2a4891e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:08.942688 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6a3da416-c190-4197-b320-8d2a2a4891e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:08.943140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6a3da416-c190-4197-b320-8d2a2a4891e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:08.943560 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6a3da416-c190-4197-b320-8d2a2a4891e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:09.005354 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6a3da416-c190-4197-b320-8d2a2a4891e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:09.012933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6a3da416-c190-4197-b320-8d2a2a4891e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.082830 Aug 04 23:31:09.013490 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 791/1547] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:08 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:09.119373 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f4ea6380-e142-48c0-9056-9ef8d3f0f74d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:09.119911 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f4ea6380-e142-48c0-9056-9ef8d3f0f74d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:09.126549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4ea6380-e142-48c0-9056-9ef8d3f0f74d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:09.127054 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4ea6380-e142-48c0-9056-9ef8d3f0f74d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:09.127469 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4ea6380-e142-48c0-9056-9ef8d3f0f74d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:09.128168 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4ea6380-e142-48c0-9056-9ef8d3f0f74d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:09.128624 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4ea6380-e142-48c0-9056-9ef8d3f0f74d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:09.129054 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4ea6380-e142-48c0-9056-9ef8d3f0f74d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:09.268497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f4ea6380-e142-48c0-9056-9ef8d3f0f74d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:09.277020 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f4ea6380-e142-48c0-9056-9ef8d3f0f74d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.161575 Aug 04 23:31:09.277583 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 757/1548] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:09 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:10.033121 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e76ad1f5-ac60-4963-ac22-c33a25a272e3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:10.033952 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e76ad1f5-ac60-4963-ac22-c33a25a272e3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:10.041171 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e76ad1f5-ac60-4963-ac22-c33a25a272e3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:10.041651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e76ad1f5-ac60-4963-ac22-c33a25a272e3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:10.042084 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e76ad1f5-ac60-4963-ac22-c33a25a272e3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:10.042805 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e76ad1f5-ac60-4963-ac22-c33a25a272e3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:10.043251 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e76ad1f5-ac60-4963-ac22-c33a25a272e3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:10.043665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e76ad1f5-ac60-4963-ac22-c33a25a272e3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:10.108424 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e76ad1f5-ac60-4963-ac22-c33a25a272e3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:10.116120 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e76ad1f5-ac60-4963-ac22-c33a25a272e3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087051 Aug 04 23:31:10.116680 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 792/1549] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:10 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:10.298665 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-22baccbb-20c5-4941-9672-70c6fdb3d6d8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:10.299386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-22baccbb-20c5-4941-9672-70c6fdb3d6d8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:10.305891 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-22baccbb-20c5-4941-9672-70c6fdb3d6d8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:10.306442 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-22baccbb-20c5-4941-9672-70c6fdb3d6d8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:10.306841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-22baccbb-20c5-4941-9672-70c6fdb3d6d8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:10.307537 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-22baccbb-20c5-4941-9672-70c6fdb3d6d8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:10.307988 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-22baccbb-20c5-4941-9672-70c6fdb3d6d8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:10.308412 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-22baccbb-20c5-4941-9672-70c6fdb3d6d8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:10.453296 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-22baccbb-20c5-4941-9672-70c6fdb3d6d8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:10.462616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-22baccbb-20c5-4941-9672-70c6fdb3d6d8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.167660 Aug 04 23:31:10.463417 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 758/1550] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:10 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:11.136772 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4dc6d519-d031-46be-ab83-a0ca1867c98a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:11.137356 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4dc6d519-d031-46be-ab83-a0ca1867c98a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:11.143747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dc6d519-d031-46be-ab83-a0ca1867c98a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:11.144242 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dc6d519-d031-46be-ab83-a0ca1867c98a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:11.144661 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dc6d519-d031-46be-ab83-a0ca1867c98a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:11.145344 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dc6d519-d031-46be-ab83-a0ca1867c98a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:11.145816 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dc6d519-d031-46be-ab83-a0ca1867c98a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:11.146237 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dc6d519-d031-46be-ab83-a0ca1867c98a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:11.209767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4dc6d519-d031-46be-ab83-a0ca1867c98a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:11.218282 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4dc6d519-d031-46be-ab83-a0ca1867c98a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085379 Aug 04 23:31:11.218928 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 793/1551] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:11 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:11.485076 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-261e51dc-fbde-4f48-8228-b5025f9ee15b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:11.485669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-261e51dc-fbde-4f48-8228-b5025f9ee15b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:11.492337 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-261e51dc-fbde-4f48-8228-b5025f9ee15b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:11.492811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-261e51dc-fbde-4f48-8228-b5025f9ee15b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:11.493247 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-261e51dc-fbde-4f48-8228-b5025f9ee15b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:11.493937 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-261e51dc-fbde-4f48-8228-b5025f9ee15b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:11.494478 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-261e51dc-fbde-4f48-8228-b5025f9ee15b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:11.494905 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-261e51dc-fbde-4f48-8228-b5025f9ee15b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:11.631455 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-261e51dc-fbde-4f48-8228-b5025f9ee15b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:11.639066 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-261e51dc-fbde-4f48-8228-b5025f9ee15b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.157909 Aug 04 23:31:11.639632 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 759/1552] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:11 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:12.239774 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b43f0e45-6ac9-42c7-bd58-97c19f891017 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:12.240501 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b43f0e45-6ac9-42c7-bd58-97c19f891017 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:12.247009 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b43f0e45-6ac9-42c7-bd58-97c19f891017 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:12.247492 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b43f0e45-6ac9-42c7-bd58-97c19f891017 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:12.247932 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b43f0e45-6ac9-42c7-bd58-97c19f891017 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:12.248621 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b43f0e45-6ac9-42c7-bd58-97c19f891017 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:12.249074 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b43f0e45-6ac9-42c7-bd58-97c19f891017 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:12.249495 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b43f0e45-6ac9-42c7-bd58-97c19f891017 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:12.264521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:31:12.312486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b43f0e45-6ac9-42c7-bd58-97c19f891017 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:12.320669 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b43f0e45-6ac9-42c7-bd58-97c19f891017 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084954 Aug 04 23:31:12.321618 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 794/1553] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:12 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:12.662515 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-cccd2bc3-e262-481f-b30b-4ddfa7d4a5be tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:12.663196 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-cccd2bc3-e262-481f-b30b-4ddfa7d4a5be tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:12.670046 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cccd2bc3-e262-481f-b30b-4ddfa7d4a5be tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:12.670578 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cccd2bc3-e262-481f-b30b-4ddfa7d4a5be tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:12.671024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cccd2bc3-e262-481f-b30b-4ddfa7d4a5be tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:12.671736 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cccd2bc3-e262-481f-b30b-4ddfa7d4a5be tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:12.672194 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cccd2bc3-e262-481f-b30b-4ddfa7d4a5be tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:12.672622 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cccd2bc3-e262-481f-b30b-4ddfa7d4a5be tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:12.809808 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-cccd2bc3-e262-481f-b30b-4ddfa7d4a5be tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:12.817308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-cccd2bc3-e262-481f-b30b-4ddfa7d4a5be tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.159571 Aug 04 23:31:12.818042 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 760/1554] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:12 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:13.341393 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1d0e95cb-76d4-47af-96b3-0d809b21eb47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:13.341981 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1d0e95cb-76d4-47af-96b3-0d809b21eb47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:13.348987 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1d0e95cb-76d4-47af-96b3-0d809b21eb47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:13.349828 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1d0e95cb-76d4-47af-96b3-0d809b21eb47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:13.350270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1d0e95cb-76d4-47af-96b3-0d809b21eb47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:13.351004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1d0e95cb-76d4-47af-96b3-0d809b21eb47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:13.351456 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1d0e95cb-76d4-47af-96b3-0d809b21eb47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:13.351866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1d0e95cb-76d4-47af-96b3-0d809b21eb47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:13.418627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1d0e95cb-76d4-47af-96b3-0d809b21eb47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:13.426117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1d0e95cb-76d4-47af-96b3-0d809b21eb47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.088709 Aug 04 23:31:13.426708 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 795/1555] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:13 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:13.839235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a4795353-f602-46dc-9947-7b4d2eed4d74 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:13.839849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a4795353-f602-46dc-9947-7b4d2eed4d74 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:13.846336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a4795353-f602-46dc-9947-7b4d2eed4d74 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:13.846830 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a4795353-f602-46dc-9947-7b4d2eed4d74 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:13.847259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a4795353-f602-46dc-9947-7b4d2eed4d74 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:13.847945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a4795353-f602-46dc-9947-7b4d2eed4d74 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:13.848394 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a4795353-f602-46dc-9947-7b4d2eed4d74 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:13.849598 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a4795353-f602-46dc-9947-7b4d2eed4d74 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:13.982719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a4795353-f602-46dc-9947-7b4d2eed4d74 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:13.990655 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a4795353-f602-46dc-9947-7b4d2eed4d74 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.155172 Aug 04 23:31:13.991252 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 761/1556] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:13 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:14.447830 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-870fa46b-b354-40e6-8793-1a43404bb948 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:14.448430 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-870fa46b-b354-40e6-8793-1a43404bb948 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:14.454864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-870fa46b-b354-40e6-8793-1a43404bb948 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:14.455331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-870fa46b-b354-40e6-8793-1a43404bb948 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:14.455755 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-870fa46b-b354-40e6-8793-1a43404bb948 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:14.456441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-870fa46b-b354-40e6-8793-1a43404bb948 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:14.456888 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-870fa46b-b354-40e6-8793-1a43404bb948 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:14.457300 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-870fa46b-b354-40e6-8793-1a43404bb948 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:14.519655 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-870fa46b-b354-40e6-8793-1a43404bb948 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:14.527800 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-870fa46b-b354-40e6-8793-1a43404bb948 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084113 Aug 04 23:31:14.528370 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 796/1557] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:14 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:15.012198 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-94505ffe-3daa-4aa3-aabd-0318bd9e5182 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:15.012787 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-94505ffe-3daa-4aa3-aabd-0318bd9e5182 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:15.019203 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94505ffe-3daa-4aa3-aabd-0318bd9e5182 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:15.019676 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94505ffe-3daa-4aa3-aabd-0318bd9e5182 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:15.020100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94505ffe-3daa-4aa3-aabd-0318bd9e5182 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:15.021576 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94505ffe-3daa-4aa3-aabd-0318bd9e5182 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:15.022059 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94505ffe-3daa-4aa3-aabd-0318bd9e5182 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:15.022509 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94505ffe-3daa-4aa3-aabd-0318bd9e5182 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:15.155090 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-94505ffe-3daa-4aa3-aabd-0318bd9e5182 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:15.162673 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-94505ffe-3daa-4aa3-aabd-0318bd9e5182 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.154276 Aug 04 23:31:15.163246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 762/1558] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:15 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:15.549279 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-68fa995e-9fe7-4eec-b220-fd06b186bdaa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:15.549888 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-68fa995e-9fe7-4eec-b220-fd06b186bdaa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:15.557034 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68fa995e-9fe7-4eec-b220-fd06b186bdaa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:15.557511 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68fa995e-9fe7-4eec-b220-fd06b186bdaa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:15.558051 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68fa995e-9fe7-4eec-b220-fd06b186bdaa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:15.558652 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68fa995e-9fe7-4eec-b220-fd06b186bdaa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:15.559100 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68fa995e-9fe7-4eec-b220-fd06b186bdaa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:15.559519 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68fa995e-9fe7-4eec-b220-fd06b186bdaa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:15.621991 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-68fa995e-9fe7-4eec-b220-fd06b186bdaa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:15.629545 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-68fa995e-9fe7-4eec-b220-fd06b186bdaa tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084170 Aug 04 23:31:15.630186 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 797/1559] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:15 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:16.183175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b14a0110-b41d-4728-acd5-1f536a93e67b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:16.183785 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b14a0110-b41d-4728-acd5-1f536a93e67b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:16.190348 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b14a0110-b41d-4728-acd5-1f536a93e67b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:16.190860 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b14a0110-b41d-4728-acd5-1f536a93e67b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:16.191294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b14a0110-b41d-4728-acd5-1f536a93e67b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:16.191984 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b14a0110-b41d-4728-acd5-1f536a93e67b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:16.193074 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b14a0110-b41d-4728-acd5-1f536a93e67b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:16.193516 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b14a0110-b41d-4728-acd5-1f536a93e67b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:16.196435 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:31:16.328585 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b14a0110-b41d-4728-acd5-1f536a93e67b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:16.336878 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b14a0110-b41d-4728-acd5-1f536a93e67b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.157518 Aug 04 23:31:16.337437 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 763/1560] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:16 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:16.650530 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-242fad4c-3d07-40cd-8d38-88add79f4e30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:16.651173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-242fad4c-3d07-40cd-8d38-88add79f4e30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:16.657601 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-242fad4c-3d07-40cd-8d38-88add79f4e30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:16.658082 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-242fad4c-3d07-40cd-8d38-88add79f4e30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:16.658546 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-242fad4c-3d07-40cd-8d38-88add79f4e30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:16.659240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-242fad4c-3d07-40cd-8d38-88add79f4e30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:16.659692 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-242fad4c-3d07-40cd-8d38-88add79f4e30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:16.660117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-242fad4c-3d07-40cd-8d38-88add79f4e30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:16.725752 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-242fad4c-3d07-40cd-8d38-88add79f4e30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:16.733277 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-242fad4c-3d07-40cd-8d38-88add79f4e30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086678 Aug 04 23:31:16.733836 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 798/1561] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:16 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:17.358110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-49d48db6-b8d2-4194-b6d3-e011205620d3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:17.358795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-49d48db6-b8d2-4194-b6d3-e011205620d3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:17.365924 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49d48db6-b8d2-4194-b6d3-e011205620d3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:17.366422 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49d48db6-b8d2-4194-b6d3-e011205620d3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:17.366855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49d48db6-b8d2-4194-b6d3-e011205620d3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:17.367546 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49d48db6-b8d2-4194-b6d3-e011205620d3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:17.368004 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49d48db6-b8d2-4194-b6d3-e011205620d3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:17.368421 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49d48db6-b8d2-4194-b6d3-e011205620d3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:17.500158 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-49d48db6-b8d2-4194-b6d3-e011205620d3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:17.508350 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-49d48db6-b8d2-4194-b6d3-e011205620d3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.154256 Aug 04 23:31:17.508911 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 764/1562] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:17 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:17.757360 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a41d6d36-99e6-44ce-89c1-20f54401c1ee tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:17.757986 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a41d6d36-99e6-44ce-89c1-20f54401c1ee tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:17.764458 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a41d6d36-99e6-44ce-89c1-20f54401c1ee tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:17.764937 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a41d6d36-99e6-44ce-89c1-20f54401c1ee tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:17.765370 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a41d6d36-99e6-44ce-89c1-20f54401c1ee tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:17.766058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a41d6d36-99e6-44ce-89c1-20f54401c1ee tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:17.766548 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a41d6d36-99e6-44ce-89c1-20f54401c1ee tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:17.766971 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a41d6d36-99e6-44ce-89c1-20f54401c1ee tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:17.832070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a41d6d36-99e6-44ce-89c1-20f54401c1ee tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:17.840027 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a41d6d36-99e6-44ce-89c1-20f54401c1ee tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087102 Aug 04 23:31:17.840598 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 799/1563] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:17 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:18.529062 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9ec33c53-3284-4feb-90b2-1cc587864a90 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:18.529688 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9ec33c53-3284-4feb-90b2-1cc587864a90 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:18.536358 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ec33c53-3284-4feb-90b2-1cc587864a90 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:18.536902 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ec33c53-3284-4feb-90b2-1cc587864a90 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:18.537340 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ec33c53-3284-4feb-90b2-1cc587864a90 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:18.538036 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ec33c53-3284-4feb-90b2-1cc587864a90 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:18.538524 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ec33c53-3284-4feb-90b2-1cc587864a90 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:18.538951 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ec33c53-3284-4feb-90b2-1cc587864a90 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:18.674900 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9ec33c53-3284-4feb-90b2-1cc587864a90 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:18.682616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9ec33c53-3284-4feb-90b2-1cc587864a90 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.157381 Aug 04 23:31:18.683186 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 765/1564] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:18 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:18.861800 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-140088dc-f1ec-4b65-824f-47326a901612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:18.862433 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-140088dc-f1ec-4b65-824f-47326a901612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:18.869092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-140088dc-f1ec-4b65-824f-47326a901612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:18.869569 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-140088dc-f1ec-4b65-824f-47326a901612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:18.869995 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-140088dc-f1ec-4b65-824f-47326a901612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:18.870709 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-140088dc-f1ec-4b65-824f-47326a901612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:18.871156 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-140088dc-f1ec-4b65-824f-47326a901612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:18.871573 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-140088dc-f1ec-4b65-824f-47326a901612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:18.932728 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-140088dc-f1ec-4b65-824f-47326a901612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:18.940260 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-140088dc-f1ec-4b65-824f-47326a901612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083038 Aug 04 23:31:18.940816 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 800/1565] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:18 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:19.704911 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4be3b4f9-fbf7-4905-a7e4-c303b39cb028 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:19.705506 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4be3b4f9-fbf7-4905-a7e4-c303b39cb028 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:19.712656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4be3b4f9-fbf7-4905-a7e4-c303b39cb028 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:19.713142 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4be3b4f9-fbf7-4905-a7e4-c303b39cb028 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:19.713576 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4be3b4f9-fbf7-4905-a7e4-c303b39cb028 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:19.714281 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4be3b4f9-fbf7-4905-a7e4-c303b39cb028 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:19.714829 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4be3b4f9-fbf7-4905-a7e4-c303b39cb028 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:19.715258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4be3b4f9-fbf7-4905-a7e4-c303b39cb028 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:19.861618 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4be3b4f9-fbf7-4905-a7e4-c303b39cb028 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:19.870584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4be3b4f9-fbf7-4905-a7e4-c303b39cb028 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.169335 Aug 04 23:31:19.871228 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 766/1566] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:19 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:19.962709 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5f9baa3e-d47f-48df-b9fa-fe21f0e5c1e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:19.963309 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5f9baa3e-d47f-48df-b9fa-fe21f0e5c1e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:19.970302 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5f9baa3e-d47f-48df-b9fa-fe21f0e5c1e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:19.970824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5f9baa3e-d47f-48df-b9fa-fe21f0e5c1e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:19.971255 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5f9baa3e-d47f-48df-b9fa-fe21f0e5c1e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:19.971955 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5f9baa3e-d47f-48df-b9fa-fe21f0e5c1e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:19.972403 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5f9baa3e-d47f-48df-b9fa-fe21f0e5c1e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:19.972821 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5f9baa3e-d47f-48df-b9fa-fe21f0e5c1e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:20.043269 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5f9baa3e-d47f-48df-b9fa-fe21f0e5c1e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:20.051694 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5f9baa3e-d47f-48df-b9fa-fe21f0e5c1e8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.093198 Aug 04 23:31:20.052761 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 801/1567] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:19 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:20.893150 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-fbb7cf53-af72-4514-930e-437e4c039ad9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:20.893758 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-fbb7cf53-af72-4514-930e-437e4c039ad9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:20.901183 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbb7cf53-af72-4514-930e-437e4c039ad9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:20.901667 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbb7cf53-af72-4514-930e-437e4c039ad9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:20.902109 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbb7cf53-af72-4514-930e-437e4c039ad9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:20.902833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbb7cf53-af72-4514-930e-437e4c039ad9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:20.903287 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbb7cf53-af72-4514-930e-437e4c039ad9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:20.903712 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbb7cf53-af72-4514-930e-437e4c039ad9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:21.045312 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-fbb7cf53-af72-4514-930e-437e4c039ad9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:21.053910 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-fbb7cf53-af72-4514-930e-437e4c039ad9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.164545 Aug 04 23:31:21.054542 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 767/1568] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:20 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:21.073481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-69abdb58-5be7-42ed-b9a5-e3f8f0285ae6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:21.074097 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-69abdb58-5be7-42ed-b9a5-e3f8f0285ae6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:21.080781 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-69abdb58-5be7-42ed-b9a5-e3f8f0285ae6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:21.081226 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-69abdb58-5be7-42ed-b9a5-e3f8f0285ae6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:21.081659 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-69abdb58-5be7-42ed-b9a5-e3f8f0285ae6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:21.082425 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-69abdb58-5be7-42ed-b9a5-e3f8f0285ae6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:21.083391 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-69abdb58-5be7-42ed-b9a5-e3f8f0285ae6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:21.083825 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-69abdb58-5be7-42ed-b9a5-e3f8f0285ae6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:21.154057 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-69abdb58-5be7-42ed-b9a5-e3f8f0285ae6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:21.162738 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-69abdb58-5be7-42ed-b9a5-e3f8f0285ae6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.093389 Aug 04 23:31:21.163305 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 802/1569] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:21 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:22.075165 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-54db1726-4341-4ae1-bc10-a926389d977f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:22.075756 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-54db1726-4341-4ae1-bc10-a926389d977f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:22.082210 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54db1726-4341-4ae1-bc10-a926389d977f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:22.083274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54db1726-4341-4ae1-bc10-a926389d977f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:22.083839 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54db1726-4341-4ae1-bc10-a926389d977f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:22.084551 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54db1726-4341-4ae1-bc10-a926389d977f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:22.085004 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54db1726-4341-4ae1-bc10-a926389d977f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:22.085429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54db1726-4341-4ae1-bc10-a926389d977f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:22.183526 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-73957e3a-8e44-4a4e-8a71-c8a47b7455fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:22.184232 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-73957e3a-8e44-4a4e-8a71-c8a47b7455fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:22.190976 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-73957e3a-8e44-4a4e-8a71-c8a47b7455fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:22.191500 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-73957e3a-8e44-4a4e-8a71-c8a47b7455fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:22.191932 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-73957e3a-8e44-4a4e-8a71-c8a47b7455fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:22.193371 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-73957e3a-8e44-4a4e-8a71-c8a47b7455fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:22.193833 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-73957e3a-8e44-4a4e-8a71-c8a47b7455fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:22.194260 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-73957e3a-8e44-4a4e-8a71-c8a47b7455fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:22.230283 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-54db1726-4341-4ae1-bc10-a926389d977f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:22.242943 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-54db1726-4341-4ae1-bc10-a926389d977f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.171720 Aug 04 23:31:22.243553 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 768/1570] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:22 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:22.258475 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-73957e3a-8e44-4a4e-8a71-c8a47b7455fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:22.266336 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-73957e3a-8e44-4a4e-8a71-c8a47b7455fb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086915 Aug 04 23:31:22.266923 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 803/1571] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:22 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:31:23.264335 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-88580c22-2986-4a13-90d0-3e272ad89fa2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:23.264935 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-88580c22-2986-4a13-90d0-3e272ad89fa2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:23.271358 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-88580c22-2986-4a13-90d0-3e272ad89fa2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:23.271828 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-88580c22-2986-4a13-90d0-3e272ad89fa2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:23.272253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-88580c22-2986-4a13-90d0-3e272ad89fa2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:23.273146 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-88580c22-2986-4a13-90d0-3e272ad89fa2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:23.273388 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-88580c22-2986-4a13-90d0-3e272ad89fa2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:23.273806 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-88580c22-2986-4a13-90d0-3e272ad89fa2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:23.290351 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-01eab4ec-a6e3-48c4-abf2-4a0619baa63c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:23.291001 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-01eab4ec-a6e3-48c4-abf2-4a0619baa63c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:23.296842 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-01eab4ec-a6e3-48c4-abf2-4a0619baa63c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:23.297345 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-01eab4ec-a6e3-48c4-abf2-4a0619baa63c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:23.297780 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-01eab4ec-a6e3-48c4-abf2-4a0619baa63c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:23.298525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-01eab4ec-a6e3-48c4-abf2-4a0619baa63c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:23.298989 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-01eab4ec-a6e3-48c4-abf2-4a0619baa63c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:23.299426 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-01eab4ec-a6e3-48c4-abf2-4a0619baa63c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:23.372174 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-01eab4ec-a6e3-48c4-abf2-4a0619baa63c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:23.379953 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-01eab4ec-a6e3-48c4-abf2-4a0619baa63c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.095296 Aug 04 23:31:23.380924 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 804/1572] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:23 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:31:23.406756 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:31:23.407025 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:31:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:31:23.439849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-88580c22-2986-4a13-90d0-3e272ad89fa2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:23.448741 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-88580c22-2986-4a13-90d0-3e272ad89fa2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.188210 Aug 04 23:31:23.449320 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 769/1573] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:23 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:24.401000 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b20537f5-fe45-420c-af3a-12b725ef406b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:24.401605 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b20537f5-fe45-420c-af3a-12b725ef406b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:24.408004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b20537f5-fe45-420c-af3a-12b725ef406b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:24.408480 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b20537f5-fe45-420c-af3a-12b725ef406b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:24.408910 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b20537f5-fe45-420c-af3a-12b725ef406b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:24.409590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b20537f5-fe45-420c-af3a-12b725ef406b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:24.410109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b20537f5-fe45-420c-af3a-12b725ef406b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:24.410486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b20537f5-fe45-420c-af3a-12b725ef406b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:24.470426 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a0a12a97-3243-4054-8ce4-35e7fd3d219c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:24.471007 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a0a12a97-3243-4054-8ce4-35e7fd3d219c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:24.472532 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b20537f5-fe45-420c-af3a-12b725ef406b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:24.477774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0a12a97-3243-4054-8ce4-35e7fd3d219c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:24.478253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0a12a97-3243-4054-8ce4-35e7fd3d219c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:24.478717 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0a12a97-3243-4054-8ce4-35e7fd3d219c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:24.479412 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0a12a97-3243-4054-8ce4-35e7fd3d219c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:24.479852 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0a12a97-3243-4054-8ce4-35e7fd3d219c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:24.480274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0a12a97-3243-4054-8ce4-35e7fd3d219c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:24.480539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b20537f5-fe45-420c-af3a-12b725ef406b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083405 Aug 04 23:31:24.481103 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 805/1574] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:24 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:24.616504 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a0a12a97-3243-4054-8ce4-35e7fd3d219c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:24.624205 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a0a12a97-3243-4054-8ce4-35e7fd3d219c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.157843 Aug 04 23:31:24.624772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 770/1575] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:24 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:31:25.502305 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3b6f1385-d249-4e09-8f31-abe5a14da5b2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:25.502957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3b6f1385-d249-4e09-8f31-abe5a14da5b2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:25.510100 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3b6f1385-d249-4e09-8f31-abe5a14da5b2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:25.510610 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3b6f1385-d249-4e09-8f31-abe5a14da5b2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:25.511042 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3b6f1385-d249-4e09-8f31-abe5a14da5b2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:25.511729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3b6f1385-d249-4e09-8f31-abe5a14da5b2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:25.512177 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3b6f1385-d249-4e09-8f31-abe5a14da5b2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:25.512594 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3b6f1385-d249-4e09-8f31-abe5a14da5b2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:25.580065 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3b6f1385-d249-4e09-8f31-abe5a14da5b2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:25.587900 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3b6f1385-d249-4e09-8f31-abe5a14da5b2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089457 Aug 04 23:31:25.588462 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 806/1576] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:25 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:25.644700 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b429148a-85d1-4b38-a8d2-757141fa8452 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:25.645312 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b429148a-85d1-4b38-a8d2-757141fa8452 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:25.651872 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b429148a-85d1-4b38-a8d2-757141fa8452 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:25.652383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b429148a-85d1-4b38-a8d2-757141fa8452 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:25.652824 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b429148a-85d1-4b38-a8d2-757141fa8452 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:25.653559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b429148a-85d1-4b38-a8d2-757141fa8452 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:25.654015 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b429148a-85d1-4b38-a8d2-757141fa8452 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:25.654476 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b429148a-85d1-4b38-a8d2-757141fa8452 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:25.792826 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b429148a-85d1-4b38-a8d2-757141fa8452 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:25.800557 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b429148a-85d1-4b38-a8d2-757141fa8452 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.159730 Aug 04 23:31:25.801123 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 771/1577] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:25 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:26.608510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-280716b6-cc26-4a53-9df0-3cc85641aa83 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:26.609240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-280716b6-cc26-4a53-9df0-3cc85641aa83 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:26.616878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-280716b6-cc26-4a53-9df0-3cc85641aa83 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:26.617357 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-280716b6-cc26-4a53-9df0-3cc85641aa83 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:26.617784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-280716b6-cc26-4a53-9df0-3cc85641aa83 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:26.618517 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-280716b6-cc26-4a53-9df0-3cc85641aa83 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:26.618958 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-280716b6-cc26-4a53-9df0-3cc85641aa83 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:26.619370 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-280716b6-cc26-4a53-9df0-3cc85641aa83 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:26.684065 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-280716b6-cc26-4a53-9df0-3cc85641aa83 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:26.692103 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-280716b6-cc26-4a53-9df0-3cc85641aa83 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087409 Aug 04 23:31:26.693457 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 807/1578] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:26 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:26.823140 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e2d61f38-de84-4c27-b49b-f0c8ddbccc99 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:26.823694 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e2d61f38-de84-4c27-b49b-f0c8ddbccc99 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:26.830096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2d61f38-de84-4c27-b49b-f0c8ddbccc99 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:26.830619 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2d61f38-de84-4c27-b49b-f0c8ddbccc99 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:26.831053 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2d61f38-de84-4c27-b49b-f0c8ddbccc99 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:26.831749 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2d61f38-de84-4c27-b49b-f0c8ddbccc99 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:26.832215 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2d61f38-de84-4c27-b49b-f0c8ddbccc99 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:26.832633 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2d61f38-de84-4c27-b49b-f0c8ddbccc99 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:26.973446 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e2d61f38-de84-4c27-b49b-f0c8ddbccc99 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:26.981632 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e2d61f38-de84-4c27-b49b-f0c8ddbccc99 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.162813 Aug 04 23:31:26.982197 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 772/1579] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:26 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:27.713689 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7fc6f567-5de1-45f3-8a34-5ebdd3dcd893 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:27.714277 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7fc6f567-5de1-45f3-8a34-5ebdd3dcd893 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:27.720840 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7fc6f567-5de1-45f3-8a34-5ebdd3dcd893 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:27.721313 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7fc6f567-5de1-45f3-8a34-5ebdd3dcd893 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:27.721745 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7fc6f567-5de1-45f3-8a34-5ebdd3dcd893 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:27.722461 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7fc6f567-5de1-45f3-8a34-5ebdd3dcd893 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:27.722909 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7fc6f567-5de1-45f3-8a34-5ebdd3dcd893 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:27.723331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7fc6f567-5de1-45f3-8a34-5ebdd3dcd893 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:27.785527 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7fc6f567-5de1-45f3-8a34-5ebdd3dcd893 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:27.793846 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7fc6f567-5de1-45f3-8a34-5ebdd3dcd893 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084064 Aug 04 23:31:27.794437 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 808/1580] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:27 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:28.003237 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9610938c-668e-4c2d-a478-7169369eb1d1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:28.003879 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9610938c-668e-4c2d-a478-7169369eb1d1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:28.006820 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=52 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:31:28.012281 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9610938c-668e-4c2d-a478-7169369eb1d1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:28.012748 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9610938c-668e-4c2d-a478-7169369eb1d1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:28.013176 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9610938c-668e-4c2d-a478-7169369eb1d1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:28.013856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9610938c-668e-4c2d-a478-7169369eb1d1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:28.014298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9610938c-668e-4c2d-a478-7169369eb1d1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:28.014786 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9610938c-668e-4c2d-a478-7169369eb1d1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:28.151077 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9610938c-668e-4c2d-a478-7169369eb1d1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:28.158093 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9610938c-668e-4c2d-a478-7169369eb1d1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.158724 Aug 04 23:31:28.158684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 773/1581] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:27 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:28.814799 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-41449521-85eb-42d9-a5e1-69ee81e90be7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:28.815412 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-41449521-85eb-42d9-a5e1-69ee81e90be7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:28.822284 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-41449521-85eb-42d9-a5e1-69ee81e90be7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:28.822797 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-41449521-85eb-42d9-a5e1-69ee81e90be7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:28.823226 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-41449521-85eb-42d9-a5e1-69ee81e90be7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:28.823920 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-41449521-85eb-42d9-a5e1-69ee81e90be7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:28.824365 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-41449521-85eb-42d9-a5e1-69ee81e90be7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:28.824808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-41449521-85eb-42d9-a5e1-69ee81e90be7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:28.890235 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-41449521-85eb-42d9-a5e1-69ee81e90be7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:28.898567 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-41449521-85eb-42d9-a5e1-69ee81e90be7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087532 Aug 04 23:31:28.899181 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 809/1582] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:28 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:31:29.180439 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e36d1b51-d49c-480d-becd-1f33f9c84198 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:29.181127 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e36d1b51-d49c-480d-becd-1f33f9c84198 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:29.187629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e36d1b51-d49c-480d-becd-1f33f9c84198 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:29.188109 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e36d1b51-d49c-480d-becd-1f33f9c84198 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:29.188541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e36d1b51-d49c-480d-becd-1f33f9c84198 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:29.189234 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e36d1b51-d49c-480d-becd-1f33f9c84198 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:29.189682 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e36d1b51-d49c-480d-becd-1f33f9c84198 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:29.190103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e36d1b51-d49c-480d-becd-1f33f9c84198 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:29.328072 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e36d1b51-d49c-480d-becd-1f33f9c84198 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:29.336485 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e36d1b51-d49c-480d-becd-1f33f9c84198 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.160619 Aug 04 23:31:29.337058 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 774/1583] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:29 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:29.920329 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a4177f6a-c5c2-4a56-b0e4-c5a01cb39799 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:29.920922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a4177f6a-c5c2-4a56-b0e4-c5a01cb39799 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:29.923209 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=56 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:31:29.929057 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a4177f6a-c5c2-4a56-b0e4-c5a01cb39799 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:29.929534 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a4177f6a-c5c2-4a56-b0e4-c5a01cb39799 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:29.929965 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a4177f6a-c5c2-4a56-b0e4-c5a01cb39799 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:29.930688 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a4177f6a-c5c2-4a56-b0e4-c5a01cb39799 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:29.931138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a4177f6a-c5c2-4a56-b0e4-c5a01cb39799 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:29.931560 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a4177f6a-c5c2-4a56-b0e4-c5a01cb39799 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:29.995030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a4177f6a-c5c2-4a56-b0e4-c5a01cb39799 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:30.002608 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a4177f6a-c5c2-4a56-b0e4-c5a01cb39799 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086169 Aug 04 23:31:30.003167 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 810/1584] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:29 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:30.358136 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a2dcfcc3-0b91-48dd-94e6-204593898415 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:30.358764 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a2dcfcc3-0b91-48dd-94e6-204593898415 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:30.365389 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a2dcfcc3-0b91-48dd-94e6-204593898415 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:30.365863 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a2dcfcc3-0b91-48dd-94e6-204593898415 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:30.366294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a2dcfcc3-0b91-48dd-94e6-204593898415 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:30.367003 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a2dcfcc3-0b91-48dd-94e6-204593898415 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:30.367450 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a2dcfcc3-0b91-48dd-94e6-204593898415 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:30.367870 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a2dcfcc3-0b91-48dd-94e6-204593898415 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:30.506150 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a2dcfcc3-0b91-48dd-94e6-204593898415 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:30.517647 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a2dcfcc3-0b91-48dd-94e6-204593898415 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.163265 Aug 04 23:31:30.518702 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 775/1585] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:30 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:31.022857 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-445624ee-b42f-43b0-b9b2-c48181b78cd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:31.023441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-445624ee-b42f-43b0-b9b2-c48181b78cd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:31.030003 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-445624ee-b42f-43b0-b9b2-c48181b78cd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:31.030501 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-445624ee-b42f-43b0-b9b2-c48181b78cd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:31.030928 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-445624ee-b42f-43b0-b9b2-c48181b78cd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:31.031623 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-445624ee-b42f-43b0-b9b2-c48181b78cd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:31.032172 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-445624ee-b42f-43b0-b9b2-c48181b78cd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:31.032479 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-445624ee-b42f-43b0-b9b2-c48181b78cd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:31.035206 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:31:31.097497 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-445624ee-b42f-43b0-b9b2-c48181b78cd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:31.105147 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-445624ee-b42f-43b0-b9b2-c48181b78cd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086160 Aug 04 23:31:31.105710 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 811/1586] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:31 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:31.552721 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7115829d-9fef-43a6-96c9-68fa2c667e1e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:31.553466 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7115829d-9fef-43a6-96c9-68fa2c667e1e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:31.559788 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7115829d-9fef-43a6-96c9-68fa2c667e1e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:31.560265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7115829d-9fef-43a6-96c9-68fa2c667e1e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:31.560694 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7115829d-9fef-43a6-96c9-68fa2c667e1e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:31.561385 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7115829d-9fef-43a6-96c9-68fa2c667e1e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:31.561830 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7115829d-9fef-43a6-96c9-68fa2c667e1e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:31.562247 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7115829d-9fef-43a6-96c9-68fa2c667e1e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:31.698841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7115829d-9fef-43a6-96c9-68fa2c667e1e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:31.706475 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7115829d-9fef-43a6-96c9-68fa2c667e1e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.158396 Aug 04 23:31:31.707032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 776/1587] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:31 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:32.126582 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b0dbb9d5-1266-45d7-b6c4-a7fd26cc1335 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:32.127146 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b0dbb9d5-1266-45d7-b6c4-a7fd26cc1335 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:32.133977 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b0dbb9d5-1266-45d7-b6c4-a7fd26cc1335 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:32.134499 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b0dbb9d5-1266-45d7-b6c4-a7fd26cc1335 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:32.134937 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b0dbb9d5-1266-45d7-b6c4-a7fd26cc1335 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:32.135638 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b0dbb9d5-1266-45d7-b6c4-a7fd26cc1335 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:32.136090 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b0dbb9d5-1266-45d7-b6c4-a7fd26cc1335 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:32.136511 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b0dbb9d5-1266-45d7-b6c4-a7fd26cc1335 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:32.203243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b0dbb9d5-1266-45d7-b6c4-a7fd26cc1335 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:32.211529 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b0dbb9d5-1266-45d7-b6c4-a7fd26cc1335 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089162 Aug 04 23:31:32.212099 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 812/1588] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:32 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:32.728137 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ac31562a-6b50-4bdc-a012-79b04a1a303f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:32.728752 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ac31562a-6b50-4bdc-a012-79b04a1a303f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:32.735375 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac31562a-6b50-4bdc-a012-79b04a1a303f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:32.735846 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac31562a-6b50-4bdc-a012-79b04a1a303f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:32.736279 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac31562a-6b50-4bdc-a012-79b04a1a303f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:32.736966 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac31562a-6b50-4bdc-a012-79b04a1a303f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:32.737419 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac31562a-6b50-4bdc-a012-79b04a1a303f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:32.737837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac31562a-6b50-4bdc-a012-79b04a1a303f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:32.870695 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ac31562a-6b50-4bdc-a012-79b04a1a303f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:32.878207 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ac31562a-6b50-4bdc-a012-79b04a1a303f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.154078 Aug 04 23:31:32.878807 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 777/1589] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:32 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:33.232907 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c095db8f-7b4c-4537-8c78-8737fc9818f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:33.233552 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c095db8f-7b4c-4537-8c78-8737fc9818f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:33.241283 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c095db8f-7b4c-4537-8c78-8737fc9818f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:33.241787 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c095db8f-7b4c-4537-8c78-8737fc9818f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:33.242214 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c095db8f-7b4c-4537-8c78-8737fc9818f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:33.242925 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c095db8f-7b4c-4537-8c78-8737fc9818f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:33.243372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c095db8f-7b4c-4537-8c78-8737fc9818f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:33.243786 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c095db8f-7b4c-4537-8c78-8737fc9818f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:33.307563 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c095db8f-7b4c-4537-8c78-8737fc9818f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:33.315107 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c095db8f-7b4c-4537-8c78-8737fc9818f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086194 Aug 04 23:31:33.315663 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 813/1590] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:33 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:33.900050 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f011e3f7-cd4f-485e-bf90-807c71e204b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:33.900663 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f011e3f7-cd4f-485e-bf90-807c71e204b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:33.907108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f011e3f7-cd4f-485e-bf90-807c71e204b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:33.907588 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f011e3f7-cd4f-485e-bf90-807c71e204b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:33.908029 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f011e3f7-cd4f-485e-bf90-807c71e204b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:33.908728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f011e3f7-cd4f-485e-bf90-807c71e204b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:33.909185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f011e3f7-cd4f-485e-bf90-807c71e204b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:33.909607 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f011e3f7-cd4f-485e-bf90-807c71e204b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:34.054095 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f011e3f7-cd4f-485e-bf90-807c71e204b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:34.061672 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f011e3f7-cd4f-485e-bf90-807c71e204b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.165479 Aug 04 23:31:34.062233 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 778/1591] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:33 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:34.336921 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-30925a57-9b9c-4f31-8232-02cfd39793a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:34.337536 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-30925a57-9b9c-4f31-8232-02cfd39793a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:34.344660 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-30925a57-9b9c-4f31-8232-02cfd39793a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:34.345140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-30925a57-9b9c-4f31-8232-02cfd39793a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:34.345565 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-30925a57-9b9c-4f31-8232-02cfd39793a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:34.346383 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-30925a57-9b9c-4f31-8232-02cfd39793a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:34.346841 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-30925a57-9b9c-4f31-8232-02cfd39793a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:34.347261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-30925a57-9b9c-4f31-8232-02cfd39793a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:34.409936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-30925a57-9b9c-4f31-8232-02cfd39793a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:34.417656 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-30925a57-9b9c-4f31-8232-02cfd39793a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084677 Aug 04 23:31:34.418218 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 814/1592] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:34 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:35.082619 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d557e8a9-774d-4174-a2a7-3b2ed567312b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:35.083409 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d557e8a9-774d-4174-a2a7-3b2ed567312b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:35.089811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d557e8a9-774d-4174-a2a7-3b2ed567312b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:35.090228 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d557e8a9-774d-4174-a2a7-3b2ed567312b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:35.090691 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d557e8a9-774d-4174-a2a7-3b2ed567312b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:35.091383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d557e8a9-774d-4174-a2a7-3b2ed567312b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:35.091835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d557e8a9-774d-4174-a2a7-3b2ed567312b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:35.092256 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d557e8a9-774d-4174-a2a7-3b2ed567312b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:35.224349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d557e8a9-774d-4174-a2a7-3b2ed567312b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:35.226585 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:31:35.233173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d557e8a9-774d-4174-a2a7-3b2ed567312b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.154474 Aug 04 23:31:35.233735 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 779/1593] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:35 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:35.437877 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4ec6eede-1546-4a89-8356-c369776108ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:35.438508 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4ec6eede-1546-4a89-8356-c369776108ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:35.445894 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ec6eede-1546-4a89-8356-c369776108ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:35.446382 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ec6eede-1546-4a89-8356-c369776108ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:35.446827 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ec6eede-1546-4a89-8356-c369776108ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:35.447516 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ec6eede-1546-4a89-8356-c369776108ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:35.447970 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ec6eede-1546-4a89-8356-c369776108ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:35.448394 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ec6eede-1546-4a89-8356-c369776108ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:35.515051 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4ec6eede-1546-4a89-8356-c369776108ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:35.523455 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4ec6eede-1546-4a89-8356-c369776108ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089425 Aug 04 23:31:35.524157 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 815/1594] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:35 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:36.253435 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0684c3e1-552f-4d23-9e2e-ca1e1fb5d402 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:36.254037 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0684c3e1-552f-4d23-9e2e-ca1e1fb5d402 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:36.261385 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0684c3e1-552f-4d23-9e2e-ca1e1fb5d402 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:36.262511 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0684c3e1-552f-4d23-9e2e-ca1e1fb5d402 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:36.262962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0684c3e1-552f-4d23-9e2e-ca1e1fb5d402 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:36.263662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0684c3e1-552f-4d23-9e2e-ca1e1fb5d402 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:36.264120 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0684c3e1-552f-4d23-9e2e-ca1e1fb5d402 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:36.264546 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0684c3e1-552f-4d23-9e2e-ca1e1fb5d402 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:36.395729 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0684c3e1-552f-4d23-9e2e-ca1e1fb5d402 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:36.403372 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0684c3e1-552f-4d23-9e2e-ca1e1fb5d402 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.153840 Aug 04 23:31:36.403943 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 780/1595] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:36 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:31:36.544101 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4285267c-e50f-44e6-9f5f-379ebc0bd6af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:36.544668 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4285267c-e50f-44e6-9f5f-379ebc0bd6af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:36.551149 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4285267c-e50f-44e6-9f5f-379ebc0bd6af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:36.552171 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4285267c-e50f-44e6-9f5f-379ebc0bd6af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:36.552611 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4285267c-e50f-44e6-9f5f-379ebc0bd6af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:36.553305 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4285267c-e50f-44e6-9f5f-379ebc0bd6af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:36.553824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4285267c-e50f-44e6-9f5f-379ebc0bd6af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:36.554182 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4285267c-e50f-44e6-9f5f-379ebc0bd6af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:36.616968 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4285267c-e50f-44e6-9f5f-379ebc0bd6af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:36.624957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4285267c-e50f-44e6-9f5f-379ebc0bd6af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084964 Aug 04 23:31:36.625547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 816/1596] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:36 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:37.424817 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d4a9124f-b569-4fee-bb1f-4e861f5c6789 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:37.425469 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d4a9124f-b569-4fee-bb1f-4e861f5c6789 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:37.432138 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d4a9124f-b569-4fee-bb1f-4e861f5c6789 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:37.432624 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d4a9124f-b569-4fee-bb1f-4e861f5c6789 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:37.433060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d4a9124f-b569-4fee-bb1f-4e861f5c6789 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:37.433754 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d4a9124f-b569-4fee-bb1f-4e861f5c6789 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:37.434211 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d4a9124f-b569-4fee-bb1f-4e861f5c6789 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:37.434664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d4a9124f-b569-4fee-bb1f-4e861f5c6789 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:37.574274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d4a9124f-b569-4fee-bb1f-4e861f5c6789 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:37.582035 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d4a9124f-b569-4fee-bb1f-4e861f5c6789 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.161191 Aug 04 23:31:37.582789 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 781/1597] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:37 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:37.646127 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-82b1e1e9-3d45-4910-9099-1c873bb747f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:37.646773 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-82b1e1e9-3d45-4910-9099-1c873bb747f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:37.653301 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82b1e1e9-3d45-4910-9099-1c873bb747f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:37.653771 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82b1e1e9-3d45-4910-9099-1c873bb747f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:37.654194 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82b1e1e9-3d45-4910-9099-1c873bb747f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:37.654932 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82b1e1e9-3d45-4910-9099-1c873bb747f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:37.655375 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82b1e1e9-3d45-4910-9099-1c873bb747f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:37.655790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82b1e1e9-3d45-4910-9099-1c873bb747f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:37.718141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-82b1e1e9-3d45-4910-9099-1c873bb747f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:37.726315 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-82b1e1e9-3d45-4910-9099-1c873bb747f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085040 Aug 04 23:31:37.726902 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 817/1598] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:37 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:38.603674 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ae9d5b6c-a8c3-4532-8ecd-128125002ccc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:38.604333 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ae9d5b6c-a8c3-4532-8ecd-128125002ccc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:38.616910 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ae9d5b6c-a8c3-4532-8ecd-128125002ccc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:38.617402 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ae9d5b6c-a8c3-4532-8ecd-128125002ccc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:38.617833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ae9d5b6c-a8c3-4532-8ecd-128125002ccc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:38.618555 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ae9d5b6c-a8c3-4532-8ecd-128125002ccc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:38.619008 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ae9d5b6c-a8c3-4532-8ecd-128125002ccc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:38.619430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ae9d5b6c-a8c3-4532-8ecd-128125002ccc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:38.746569 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2e704197-0e78-4d61-8334-9be93165fa5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:38.747177 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2e704197-0e78-4d61-8334-9be93165fa5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:38.754000 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2e704197-0e78-4d61-8334-9be93165fa5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:38.754198 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ae9d5b6c-a8c3-4532-8ecd-128125002ccc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:38.754602 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2e704197-0e78-4d61-8334-9be93165fa5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:38.755149 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2e704197-0e78-4d61-8334-9be93165fa5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:38.756054 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2e704197-0e78-4d61-8334-9be93165fa5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:38.756501 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2e704197-0e78-4d61-8334-9be93165fa5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:38.756916 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2e704197-0e78-4d61-8334-9be93165fa5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:38.761812 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ae9d5b6c-a8c3-4532-8ecd-128125002ccc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.161959 Aug 04 23:31:38.762412 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 782/1599] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:38 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:38.822612 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2e704197-0e78-4d61-8334-9be93165fa5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:38.830198 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2e704197-0e78-4d61-8334-9be93165fa5e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087767 Aug 04 23:31:38.830797 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 818/1600] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:38 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:31:39.782849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e9e56c79-5223-425d-b343-14340e3db8ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:39.783459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e9e56c79-5223-425d-b343-14340e3db8ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:39.791038 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e9e56c79-5223-425d-b343-14340e3db8ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:39.791521 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e9e56c79-5223-425d-b343-14340e3db8ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:39.791954 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e9e56c79-5223-425d-b343-14340e3db8ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:39.792643 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e9e56c79-5223-425d-b343-14340e3db8ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:39.793093 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e9e56c79-5223-425d-b343-14340e3db8ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:39.793512 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e9e56c79-5223-425d-b343-14340e3db8ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:39.852264 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e8d54f5d-17df-44e1-9a58-aa54db4766ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:39.852993 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e8d54f5d-17df-44e1-9a58-aa54db4766ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:39.859529 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e8d54f5d-17df-44e1-9a58-aa54db4766ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:39.860105 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e8d54f5d-17df-44e1-9a58-aa54db4766ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:39.860606 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e8d54f5d-17df-44e1-9a58-aa54db4766ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:39.861395 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e8d54f5d-17df-44e1-9a58-aa54db4766ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:39.862034 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e8d54f5d-17df-44e1-9a58-aa54db4766ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:39.862586 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e8d54f5d-17df-44e1-9a58-aa54db4766ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:39.938352 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e8d54f5d-17df-44e1-9a58-aa54db4766ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:39.946748 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e8d54f5d-17df-44e1-9a58-aa54db4766ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.099011 Aug 04 23:31:39.947322 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 819/1601] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:39 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:31:39.955884 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e9e56c79-5223-425d-b343-14340e3db8ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:39.966141 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e9e56c79-5223-425d-b343-14340e3db8ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.187010 Aug 04 23:31:39.966770 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 783/1602] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:39 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:40.969096 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e65b95c2-e57f-4009-b148-c8215178f02a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:40.969846 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e65b95c2-e57f-4009-b148-c8215178f02a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:40.976409 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e65b95c2-e57f-4009-b148-c8215178f02a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:40.976888 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e65b95c2-e57f-4009-b148-c8215178f02a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:40.977321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e65b95c2-e57f-4009-b148-c8215178f02a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:40.978035 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e65b95c2-e57f-4009-b148-c8215178f02a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:40.978494 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e65b95c2-e57f-4009-b148-c8215178f02a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:40.978917 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e65b95c2-e57f-4009-b148-c8215178f02a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:40.988910 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e4c31151-03e3-4d26-9db8-40836330ab57 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:40.989925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e4c31151-03e3-4d26-9db8-40836330ab57 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:40.996240 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e4c31151-03e3-4d26-9db8-40836330ab57 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:40.996718 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e4c31151-03e3-4d26-9db8-40836330ab57 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:40.997151 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e4c31151-03e3-4d26-9db8-40836330ab57 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:40.997845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e4c31151-03e3-4d26-9db8-40836330ab57 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:40.998288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e4c31151-03e3-4d26-9db8-40836330ab57 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:40.998730 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e4c31151-03e3-4d26-9db8-40836330ab57 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:41.050635 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e65b95c2-e57f-4009-b148-c8215178f02a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:41.058855 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e65b95c2-e57f-4009-b148-c8215178f02a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.093542 Aug 04 23:31:41.059420 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 820/1603] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:40 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:41.142617 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e4c31151-03e3-4d26-9db8-40836330ab57 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:41.151019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e4c31151-03e3-4d26-9db8-40836330ab57 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.166077 Aug 04 23:31:41.151593 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 784/1604] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:40 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:31:42.080864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-83db6d95-57d4-4a3a-abff-a38f1faccb8f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:42.081453 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-83db6d95-57d4-4a3a-abff-a38f1faccb8f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:42.088890 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-83db6d95-57d4-4a3a-abff-a38f1faccb8f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:42.089291 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-83db6d95-57d4-4a3a-abff-a38f1faccb8f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:42.089718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-83db6d95-57d4-4a3a-abff-a38f1faccb8f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:42.090441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-83db6d95-57d4-4a3a-abff-a38f1faccb8f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:42.090891 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-83db6d95-57d4-4a3a-abff-a38f1faccb8f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:42.091310 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-83db6d95-57d4-4a3a-abff-a38f1faccb8f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:42.155758 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-83db6d95-57d4-4a3a-abff-a38f1faccb8f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:42.164333 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-83db6d95-57d4-4a3a-abff-a38f1faccb8f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087279 Aug 04 23:31:42.164976 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 821/1605] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:42 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:42.172905 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6e8575f0-6c8e-4d61-a490-6dfc1208a407 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:42.173523 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6e8575f0-6c8e-4d61-a490-6dfc1208a407 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:42.180570 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e8575f0-6c8e-4d61-a490-6dfc1208a407 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:42.181052 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e8575f0-6c8e-4d61-a490-6dfc1208a407 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:42.181485 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e8575f0-6c8e-4d61-a490-6dfc1208a407 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:42.182176 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e8575f0-6c8e-4d61-a490-6dfc1208a407 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:42.182681 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e8575f0-6c8e-4d61-a490-6dfc1208a407 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:42.183098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e8575f0-6c8e-4d61-a490-6dfc1208a407 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:42.322799 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6e8575f0-6c8e-4d61-a490-6dfc1208a407 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:42.330459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6e8575f0-6c8e-4d61-a490-6dfc1208a407 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.161371 Aug 04 23:31:42.331019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 785/1606] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:42 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:43.185041 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-adb255e3-ec71-4710-8313-26470f05deac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:43.185676 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-adb255e3-ec71-4710-8313-26470f05deac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:43.193413 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adb255e3-ec71-4710-8313-26470f05deac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:43.193883 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adb255e3-ec71-4710-8313-26470f05deac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:43.194308 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adb255e3-ec71-4710-8313-26470f05deac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:43.195014 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adb255e3-ec71-4710-8313-26470f05deac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:43.195713 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adb255e3-ec71-4710-8313-26470f05deac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:43.196128 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adb255e3-ec71-4710-8313-26470f05deac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:43.257941 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-adb255e3-ec71-4710-8313-26470f05deac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:43.265946 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-adb255e3-ec71-4710-8313-26470f05deac tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084781 Aug 04 23:31:43.266533 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 822/1607] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:43 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:43.352887 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-edbdf8dc-310c-4dcb-8de3-c5f7dbd652d5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:43.353498 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-edbdf8dc-310c-4dcb-8de3-c5f7dbd652d5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:43.359947 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edbdf8dc-310c-4dcb-8de3-c5f7dbd652d5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:43.360366 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edbdf8dc-310c-4dcb-8de3-c5f7dbd652d5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:43.360799 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edbdf8dc-310c-4dcb-8de3-c5f7dbd652d5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:43.361484 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edbdf8dc-310c-4dcb-8de3-c5f7dbd652d5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:43.361931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edbdf8dc-310c-4dcb-8de3-c5f7dbd652d5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:43.362354 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-edbdf8dc-310c-4dcb-8de3-c5f7dbd652d5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:43.493842 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-edbdf8dc-310c-4dcb-8de3-c5f7dbd652d5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:43.501465 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-edbdf8dc-310c-4dcb-8de3-c5f7dbd652d5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.152569 Aug 04 23:31:43.502019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 786/1608] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:43 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:44.287385 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-325accf1-6207-4002-8104-bd48ffed85c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:44.287991 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-325accf1-6207-4002-8104-bd48ffed85c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:44.294509 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-325accf1-6207-4002-8104-bd48ffed85c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:44.294988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-325accf1-6207-4002-8104-bd48ffed85c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:44.295584 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-325accf1-6207-4002-8104-bd48ffed85c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:44.296268 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-325accf1-6207-4002-8104-bd48ffed85c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:44.296718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-325accf1-6207-4002-8104-bd48ffed85c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:44.297137 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-325accf1-6207-4002-8104-bd48ffed85c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:44.362698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-325accf1-6207-4002-8104-bd48ffed85c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:44.370925 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-325accf1-6207-4002-8104-bd48ffed85c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087540 Aug 04 23:31:44.371484 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 823/1609] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:44 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:44.523760 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f1259673-20f4-4a5f-8167-7dbd1e2f2c2f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:44.524383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f1259673-20f4-4a5f-8167-7dbd1e2f2c2f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:44.530932 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f1259673-20f4-4a5f-8167-7dbd1e2f2c2f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:44.531417 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f1259673-20f4-4a5f-8167-7dbd1e2f2c2f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:44.531855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f1259673-20f4-4a5f-8167-7dbd1e2f2c2f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:44.532553 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f1259673-20f4-4a5f-8167-7dbd1e2f2c2f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:44.533008 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f1259673-20f4-4a5f-8167-7dbd1e2f2c2f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:44.533435 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f1259673-20f4-4a5f-8167-7dbd1e2f2c2f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:44.685101 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f1259673-20f4-4a5f-8167-7dbd1e2f2c2f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:44.693434 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f1259673-20f4-4a5f-8167-7dbd1e2f2c2f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.173853 Aug 04 23:31:44.694007 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 787/1610] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:44 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:45.391853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f8914bbb-33fc-4b08-89ae-7e8c43121f62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:45.392446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f8914bbb-33fc-4b08-89ae-7e8c43121f62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:45.399525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f8914bbb-33fc-4b08-89ae-7e8c43121f62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:45.400007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f8914bbb-33fc-4b08-89ae-7e8c43121f62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:45.400439 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f8914bbb-33fc-4b08-89ae-7e8c43121f62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:45.401138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f8914bbb-33fc-4b08-89ae-7e8c43121f62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:45.401591 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f8914bbb-33fc-4b08-89ae-7e8c43121f62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:45.402011 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f8914bbb-33fc-4b08-89ae-7e8c43121f62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:45.465307 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f8914bbb-33fc-4b08-89ae-7e8c43121f62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:45.473341 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f8914bbb-33fc-4b08-89ae-7e8c43121f62 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085241 Aug 04 23:31:45.473842 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 824/1611] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:45 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:45.718610 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-bc62b9a8-f74d-4273-927b-57b9fd22e9ec tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:45.719253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-bc62b9a8-f74d-4273-927b-57b9fd22e9ec tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:45.726322 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bc62b9a8-f74d-4273-927b-57b9fd22e9ec tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:45.726759 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bc62b9a8-f74d-4273-927b-57b9fd22e9ec tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:45.727188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bc62b9a8-f74d-4273-927b-57b9fd22e9ec tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:45.727867 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bc62b9a8-f74d-4273-927b-57b9fd22e9ec tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:45.728312 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bc62b9a8-f74d-4273-927b-57b9fd22e9ec tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:45.728731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bc62b9a8-f74d-4273-927b-57b9fd22e9ec tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:45.865956 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-bc62b9a8-f74d-4273-927b-57b9fd22e9ec tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:45.873459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-bc62b9a8-f74d-4273-927b-57b9fd22e9ec tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.158775 Aug 04 23:31:45.874018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 788/1612] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:45 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:46.493855 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-21c07ef2-8551-41e5-955f-2a53dec6fee6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:46.494472 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-21c07ef2-8551-41e5-955f-2a53dec6fee6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:46.500825 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21c07ef2-8551-41e5-955f-2a53dec6fee6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:46.501299 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21c07ef2-8551-41e5-955f-2a53dec6fee6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:46.501728 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21c07ef2-8551-41e5-955f-2a53dec6fee6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:46.502443 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21c07ef2-8551-41e5-955f-2a53dec6fee6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:46.502891 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21c07ef2-8551-41e5-955f-2a53dec6fee6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:46.503311 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21c07ef2-8551-41e5-955f-2a53dec6fee6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:46.564697 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-21c07ef2-8551-41e5-955f-2a53dec6fee6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:46.573255 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-21c07ef2-8551-41e5-955f-2a53dec6fee6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083384 Aug 04 23:31:46.573813 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 825/1613] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:46 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:46.896075 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1c3d009d-a238-43e2-98d5-893d95b90cf3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:46.896711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1c3d009d-a238-43e2-98d5-893d95b90cf3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:46.903165 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c3d009d-a238-43e2-98d5-893d95b90cf3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:46.903635 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c3d009d-a238-43e2-98d5-893d95b90cf3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:46.904064 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c3d009d-a238-43e2-98d5-893d95b90cf3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:46.904742 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c3d009d-a238-43e2-98d5-893d95b90cf3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:46.905184 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c3d009d-a238-43e2-98d5-893d95b90cf3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:46.905596 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c3d009d-a238-43e2-98d5-893d95b90cf3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:47.038817 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1c3d009d-a238-43e2-98d5-893d95b90cf3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:47.046539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1c3d009d-a238-43e2-98d5-893d95b90cf3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.155292 Aug 04 23:31:47.047105 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 789/1614] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:46 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:47.594377 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-05d1ba38-e564-4f5b-84ca-b976e36b3f45 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:47.594987 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-05d1ba38-e564-4f5b-84ca-b976e36b3f45 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:47.602030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05d1ba38-e564-4f5b-84ca-b976e36b3f45 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:47.602547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05d1ba38-e564-4f5b-84ca-b976e36b3f45 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:47.602984 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05d1ba38-e564-4f5b-84ca-b976e36b3f45 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:47.603671 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05d1ba38-e564-4f5b-84ca-b976e36b3f45 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:47.604123 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05d1ba38-e564-4f5b-84ca-b976e36b3f45 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:47.604542 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05d1ba38-e564-4f5b-84ca-b976e36b3f45 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:47.668154 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-05d1ba38-e564-4f5b-84ca-b976e36b3f45 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:47.676362 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-05d1ba38-e564-4f5b-84ca-b976e36b3f45 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085243 Aug 04 23:31:47.676928 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 826/1615] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:47 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:48.067766 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9cbadc78-f3ba-40b7-8086-301244fe31e4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:48.068599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9cbadc78-f3ba-40b7-8086-301244fe31e4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:48.077274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cbadc78-f3ba-40b7-8086-301244fe31e4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:48.077757 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cbadc78-f3ba-40b7-8086-301244fe31e4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:48.078191 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cbadc78-f3ba-40b7-8086-301244fe31e4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:48.078919 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cbadc78-f3ba-40b7-8086-301244fe31e4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:48.079373 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cbadc78-f3ba-40b7-8086-301244fe31e4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:48.079795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cbadc78-f3ba-40b7-8086-301244fe31e4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:48.213295 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9cbadc78-f3ba-40b7-8086-301244fe31e4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:48.220811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9cbadc78-f3ba-40b7-8086-301244fe31e4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.157477 Aug 04 23:31:48.221370 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 790/1616] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:48 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:48.698105 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7576738b-5661-4b48-bff5-428ad07b9b4a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:48.698842 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7576738b-5661-4b48-bff5-428ad07b9b4a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:48.705053 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7576738b-5661-4b48-bff5-428ad07b9b4a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:48.705525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7576738b-5661-4b48-bff5-428ad07b9b4a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:48.705951 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7576738b-5661-4b48-bff5-428ad07b9b4a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:48.706740 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7576738b-5661-4b48-bff5-428ad07b9b4a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:48.707590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7576738b-5661-4b48-bff5-428ad07b9b4a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:48.708113 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7576738b-5661-4b48-bff5-428ad07b9b4a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:48.769944 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7576738b-5661-4b48-bff5-428ad07b9b4a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:48.772211 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:31:48.779359 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7576738b-5661-4b48-bff5-428ad07b9b4a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085322 Aug 04 23:31:48.779934 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 827/1617] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:48 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:49.241830 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6b3edf76-68f9-4b4b-b376-249b6bf14703 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:49.242464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6b3edf76-68f9-4b4b-b376-249b6bf14703 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:49.248863 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b3edf76-68f9-4b4b-b376-249b6bf14703 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:49.249344 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b3edf76-68f9-4b4b-b376-249b6bf14703 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:49.249776 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b3edf76-68f9-4b4b-b376-249b6bf14703 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:49.250502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b3edf76-68f9-4b4b-b376-249b6bf14703 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:49.250953 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b3edf76-68f9-4b4b-b376-249b6bf14703 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:49.251372 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b3edf76-68f9-4b4b-b376-249b6bf14703 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:49.385320 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6b3edf76-68f9-4b4b-b376-249b6bf14703 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:49.392883 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6b3edf76-68f9-4b4b-b376-249b6bf14703 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.155766 Aug 04 23:31:49.393446 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 791/1618] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:49 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:49.801390 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-bcd33b1a-5edf-4ca7-bbf7-1b4a7d1eabfe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:49.801993 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-bcd33b1a-5edf-4ca7-bbf7-1b4a7d1eabfe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:49.808515 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bcd33b1a-5edf-4ca7-bbf7-1b4a7d1eabfe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:49.808923 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bcd33b1a-5edf-4ca7-bbf7-1b4a7d1eabfe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:49.809364 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bcd33b1a-5edf-4ca7-bbf7-1b4a7d1eabfe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:49.810061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bcd33b1a-5edf-4ca7-bbf7-1b4a7d1eabfe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:49.810570 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bcd33b1a-5edf-4ca7-bbf7-1b4a7d1eabfe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:49.810987 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bcd33b1a-5edf-4ca7-bbf7-1b4a7d1eabfe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:49.875243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-bcd33b1a-5edf-4ca7-bbf7-1b4a7d1eabfe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:49.883052 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-bcd33b1a-5edf-4ca7-bbf7-1b4a7d1eabfe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085945 Aug 04 23:31:49.883606 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 828/1619] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:49 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:50.415170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5800a113-0b3c-4650-8328-89f7518c48ea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:50.415767 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5800a113-0b3c-4650-8328-89f7518c48ea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:50.422400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5800a113-0b3c-4650-8328-89f7518c48ea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:50.422876 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5800a113-0b3c-4650-8328-89f7518c48ea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:50.423308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5800a113-0b3c-4650-8328-89f7518c48ea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:50.424003 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5800a113-0b3c-4650-8328-89f7518c48ea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:50.424453 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5800a113-0b3c-4650-8328-89f7518c48ea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:50.424870 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5800a113-0b3c-4650-8328-89f7518c48ea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:50.556200 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5800a113-0b3c-4650-8328-89f7518c48ea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:50.563777 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5800a113-0b3c-4650-8328-89f7518c48ea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.152515 Aug 04 23:31:50.564386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 792/1620] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:50 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:50.903658 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-162404df-e6fa-4d39-91e9-3bed725241c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:50.904270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-162404df-e6fa-4d39-91e9-3bed725241c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:50.911462 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-162404df-e6fa-4d39-91e9-3bed725241c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:50.911933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-162404df-e6fa-4d39-91e9-3bed725241c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:50.912364 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-162404df-e6fa-4d39-91e9-3bed725241c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:50.913048 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-162404df-e6fa-4d39-91e9-3bed725241c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:50.913512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-162404df-e6fa-4d39-91e9-3bed725241c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:50.913916 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-162404df-e6fa-4d39-91e9-3bed725241c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:50.975067 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-162404df-e6fa-4d39-91e9-3bed725241c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:50.983232 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-162404df-e6fa-4d39-91e9-3bed725241c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083411 Aug 04 23:31:50.983791 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 829/1621] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:50 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:51.585186 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f39f1c54-a9e8-44bb-933e-b89edd591f20 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:51.585808 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f39f1c54-a9e8-44bb-933e-b89edd591f20 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:51.592402 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f39f1c54-a9e8-44bb-933e-b89edd591f20 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:51.592881 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f39f1c54-a9e8-44bb-933e-b89edd591f20 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:51.593317 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f39f1c54-a9e8-44bb-933e-b89edd591f20 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:51.594010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f39f1c54-a9e8-44bb-933e-b89edd591f20 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:51.594500 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f39f1c54-a9e8-44bb-933e-b89edd591f20 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:51.594926 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f39f1c54-a9e8-44bb-933e-b89edd591f20 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:51.734004 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f39f1c54-a9e8-44bb-933e-b89edd591f20 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:51.742712 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f39f1c54-a9e8-44bb-933e-b89edd591f20 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.161464 Aug 04 23:31:51.743280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 793/1622] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:51 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:52.005771 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1bd68f08-68be-4c34-85de-aa3332723d54 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:52.006411 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1bd68f08-68be-4c34-85de-aa3332723d54 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:52.012973 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1bd68f08-68be-4c34-85de-aa3332723d54 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:52.013467 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1bd68f08-68be-4c34-85de-aa3332723d54 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:52.013931 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1bd68f08-68be-4c34-85de-aa3332723d54 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:52.014652 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1bd68f08-68be-4c34-85de-aa3332723d54 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:52.015112 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1bd68f08-68be-4c34-85de-aa3332723d54 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:52.015534 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1bd68f08-68be-4c34-85de-aa3332723d54 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:52.077668 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1bd68f08-68be-4c34-85de-aa3332723d54 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:52.085583 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1bd68f08-68be-4c34-85de-aa3332723d54 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084414 Aug 04 23:31:52.086294 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 830/1623] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:51 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:31:52.763758 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-cb3c9ec8-7c1f-421f-bff1-46f9cf0bd8f1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:52.764357 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-cb3c9ec8-7c1f-421f-bff1-46f9cf0bd8f1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:52.771231 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cb3c9ec8-7c1f-421f-bff1-46f9cf0bd8f1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:52.771712 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cb3c9ec8-7c1f-421f-bff1-46f9cf0bd8f1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:52.772145 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cb3c9ec8-7c1f-421f-bff1-46f9cf0bd8f1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:52.772838 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cb3c9ec8-7c1f-421f-bff1-46f9cf0bd8f1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:52.773286 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cb3c9ec8-7c1f-421f-bff1-46f9cf0bd8f1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:52.773707 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cb3c9ec8-7c1f-421f-bff1-46f9cf0bd8f1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:52.913044 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-cb3c9ec8-7c1f-421f-bff1-46f9cf0bd8f1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:52.920542 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-cb3c9ec8-7c1f-421f-bff1-46f9cf0bd8f1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.160680 Aug 04 23:31:52.921108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 794/1624] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:52 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:53.106904 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-63f7551f-9ccd-49a5-a0f5-e9174832f924 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:53.107461 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-63f7551f-9ccd-49a5-a0f5-e9174832f924 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:53.114016 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-63f7551f-9ccd-49a5-a0f5-e9174832f924 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:53.114519 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-63f7551f-9ccd-49a5-a0f5-e9174832f924 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:53.114941 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-63f7551f-9ccd-49a5-a0f5-e9174832f924 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:53.115635 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-63f7551f-9ccd-49a5-a0f5-e9174832f924 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:53.116079 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-63f7551f-9ccd-49a5-a0f5-e9174832f924 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:53.116496 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-63f7551f-9ccd-49a5-a0f5-e9174832f924 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:53.177384 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-63f7551f-9ccd-49a5-a0f5-e9174832f924 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:53.184864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-63f7551f-9ccd-49a5-a0f5-e9174832f924 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.082149 Aug 04 23:31:53.185412 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 831/1625] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:53 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:53.942677 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-af4880ed-fed6-4247-bc54-e46ffd830c04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:53.943285 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-af4880ed-fed6-4247-bc54-e46ffd830c04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:53.949715 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-af4880ed-fed6-4247-bc54-e46ffd830c04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:53.950184 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-af4880ed-fed6-4247-bc54-e46ffd830c04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:53.950644 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-af4880ed-fed6-4247-bc54-e46ffd830c04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:53.951323 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-af4880ed-fed6-4247-bc54-e46ffd830c04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:53.951767 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-af4880ed-fed6-4247-bc54-e46ffd830c04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:53.952183 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-af4880ed-fed6-4247-bc54-e46ffd830c04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:54.086223 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-af4880ed-fed6-4247-bc54-e46ffd830c04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:54.094028 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-af4880ed-fed6-4247-bc54-e46ffd830c04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.155991 Aug 04 23:31:54.094640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 795/1626] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:53 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:54.206427 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d9055977-b8fa-4311-abe7-c91cdc825fdf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:54.207092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d9055977-b8fa-4311-abe7-c91cdc825fdf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:54.213592 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d9055977-b8fa-4311-abe7-c91cdc825fdf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:54.214072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d9055977-b8fa-4311-abe7-c91cdc825fdf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:54.214548 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d9055977-b8fa-4311-abe7-c91cdc825fdf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:54.215243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d9055977-b8fa-4311-abe7-c91cdc825fdf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:54.215696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d9055977-b8fa-4311-abe7-c91cdc825fdf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:54.216118 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d9055977-b8fa-4311-abe7-c91cdc825fdf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:54.278056 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d9055977-b8fa-4311-abe7-c91cdc825fdf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:54.286239 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d9055977-b8fa-4311-abe7-c91cdc825fdf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083729 Aug 04 23:31:54.286823 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 832/1627] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:54 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:55.116285 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0ee28d61-760f-4d96-8d3b-b28b60747009 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:55.116887 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0ee28d61-760f-4d96-8d3b-b28b60747009 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:55.123251 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0ee28d61-760f-4d96-8d3b-b28b60747009 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:55.123726 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0ee28d61-760f-4d96-8d3b-b28b60747009 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:55.124153 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0ee28d61-760f-4d96-8d3b-b28b60747009 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:55.124835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0ee28d61-760f-4d96-8d3b-b28b60747009 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:55.125280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0ee28d61-760f-4d96-8d3b-b28b60747009 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:55.125698 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0ee28d61-760f-4d96-8d3b-b28b60747009 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:55.141559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:31:55.264177 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0ee28d61-760f-4d96-8d3b-b28b60747009 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:55.272568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0ee28d61-760f-4d96-8d3b-b28b60747009 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.161171 Aug 04 23:31:55.273133 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 796/1628] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:55 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:55.307385 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-39268da8-83aa-4a97-836f-ea01587e07f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:55.307995 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-39268da8-83aa-4a97-836f-ea01587e07f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:55.314566 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39268da8-83aa-4a97-836f-ea01587e07f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:55.315049 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39268da8-83aa-4a97-836f-ea01587e07f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:55.315478 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39268da8-83aa-4a97-836f-ea01587e07f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:55.316348 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39268da8-83aa-4a97-836f-ea01587e07f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:55.316889 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39268da8-83aa-4a97-836f-ea01587e07f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:55.317316 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39268da8-83aa-4a97-836f-ea01587e07f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:55.380925 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-39268da8-83aa-4a97-836f-ea01587e07f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:55.388488 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-39268da8-83aa-4a97-836f-ea01587e07f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084909 Aug 04 23:31:55.389047 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 833/1629] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:55 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:56.294134 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3fb1ef08-70f2-4abb-99df-289d16b2e9d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:56.294763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3fb1ef08-70f2-4abb-99df-289d16b2e9d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:56.301292 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3fb1ef08-70f2-4abb-99df-289d16b2e9d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:56.301770 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3fb1ef08-70f2-4abb-99df-289d16b2e9d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:56.302203 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3fb1ef08-70f2-4abb-99df-289d16b2e9d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:56.302907 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3fb1ef08-70f2-4abb-99df-289d16b2e9d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:56.303355 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3fb1ef08-70f2-4abb-99df-289d16b2e9d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:56.303775 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3fb1ef08-70f2-4abb-99df-289d16b2e9d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:56.409120 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-93c31a2e-dda3-452a-9515-fd47ef8fbde4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:56.409875 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-93c31a2e-dda3-452a-9515-fd47ef8fbde4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:56.416470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-93c31a2e-dda3-452a-9515-fd47ef8fbde4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:56.417132 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-93c31a2e-dda3-452a-9515-fd47ef8fbde4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:56.417569 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-93c31a2e-dda3-452a-9515-fd47ef8fbde4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:56.418280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-93c31a2e-dda3-452a-9515-fd47ef8fbde4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:56.418761 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-93c31a2e-dda3-452a-9515-fd47ef8fbde4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:56.419188 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-93c31a2e-dda3-452a-9515-fd47ef8fbde4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:56.441142 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3fb1ef08-70f2-4abb-99df-289d16b2e9d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:56.449558 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3fb1ef08-70f2-4abb-99df-289d16b2e9d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.159324 Aug 04 23:31:56.450140 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 797/1630] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:56 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:56.482792 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-93c31a2e-dda3-452a-9515-fd47ef8fbde4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:56.491673 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-93c31a2e-dda3-452a-9515-fd47ef8fbde4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086426 Aug 04 23:31:56.492247 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 834/1631] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:56 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:31:57.470606 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9c3e6c30-e5f1-4f2f-8eb4-8eafd032ed2b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:57.471209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9c3e6c30-e5f1-4f2f-8eb4-8eafd032ed2b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:57.477659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9c3e6c30-e5f1-4f2f-8eb4-8eafd032ed2b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:57.478136 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9c3e6c30-e5f1-4f2f-8eb4-8eafd032ed2b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:57.479233 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9c3e6c30-e5f1-4f2f-8eb4-8eafd032ed2b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:57.479929 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9c3e6c30-e5f1-4f2f-8eb4-8eafd032ed2b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:57.480376 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9c3e6c30-e5f1-4f2f-8eb4-8eafd032ed2b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:57.480793 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9c3e6c30-e5f1-4f2f-8eb4-8eafd032ed2b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:57.511531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e4b5a75d-91a5-4724-bb9f-8d6f9dcf954f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:57.512236 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e4b5a75d-91a5-4724-bb9f-8d6f9dcf954f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:57.518706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4b5a75d-91a5-4724-bb9f-8d6f9dcf954f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:57.519192 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4b5a75d-91a5-4724-bb9f-8d6f9dcf954f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:57.519633 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4b5a75d-91a5-4724-bb9f-8d6f9dcf954f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:57.520331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4b5a75d-91a5-4724-bb9f-8d6f9dcf954f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:57.520789 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4b5a75d-91a5-4724-bb9f-8d6f9dcf954f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:57.521217 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4b5a75d-91a5-4724-bb9f-8d6f9dcf954f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:57.602698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e4b5a75d-91a5-4724-bb9f-8d6f9dcf954f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:57.610762 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e4b5a75d-91a5-4724-bb9f-8d6f9dcf954f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.102986 Aug 04 23:31:57.611327 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 835/1632] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:57 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:31:57.637855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9c3e6c30-e5f1-4f2f-8eb4-8eafd032ed2b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:57.646313 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9c3e6c30-e5f1-4f2f-8eb4-8eafd032ed2b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.179574 Aug 04 23:31:57.646902 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 798/1633] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:57 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:58.631735 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8b646448-ee7a-4f52-bae3-98e941c07ade tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:58.632341 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8b646448-ee7a-4f52-bae3-98e941c07ade tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:58.638904 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8b646448-ee7a-4f52-bae3-98e941c07ade tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:58.639383 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8b646448-ee7a-4f52-bae3-98e941c07ade tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:58.639814 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8b646448-ee7a-4f52-bae3-98e941c07ade tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:58.640504 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8b646448-ee7a-4f52-bae3-98e941c07ade tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:58.640954 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8b646448-ee7a-4f52-bae3-98e941c07ade tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:58.641378 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8b646448-ee7a-4f52-bae3-98e941c07ade tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:58.669780 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8c23a156-530a-474c-86d5-2431d0d979ba tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:58.670422 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8c23a156-530a-474c-86d5-2431d0d979ba tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:58.672759 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=52 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:31:58.678206 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c23a156-530a-474c-86d5-2431d0d979ba tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:58.678724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c23a156-530a-474c-86d5-2431d0d979ba tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:58.679163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c23a156-530a-474c-86d5-2431d0d979ba tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:58.679868 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c23a156-530a-474c-86d5-2431d0d979ba tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:58.680323 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c23a156-530a-474c-86d5-2431d0d979ba tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:58.680750 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c23a156-530a-474c-86d5-2431d0d979ba tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:58.712755 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8b646448-ee7a-4f52-bae3-98e941c07ade tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:58.721113 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8b646448-ee7a-4f52-bae3-98e941c07ade tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.093222 Aug 04 23:31:58.721880 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 836/1634] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:58 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:58.812917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8c23a156-530a-474c-86d5-2431d0d979ba tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:58.820827 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8c23a156-530a-474c-86d5-2431d0d979ba tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.155399 Aug 04 23:31:58.821391 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 799/1635] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:58 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:31:59.743010 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-cdb16de1-b836-42dd-9b74-0b0319cee077 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:59.743606 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-cdb16de1-b836-42dd-9b74-0b0319cee077 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:59.750714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cdb16de1-b836-42dd-9b74-0b0319cee077 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:59.751205 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cdb16de1-b836-42dd-9b74-0b0319cee077 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:59.751638 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cdb16de1-b836-42dd-9b74-0b0319cee077 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:59.752339 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cdb16de1-b836-42dd-9b74-0b0319cee077 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:59.752789 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cdb16de1-b836-42dd-9b74-0b0319cee077 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:59.753213 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cdb16de1-b836-42dd-9b74-0b0319cee077 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:59.815367 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cdb16de1-b836-42dd-9b74-0b0319cee077 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:31:59.824039 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-cdb16de1-b836-42dd-9b74-0b0319cee077 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.084926 Aug 04 23:31:59.824601 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 837/1636] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:59 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:31:59.843052 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c2efc3e4-e170-41e2-a494-23e10f2b9102 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:31:59.843667 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c2efc3e4-e170-41e2-a494-23e10f2b9102 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:31:59.850638 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c2efc3e4-e170-41e2-a494-23e10f2b9102 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:59.851120 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c2efc3e4-e170-41e2-a494-23e10f2b9102 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:59.851556 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c2efc3e4-e170-41e2-a494-23e10f2b9102 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:59.852261 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c2efc3e4-e170-41e2-a494-23e10f2b9102 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:31:59.852702 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c2efc3e4-e170-41e2-a494-23e10f2b9102 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:31:59.853126 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c2efc3e4-e170-41e2-a494-23e10f2b9102 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:31:59.992523 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c2efc3e4-e170-41e2-a494-23e10f2b9102 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:00.000897 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c2efc3e4-e170-41e2-a494-23e10f2b9102 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.161674 Aug 04 23:32:00.001458 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 800/1637] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:31:59 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:00.844730 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f5f00c44-e019-4176-b142-db114b987d16 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:00.845349 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f5f00c44-e019-4176-b142-db114b987d16 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:00.847655 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=56 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:32:00.852858 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f5f00c44-e019-4176-b142-db114b987d16 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:00.853844 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f5f00c44-e019-4176-b142-db114b987d16 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:00.854285 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f5f00c44-e019-4176-b142-db114b987d16 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:00.855036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f5f00c44-e019-4176-b142-db114b987d16 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:00.855486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f5f00c44-e019-4176-b142-db114b987d16 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:00.855909 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f5f00c44-e019-4176-b142-db114b987d16 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:00.917073 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f5f00c44-e019-4176-b142-db114b987d16 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:00.924657 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f5f00c44-e019-4176-b142-db114b987d16 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083865 Aug 04 23:32:00.925232 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 838/1638] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:00 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:01.021505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8fdef55a-f094-4a30-8778-c7ac9091f333 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:01.022121 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8fdef55a-f094-4a30-8778-c7ac9091f333 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:01.029400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8fdef55a-f094-4a30-8778-c7ac9091f333 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:01.029881 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8fdef55a-f094-4a30-8778-c7ac9091f333 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:01.030312 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8fdef55a-f094-4a30-8778-c7ac9091f333 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:01.031048 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8fdef55a-f094-4a30-8778-c7ac9091f333 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:01.031498 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8fdef55a-f094-4a30-8778-c7ac9091f333 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:01.031918 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8fdef55a-f094-4a30-8778-c7ac9091f333 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:01.167553 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8fdef55a-f094-4a30-8778-c7ac9091f333 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:01.175258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8fdef55a-f094-4a30-8778-c7ac9091f333 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.157527 Aug 04 23:32:01.175820 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 801/1639] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:01 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:01.945285 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4470d8a6-5eae-4b8b-801a-8001b72c330d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:01.945902 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4470d8a6-5eae-4b8b-801a-8001b72c330d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:01.953320 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4470d8a6-5eae-4b8b-801a-8001b72c330d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:01.953807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4470d8a6-5eae-4b8b-801a-8001b72c330d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:01.954303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4470d8a6-5eae-4b8b-801a-8001b72c330d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:01.955092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4470d8a6-5eae-4b8b-801a-8001b72c330d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:01.955551 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4470d8a6-5eae-4b8b-801a-8001b72c330d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:01.955972 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4470d8a6-5eae-4b8b-801a-8001b72c330d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:02.027566 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4470d8a6-5eae-4b8b-801a-8001b72c330d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:02.035383 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4470d8a6-5eae-4b8b-801a-8001b72c330d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.094116 Aug 04 23:32:02.035941 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 839/1640] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:01 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:02.196395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0bc68548-2ee9-46de-8296-55c4388ed748 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:02.197005 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0bc68548-2ee9-46de-8296-55c4388ed748 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:02.204064 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0bc68548-2ee9-46de-8296-55c4388ed748 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:02.204541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0bc68548-2ee9-46de-8296-55c4388ed748 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:02.204979 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0bc68548-2ee9-46de-8296-55c4388ed748 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:02.205665 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0bc68548-2ee9-46de-8296-55c4388ed748 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:02.206117 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0bc68548-2ee9-46de-8296-55c4388ed748 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:02.206577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0bc68548-2ee9-46de-8296-55c4388ed748 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:02.337822 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0bc68548-2ee9-46de-8296-55c4388ed748 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:02.345382 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0bc68548-2ee9-46de-8296-55c4388ed748 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.153146 Aug 04 23:32:02.345944 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 802/1641] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:02 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:03.056798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-54724578-b904-4c2a-b9d4-4f87bed02170 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:03.057538 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-54724578-b904-4c2a-b9d4-4f87bed02170 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:03.064078 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-54724578-b904-4c2a-b9d4-4f87bed02170 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:03.064563 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-54724578-b904-4c2a-b9d4-4f87bed02170 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:03.065000 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-54724578-b904-4c2a-b9d4-4f87bed02170 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:03.065695 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-54724578-b904-4c2a-b9d4-4f87bed02170 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:03.066147 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-54724578-b904-4c2a-b9d4-4f87bed02170 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:03.066604 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-54724578-b904-4c2a-b9d4-4f87bed02170 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:03.132524 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-54724578-b904-4c2a-b9d4-4f87bed02170 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:03.141790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-54724578-b904-4c2a-b9d4-4f87bed02170 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.088904 Aug 04 23:32:03.142411 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 840/1642] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:03 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:03.367222 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3808b6d2-8a99-4644-9132-1c40bb3955e6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:03.367928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3808b6d2-8a99-4644-9132-1c40bb3955e6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:03.375419 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3808b6d2-8a99-4644-9132-1c40bb3955e6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:03.375895 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3808b6d2-8a99-4644-9132-1c40bb3955e6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:03.376321 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3808b6d2-8a99-4644-9132-1c40bb3955e6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:03.376997 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3808b6d2-8a99-4644-9132-1c40bb3955e6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:03.377440 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3808b6d2-8a99-4644-9132-1c40bb3955e6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:03.377853 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3808b6d2-8a99-4644-9132-1c40bb3955e6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:03.519672 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3808b6d2-8a99-4644-9132-1c40bb3955e6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:03.527704 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3808b6d2-8a99-4644-9132-1c40bb3955e6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.164218 Aug 04 23:32:03.528301 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 803/1643] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:03 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:04.163024 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-601dc271-f76a-4837-8987-7c4f9f8c89cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:04.163584 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-601dc271-f76a-4837-8987-7c4f9f8c89cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:04.171260 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-601dc271-f76a-4837-8987-7c4f9f8c89cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:04.171740 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-601dc271-f76a-4837-8987-7c4f9f8c89cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:04.172166 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-601dc271-f76a-4837-8987-7c4f9f8c89cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:04.172856 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-601dc271-f76a-4837-8987-7c4f9f8c89cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:04.173300 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-601dc271-f76a-4837-8987-7c4f9f8c89cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:04.173713 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-601dc271-f76a-4837-8987-7c4f9f8c89cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:04.237164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-601dc271-f76a-4837-8987-7c4f9f8c89cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:04.245010 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-601dc271-f76a-4837-8987-7c4f9f8c89cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085871 Aug 04 23:32:04.245576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 841/1644] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:04 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:04.549778 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c7f7a5d4-ab75-44bb-802a-fc342a0f1424 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:04.550443 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c7f7a5d4-ab75-44bb-802a-fc342a0f1424 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:04.557053 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c7f7a5d4-ab75-44bb-802a-fc342a0f1424 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:04.557555 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c7f7a5d4-ab75-44bb-802a-fc342a0f1424 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:04.557965 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c7f7a5d4-ab75-44bb-802a-fc342a0f1424 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:04.558706 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c7f7a5d4-ab75-44bb-802a-fc342a0f1424 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:04.559159 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c7f7a5d4-ab75-44bb-802a-fc342a0f1424 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:04.559583 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c7f7a5d4-ab75-44bb-802a-fc342a0f1424 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:04.690670 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c7f7a5d4-ab75-44bb-802a-fc342a0f1424 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:04.699023 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c7f7a5d4-ab75-44bb-802a-fc342a0f1424 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.154221 Aug 04 23:32:04.699585 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 804/1645] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:04 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:05.269773 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2d425080-08f5-4680-bdac-c8a4c20373cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:05.271078 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2d425080-08f5-4680-bdac-c8a4c20373cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:05.279045 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d425080-08f5-4680-bdac-c8a4c20373cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:05.279539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d425080-08f5-4680-bdac-c8a4c20373cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:05.279985 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d425080-08f5-4680-bdac-c8a4c20373cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:05.280685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d425080-08f5-4680-bdac-c8a4c20373cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:05.281139 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d425080-08f5-4680-bdac-c8a4c20373cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:05.281566 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2d425080-08f5-4680-bdac-c8a4c20373cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:05.350881 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2d425080-08f5-4680-bdac-c8a4c20373cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:05.360216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2d425080-08f5-4680-bdac-c8a4c20373cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.097539 Aug 04 23:32:05.360813 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 842/1646] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:05 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:05.720439 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8d08dbd0-ee59-474a-9d2b-af95b319599c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:05.721127 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8d08dbd0-ee59-474a-9d2b-af95b319599c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:05.727450 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d08dbd0-ee59-474a-9d2b-af95b319599c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:05.727931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d08dbd0-ee59-474a-9d2b-af95b319599c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:05.729038 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d08dbd0-ee59-474a-9d2b-af95b319599c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:05.729754 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d08dbd0-ee59-474a-9d2b-af95b319599c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:05.730203 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d08dbd0-ee59-474a-9d2b-af95b319599c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:05.730655 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d08dbd0-ee59-474a-9d2b-af95b319599c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:05.866722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8d08dbd0-ee59-474a-9d2b-af95b319599c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:05.874710 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8d08dbd0-ee59-474a-9d2b-af95b319599c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.158288 Aug 04 23:32:05.875351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 805/1647] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:05 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:32:06.381875 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ef3897a0-7cb2-4c2e-ad38-f9589f912da2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:06.382524 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ef3897a0-7cb2-4c2e-ad38-f9589f912da2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:06.389330 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef3897a0-7cb2-4c2e-ad38-f9589f912da2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:06.389812 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef3897a0-7cb2-4c2e-ad38-f9589f912da2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:06.390237 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef3897a0-7cb2-4c2e-ad38-f9589f912da2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:06.390961 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef3897a0-7cb2-4c2e-ad38-f9589f912da2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:06.391410 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef3897a0-7cb2-4c2e-ad38-f9589f912da2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:06.391828 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ef3897a0-7cb2-4c2e-ad38-f9589f912da2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:06.456533 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ef3897a0-7cb2-4c2e-ad38-f9589f912da2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:06.465265 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ef3897a0-7cb2-4c2e-ad38-f9589f912da2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087135 Aug 04 23:32:06.465835 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 843/1648] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:06 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:32:06.896021 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-704c15e2-847b-4ece-b1c5-51b4bcb050b7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:06.896620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-704c15e2-847b-4ece-b1c5-51b4bcb050b7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:06.903717 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-704c15e2-847b-4ece-b1c5-51b4bcb050b7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:06.904192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-704c15e2-847b-4ece-b1c5-51b4bcb050b7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:06.904619 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-704c15e2-847b-4ece-b1c5-51b4bcb050b7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:06.905304 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-704c15e2-847b-4ece-b1c5-51b4bcb050b7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:06.905782 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-704c15e2-847b-4ece-b1c5-51b4bcb050b7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:06.906193 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-704c15e2-847b-4ece-b1c5-51b4bcb050b7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:07.043998 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-704c15e2-847b-4ece-b1c5-51b4bcb050b7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:07.051685 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-704c15e2-847b-4ece-b1c5-51b4bcb050b7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.159557 Aug 04 23:32:07.052255 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 806/1649] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:06 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:07.486143 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9d1e4b95-b374-4a52-88c7-147466286ac4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:07.486774 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9d1e4b95-b374-4a52-88c7-147466286ac4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:07.493292 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d1e4b95-b374-4a52-88c7-147466286ac4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:07.494442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d1e4b95-b374-4a52-88c7-147466286ac4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:07.494874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d1e4b95-b374-4a52-88c7-147466286ac4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:07.495582 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d1e4b95-b374-4a52-88c7-147466286ac4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:07.496035 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d1e4b95-b374-4a52-88c7-147466286ac4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:07.496451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9d1e4b95-b374-4a52-88c7-147466286ac4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:07.511776 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:32:07.560480 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9d1e4b95-b374-4a52-88c7-147466286ac4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:07.568296 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9d1e4b95-b374-4a52-88c7-147466286ac4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.085997 Aug 04 23:32:07.568883 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 844/1650] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:07 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:08.074930 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5c5a9a77-e061-4980-a799-a7734c6d3654 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:08.075596 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5c5a9a77-e061-4980-a799-a7734c6d3654 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:08.082613 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c5a9a77-e061-4980-a799-a7734c6d3654 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:08.083117 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c5a9a77-e061-4980-a799-a7734c6d3654 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:08.083538 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c5a9a77-e061-4980-a799-a7734c6d3654 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:08.084251 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c5a9a77-e061-4980-a799-a7734c6d3654 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:08.084695 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c5a9a77-e061-4980-a799-a7734c6d3654 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:08.085202 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c5a9a77-e061-4980-a799-a7734c6d3654 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:08.238308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5c5a9a77-e061-4980-a799-a7734c6d3654 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:08.248793 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5c5a9a77-e061-4980-a799-a7734c6d3654 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.178666 Aug 04 23:32:08.249386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 807/1651] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:08 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:08.590387 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4645870a-ec12-44c7-aecc-3370170260af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:08.590996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4645870a-ec12-44c7-aecc-3370170260af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:08.597521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4645870a-ec12-44c7-aecc-3370170260af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:08.597994 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4645870a-ec12-44c7-aecc-3370170260af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:08.598452 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4645870a-ec12-44c7-aecc-3370170260af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:08.599144 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4645870a-ec12-44c7-aecc-3370170260af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:08.599579 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4645870a-ec12-44c7-aecc-3370170260af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:08.599992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4645870a-ec12-44c7-aecc-3370170260af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:08.668811 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4645870a-ec12-44c7-aecc-3370170260af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:08.676819 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4645870a-ec12-44c7-aecc-3370170260af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.091454 Aug 04 23:32:08.677408 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 845/1652] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:08 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:09.270249 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ef0028cc-ce60-4e8a-ac85-d973742aa5a4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:09.270899 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ef0028cc-ce60-4e8a-ac85-d973742aa5a4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:09.277610 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef0028cc-ce60-4e8a-ac85-d973742aa5a4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:09.278093 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef0028cc-ce60-4e8a-ac85-d973742aa5a4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:09.278556 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef0028cc-ce60-4e8a-ac85-d973742aa5a4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:09.279252 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef0028cc-ce60-4e8a-ac85-d973742aa5a4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:09.279697 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef0028cc-ce60-4e8a-ac85-d973742aa5a4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:09.280113 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef0028cc-ce60-4e8a-ac85-d973742aa5a4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:09.420340 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ef0028cc-ce60-4e8a-ac85-d973742aa5a4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:09.428112 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ef0028cc-ce60-4e8a-ac85-d973742aa5a4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.161676 Aug 04 23:32:09.428685 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 808/1653] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:09 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:09.711230 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6e4a8b6d-411e-44ee-810a-2791cb3e631b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:09.711834 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6e4a8b6d-411e-44ee-810a-2791cb3e631b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:09.719116 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e4a8b6d-411e-44ee-810a-2791cb3e631b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:09.719691 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e4a8b6d-411e-44ee-810a-2791cb3e631b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:09.720130 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e4a8b6d-411e-44ee-810a-2791cb3e631b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:09.721063 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e4a8b6d-411e-44ee-810a-2791cb3e631b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:09.721599 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e4a8b6d-411e-44ee-810a-2791cb3e631b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:09.722025 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e4a8b6d-411e-44ee-810a-2791cb3e631b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:09.949792 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6e4a8b6d-411e-44ee-810a-2791cb3e631b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:09.957799 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6e4a8b6d-411e-44ee-810a-2791cb3e631b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.250569 Aug 04 23:32:09.958411 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 846/1654] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:09 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:10.450931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8a481ef9-4239-490e-946e-a31b8dbd3ce5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:10.451540 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8a481ef9-4239-490e-946e-a31b8dbd3ce5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:10.458320 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a481ef9-4239-490e-946e-a31b8dbd3ce5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:10.458860 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a481ef9-4239-490e-946e-a31b8dbd3ce5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:10.459274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a481ef9-4239-490e-946e-a31b8dbd3ce5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:10.459978 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a481ef9-4239-490e-946e-a31b8dbd3ce5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:10.460425 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a481ef9-4239-490e-946e-a31b8dbd3ce5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:10.460844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8a481ef9-4239-490e-946e-a31b8dbd3ce5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:10.604255 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8a481ef9-4239-490e-946e-a31b8dbd3ce5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:10.612018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8a481ef9-4239-490e-946e-a31b8dbd3ce5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.165903 Aug 04 23:32:10.612584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 809/1655] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:10 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:10.992258 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a0d5f079-e98e-4ef5-94f5-b0ee06e8f4e2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:10.992891 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a0d5f079-e98e-4ef5-94f5-b0ee06e8f4e2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:10.999539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a0d5f079-e98e-4ef5-94f5-b0ee06e8f4e2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:11.000019 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a0d5f079-e98e-4ef5-94f5-b0ee06e8f4e2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:11.000449 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a0d5f079-e98e-4ef5-94f5-b0ee06e8f4e2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:11.003483 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a0d5f079-e98e-4ef5-94f5-b0ee06e8f4e2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:11.004000 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a0d5f079-e98e-4ef5-94f5-b0ee06e8f4e2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:11.008834 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a0d5f079-e98e-4ef5-94f5-b0ee06e8f4e2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:11.071887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a0d5f079-e98e-4ef5-94f5-b0ee06e8f4e2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:11.079831 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a0d5f079-e98e-4ef5-94f5-b0ee06e8f4e2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.091532 Aug 04 23:32:11.080394 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 847/1656] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:10 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:11.635657 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7d6f7117-49ff-4932-bfed-20fcc21b69b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:11.636714 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7d6f7117-49ff-4932-bfed-20fcc21b69b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:11.647433 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d6f7117-49ff-4932-bfed-20fcc21b69b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:11.647931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d6f7117-49ff-4932-bfed-20fcc21b69b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:11.648682 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d6f7117-49ff-4932-bfed-20fcc21b69b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:11.649625 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d6f7117-49ff-4932-bfed-20fcc21b69b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:11.650613 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d6f7117-49ff-4932-bfed-20fcc21b69b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:11.651114 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d6f7117-49ff-4932-bfed-20fcc21b69b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:11.788533 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7d6f7117-49ff-4932-bfed-20fcc21b69b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:11.797369 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7d6f7117-49ff-4932-bfed-20fcc21b69b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.166817 Aug 04 23:32:11.798120 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 810/1657] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:11 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:12.101456 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-aa0d3635-662c-4004-b397-e2ef01be051f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:12.102045 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-aa0d3635-662c-4004-b397-e2ef01be051f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:12.109186 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa0d3635-662c-4004-b397-e2ef01be051f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:12.109671 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa0d3635-662c-4004-b397-e2ef01be051f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:12.110105 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa0d3635-662c-4004-b397-e2ef01be051f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:12.110838 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa0d3635-662c-4004-b397-e2ef01be051f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:12.111287 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa0d3635-662c-4004-b397-e2ef01be051f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:12.111705 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa0d3635-662c-4004-b397-e2ef01be051f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:12.177510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-aa0d3635-662c-4004-b397-e2ef01be051f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:12.186659 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-aa0d3635-662c-4004-b397-e2ef01be051f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089123 Aug 04 23:32:12.187232 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 848/1658] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:12 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:12.819830 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-587fdc2f-540e-4740-b70b-b0eb94c228ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:12.820445 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-587fdc2f-540e-4740-b70b-b0eb94c228ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:12.828417 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-587fdc2f-540e-4740-b70b-b0eb94c228ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:12.828912 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-587fdc2f-540e-4740-b70b-b0eb94c228ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:12.829348 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-587fdc2f-540e-4740-b70b-b0eb94c228ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:12.830075 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-587fdc2f-540e-4740-b70b-b0eb94c228ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:12.830568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-587fdc2f-540e-4740-b70b-b0eb94c228ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:12.830996 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-587fdc2f-540e-4740-b70b-b0eb94c228ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:12.973689 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-587fdc2f-540e-4740-b70b-b0eb94c228ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:12.983566 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-587fdc2f-540e-4740-b70b-b0eb94c228ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.168554 Aug 04 23:32:12.984151 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 811/1659] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:12 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:13.208000 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3e15d2e5-c200-4ae4-b5b1-52a2867f88eb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:13.208626 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3e15d2e5-c200-4ae4-b5b1-52a2867f88eb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:13.216267 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e15d2e5-c200-4ae4-b5b1-52a2867f88eb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:13.216758 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e15d2e5-c200-4ae4-b5b1-52a2867f88eb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:13.217199 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e15d2e5-c200-4ae4-b5b1-52a2867f88eb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:13.217912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e15d2e5-c200-4ae4-b5b1-52a2867f88eb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:13.218384 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e15d2e5-c200-4ae4-b5b1-52a2867f88eb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:13.218824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e15d2e5-c200-4ae4-b5b1-52a2867f88eb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:13.284612 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3e15d2e5-c200-4ae4-b5b1-52a2867f88eb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:13.293791 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3e15d2e5-c200-4ae4-b5b1-52a2867f88eb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089593 Aug 04 23:32:13.294401 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 849/1660] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:13 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:14.005802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8f0249fd-f15a-4ed9-bf7a-e4b7b1f49b3e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:14.006518 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8f0249fd-f15a-4ed9-bf7a-e4b7b1f49b3e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:14.014275 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8f0249fd-f15a-4ed9-bf7a-e4b7b1f49b3e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:14.015023 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8f0249fd-f15a-4ed9-bf7a-e4b7b1f49b3e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:14.015542 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8f0249fd-f15a-4ed9-bf7a-e4b7b1f49b3e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:14.016506 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8f0249fd-f15a-4ed9-bf7a-e4b7b1f49b3e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:14.017014 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8f0249fd-f15a-4ed9-bf7a-e4b7b1f49b3e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:14.017524 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8f0249fd-f15a-4ed9-bf7a-e4b7b1f49b3e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:14.171275 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8f0249fd-f15a-4ed9-bf7a-e4b7b1f49b3e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:14.179254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8f0249fd-f15a-4ed9-bf7a-e4b7b1f49b3e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.177327 Aug 04 23:32:14.179835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 812/1661] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:14 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:32:14.315156 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-81c04ad2-0baa-4437-a3cd-d0e76d0a5fe7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:14.315765 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-81c04ad2-0baa-4437-a3cd-d0e76d0a5fe7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:14.324248 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-81c04ad2-0baa-4437-a3cd-d0e76d0a5fe7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:14.324729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-81c04ad2-0baa-4437-a3cd-d0e76d0a5fe7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:14.325159 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-81c04ad2-0baa-4437-a3cd-d0e76d0a5fe7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:14.325874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-81c04ad2-0baa-4437-a3cd-d0e76d0a5fe7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:14.326323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-81c04ad2-0baa-4437-a3cd-d0e76d0a5fe7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:14.326767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-81c04ad2-0baa-4437-a3cd-d0e76d0a5fe7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:14.393674 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-81c04ad2-0baa-4437-a3cd-d0e76d0a5fe7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:14.402908 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-81c04ad2-0baa-4437-a3cd-d0e76d0a5fe7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.091416 Aug 04 23:32:14.403512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 850/1662] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:14 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:15.201187 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-dff5f293-9709-4a4c-b176-ed46cfede38f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:15.201965 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-dff5f293-9709-4a4c-b176-ed46cfede38f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:15.209397 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dff5f293-9709-4a4c-b176-ed46cfede38f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:15.209891 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dff5f293-9709-4a4c-b176-ed46cfede38f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:15.210752 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dff5f293-9709-4a4c-b176-ed46cfede38f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:15.211088 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dff5f293-9709-4a4c-b176-ed46cfede38f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:15.211548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dff5f293-9709-4a4c-b176-ed46cfede38f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:15.212126 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dff5f293-9709-4a4c-b176-ed46cfede38f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:15.217304 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:32:15.378532 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-dff5f293-9709-4a4c-b176-ed46cfede38f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:15.387638 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-dff5f293-9709-4a4c-b176-ed46cfede38f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.191036 Aug 04 23:32:15.388238 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 813/1663] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:15 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:15.424213 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-047939b5-d530-4c31-8cef-e1874e65ec1f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:15.424875 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-047939b5-d530-4c31-8cef-e1874e65ec1f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:15.432672 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-047939b5-d530-4c31-8cef-e1874e65ec1f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:15.433161 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-047939b5-d530-4c31-8cef-e1874e65ec1f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:15.433602 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-047939b5-d530-4c31-8cef-e1874e65ec1f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:15.434336 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-047939b5-d530-4c31-8cef-e1874e65ec1f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:15.434826 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-047939b5-d530-4c31-8cef-e1874e65ec1f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:15.435254 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-047939b5-d530-4c31-8cef-e1874e65ec1f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:15.512955 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-047939b5-d530-4c31-8cef-e1874e65ec1f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:15.520798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-047939b5-d530-4c31-8cef-e1874e65ec1f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.100432 Aug 04 23:32:15.521373 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 851/1664] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:15 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:32:16.409255 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4efa98f1-5998-489b-8bce-abccf90c68b1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:16.410020 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4efa98f1-5998-489b-8bce-abccf90c68b1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:16.416852 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4efa98f1-5998-489b-8bce-abccf90c68b1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:16.417332 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4efa98f1-5998-489b-8bce-abccf90c68b1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:16.417762 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4efa98f1-5998-489b-8bce-abccf90c68b1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:16.418498 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4efa98f1-5998-489b-8bce-abccf90c68b1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:16.418944 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4efa98f1-5998-489b-8bce-abccf90c68b1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:16.419364 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4efa98f1-5998-489b-8bce-abccf90c68b1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:16.542637 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0dbdf95e-f102-4593-a2ce-d845a25800db tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:16.543347 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0dbdf95e-f102-4593-a2ce-d845a25800db tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:16.550392 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0dbdf95e-f102-4593-a2ce-d845a25800db tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:16.551040 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0dbdf95e-f102-4593-a2ce-d845a25800db tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:16.551542 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0dbdf95e-f102-4593-a2ce-d845a25800db tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:16.552340 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0dbdf95e-f102-4593-a2ce-d845a25800db tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:16.552883 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0dbdf95e-f102-4593-a2ce-d845a25800db tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:16.553385 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0dbdf95e-f102-4593-a2ce-d845a25800db tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:16.565447 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4efa98f1-5998-489b-8bce-abccf90c68b1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:16.574379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4efa98f1-5998-489b-8bce-abccf90c68b1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.169065 Aug 04 23:32:16.575252 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 814/1665] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:16 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:16.625270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0dbdf95e-f102-4593-a2ce-d845a25800db tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:16.632933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0dbdf95e-f102-4593-a2ce-d845a25800db tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.094839 Aug 04 23:32:16.633510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 852/1666] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:16 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:32:17.596072 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-468f3a44-c2fb-4085-9696-ff18731bf7cf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:17.596682 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-468f3a44-c2fb-4085-9696-ff18731bf7cf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:17.603984 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-468f3a44-c2fb-4085-9696-ff18731bf7cf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:17.604481 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-468f3a44-c2fb-4085-9696-ff18731bf7cf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:17.604914 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-468f3a44-c2fb-4085-9696-ff18731bf7cf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:17.605612 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-468f3a44-c2fb-4085-9696-ff18731bf7cf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:17.606061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-468f3a44-c2fb-4085-9696-ff18731bf7cf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:17.606511 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-468f3a44-c2fb-4085-9696-ff18731bf7cf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:17.657737 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a7ba4f4a-529e-4b62-94c8-5e776dcbad1b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:17.658870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a7ba4f4a-529e-4b62-94c8-5e776dcbad1b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:17.669186 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a7ba4f4a-529e-4b62-94c8-5e776dcbad1b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:17.669722 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a7ba4f4a-529e-4b62-94c8-5e776dcbad1b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:17.670330 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a7ba4f4a-529e-4b62-94c8-5e776dcbad1b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:17.671311 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a7ba4f4a-529e-4b62-94c8-5e776dcbad1b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:17.671777 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a7ba4f4a-529e-4b62-94c8-5e776dcbad1b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:17.672218 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a7ba4f4a-529e-4b62-94c8-5e776dcbad1b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:17.945929 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a7ba4f4a-529e-4b62-94c8-5e776dcbad1b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:17.954884 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a7ba4f4a-529e-4b62-94c8-5e776dcbad1b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.303799 Aug 04 23:32:17.955470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 853/1667] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:17 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:18.010863 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-468f3a44-c2fb-4085-9696-ff18731bf7cf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:18.018712 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-468f3a44-c2fb-4085-9696-ff18731bf7cf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.426313 Aug 04 23:32:18.019303 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 815/1668] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:17 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:18.975999 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-af6365eb-22ac-4c1f-8f5c-dd0ce7208275 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:18.976645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-af6365eb-22ac-4c1f-8f5c-dd0ce7208275 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:18.984334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af6365eb-22ac-4c1f-8f5c-dd0ce7208275 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:18.984825 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af6365eb-22ac-4c1f-8f5c-dd0ce7208275 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:18.985260 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af6365eb-22ac-4c1f-8f5c-dd0ce7208275 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:18.985960 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af6365eb-22ac-4c1f-8f5c-dd0ce7208275 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:18.986437 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af6365eb-22ac-4c1f-8f5c-dd0ce7208275 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:18.986862 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af6365eb-22ac-4c1f-8f5c-dd0ce7208275 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:19.042066 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-bb7c0a8c-305b-4670-8530-3e2c7a8385c5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:19.043023 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-bb7c0a8c-305b-4670-8530-3e2c7a8385c5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:19.050007 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb7c0a8c-305b-4670-8530-3e2c7a8385c5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:19.050539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb7c0a8c-305b-4670-8530-3e2c7a8385c5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:19.050735 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-af6365eb-22ac-4c1f-8f5c-dd0ce7208275 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:19.050970 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb7c0a8c-305b-4670-8530-3e2c7a8385c5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:19.051668 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb7c0a8c-305b-4670-8530-3e2c7a8385c5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:19.052116 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb7c0a8c-305b-4670-8530-3e2c7a8385c5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:19.052536 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb7c0a8c-305b-4670-8530-3e2c7a8385c5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:19.059188 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-af6365eb-22ac-4c1f-8f5c-dd0ce7208275 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087077 Aug 04 23:32:19.059759 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 854/1669] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:18 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:19.190430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-bb7c0a8c-305b-4670-8530-3e2c7a8385c5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:19.198345 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-bb7c0a8c-305b-4670-8530-3e2c7a8385c5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.161166 Aug 04 23:32:19.198925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 816/1670] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:19 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:20.083073 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8a888d7b-c58f-426b-be98-1d9339ff4bdc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:20.083667 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8a888d7b-c58f-426b-be98-1d9339ff4bdc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:20.090922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8a888d7b-c58f-426b-be98-1d9339ff4bdc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:20.091281 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8a888d7b-c58f-426b-be98-1d9339ff4bdc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:20.091722 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8a888d7b-c58f-426b-be98-1d9339ff4bdc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:20.092430 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8a888d7b-c58f-426b-be98-1d9339ff4bdc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:20.092897 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8a888d7b-c58f-426b-be98-1d9339ff4bdc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:20.093331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8a888d7b-c58f-426b-be98-1d9339ff4bdc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:20.157398 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8a888d7b-c58f-426b-be98-1d9339ff4bdc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:20.166389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8a888d7b-c58f-426b-be98-1d9339ff4bdc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.087396 Aug 04 23:32:20.166946 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 855/1671] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:20 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:20.219138 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8db8ab73-39e8-4f48-8fd3-331115bf0056 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:20.219745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8db8ab73-39e8-4f48-8fd3-331115bf0056 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:20.226231 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8db8ab73-39e8-4f48-8fd3-331115bf0056 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:20.226739 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8db8ab73-39e8-4f48-8fd3-331115bf0056 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:20.227169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8db8ab73-39e8-4f48-8fd3-331115bf0056 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:20.228509 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8db8ab73-39e8-4f48-8fd3-331115bf0056 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:20.228972 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8db8ab73-39e8-4f48-8fd3-331115bf0056 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:20.229396 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8db8ab73-39e8-4f48-8fd3-331115bf0056 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:20.359269 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8db8ab73-39e8-4f48-8fd3-331115bf0056 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:20.369287 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8db8ab73-39e8-4f48-8fd3-331115bf0056 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.153843 Aug 04 23:32:20.369875 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 817/1672] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:20 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:21.186416 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9c9539ec-87ba-420e-ba57-687224d165af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:21.187160 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9c9539ec-87ba-420e-ba57-687224d165af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:21.193568 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c9539ec-87ba-420e-ba57-687224d165af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:21.194568 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c9539ec-87ba-420e-ba57-687224d165af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:21.194788 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c9539ec-87ba-420e-ba57-687224d165af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:21.195497 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c9539ec-87ba-420e-ba57-687224d165af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:21.195952 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c9539ec-87ba-420e-ba57-687224d165af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:21.196911 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c9539ec-87ba-420e-ba57-687224d165af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:21.264027 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9c9539ec-87ba-420e-ba57-687224d165af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:21.271771 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9c9539ec-87ba-420e-ba57-687224d165af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089285 Aug 04 23:32:21.272346 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 856/1673] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:21 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:21.392179 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a62f9f88-dfee-4c2d-9d44-629c85a73ba8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:21.392846 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a62f9f88-dfee-4c2d-9d44-629c85a73ba8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:21.400441 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a62f9f88-dfee-4c2d-9d44-629c85a73ba8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:21.400927 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a62f9f88-dfee-4c2d-9d44-629c85a73ba8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:21.401361 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a62f9f88-dfee-4c2d-9d44-629c85a73ba8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:21.402058 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a62f9f88-dfee-4c2d-9d44-629c85a73ba8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:21.402543 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a62f9f88-dfee-4c2d-9d44-629c85a73ba8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:21.402968 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a62f9f88-dfee-4c2d-9d44-629c85a73ba8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:21.542990 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a62f9f88-dfee-4c2d-9d44-629c85a73ba8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:21.551534 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a62f9f88-dfee-4c2d-9d44-629c85a73ba8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.163223 Aug 04 23:32:21.552099 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 818/1674] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:21 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:22.294269 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-55376166-8efb-44a2-96cf-e22f196b28fe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:22.294906 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-55376166-8efb-44a2-96cf-e22f196b28fe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:22.301829 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-55376166-8efb-44a2-96cf-e22f196b28fe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:22.302313 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-55376166-8efb-44a2-96cf-e22f196b28fe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:22.302771 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-55376166-8efb-44a2-96cf-e22f196b28fe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:22.303474 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-55376166-8efb-44a2-96cf-e22f196b28fe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:22.303922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-55376166-8efb-44a2-96cf-e22f196b28fe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:22.304341 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-55376166-8efb-44a2-96cf-e22f196b28fe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:22.370990 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-55376166-8efb-44a2-96cf-e22f196b28fe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:22.379239 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-55376166-8efb-44a2-96cf-e22f196b28fe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.089701 Aug 04 23:32:22.379818 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 857/1675] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:22 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:22.575254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-afdec1f5-8ebc-48c4-ac83-c4680eaf71a7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:22.575835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-afdec1f5-8ebc-48c4-ac83-c4680eaf71a7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:22.583077 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-afdec1f5-8ebc-48c4-ac83-c4680eaf71a7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:22.583559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-afdec1f5-8ebc-48c4-ac83-c4680eaf71a7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:22.583988 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-afdec1f5-8ebc-48c4-ac83-c4680eaf71a7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:22.584685 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-afdec1f5-8ebc-48c4-ac83-c4680eaf71a7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:22.585136 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-afdec1f5-8ebc-48c4-ac83-c4680eaf71a7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:22.585552 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-afdec1f5-8ebc-48c4-ac83-c4680eaf71a7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:22.737998 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-afdec1f5-8ebc-48c4-ac83-c4680eaf71a7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:22.746183 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-afdec1f5-8ebc-48c4-ac83-c4680eaf71a7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.175255 Aug 04 23:32:22.746830 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 819/1676] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:22 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:23.403411 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c2bb2ca1-0e19-4010-93c6-611b73a6a1e7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:23.404055 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c2bb2ca1-0e19-4010-93c6-611b73a6a1e7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:23.410519 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2bb2ca1-0e19-4010-93c6-611b73a6a1e7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:23.410998 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2bb2ca1-0e19-4010-93c6-611b73a6a1e7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:23.411431 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2bb2ca1-0e19-4010-93c6-611b73a6a1e7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:23.412144 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2bb2ca1-0e19-4010-93c6-611b73a6a1e7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:23.412593 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2bb2ca1-0e19-4010-93c6-611b73a6a1e7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:23.413013 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2bb2ca1-0e19-4010-93c6-611b73a6a1e7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:23.478141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c2bb2ca1-0e19-4010-93c6-611b73a6a1e7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:23.485811 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c2bb2ca1-0e19-4010-93c6-611b73a6a1e7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086824 Aug 04 23:32:23.486396 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 858/1677] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:23 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:23.768092 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6d563e2c-61e0-4f19-8592-7ab032b7731a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:23.768687 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6d563e2c-61e0-4f19-8592-7ab032b7731a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:23.774844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6d563e2c-61e0-4f19-8592-7ab032b7731a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:23.775341 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6d563e2c-61e0-4f19-8592-7ab032b7731a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:23.775858 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6d563e2c-61e0-4f19-8592-7ab032b7731a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:23.776552 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6d563e2c-61e0-4f19-8592-7ab032b7731a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:23.777143 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6d563e2c-61e0-4f19-8592-7ab032b7731a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:23.777425 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6d563e2c-61e0-4f19-8592-7ab032b7731a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:23.912928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6d563e2c-61e0-4f19-8592-7ab032b7731a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:23.920983 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6d563e2c-61e0-4f19-8592-7ab032b7731a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.156914 Aug 04 23:32:23.921647 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 820/1678] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:23 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:24.506528 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-30cbd376-1130-4a90-9581-e9f2988a19f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:24.507140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-30cbd376-1130-4a90-9581-e9f2988a19f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:24.513599 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-30cbd376-1130-4a90-9581-e9f2988a19f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:24.514085 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-30cbd376-1130-4a90-9581-e9f2988a19f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:24.514551 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-30cbd376-1130-4a90-9581-e9f2988a19f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:24.515252 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-30cbd376-1130-4a90-9581-e9f2988a19f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:24.515706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-30cbd376-1130-4a90-9581-e9f2988a19f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:24.516132 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-30cbd376-1130-4a90-9581-e9f2988a19f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:24.580904 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-30cbd376-1130-4a90-9581-e9f2988a19f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:24.589069 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-30cbd376-1130-4a90-9581-e9f2988a19f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.086496 Aug 04 23:32:24.589615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 859/1679] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:24 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:24.944154 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-aeb1c93e-6db5-49fd-b2fc-971e4753dd78 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:24.944790 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-aeb1c93e-6db5-49fd-b2fc-971e4753dd78 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:24.952102 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aeb1c93e-6db5-49fd-b2fc-971e4753dd78 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:24.952584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aeb1c93e-6db5-49fd-b2fc-971e4753dd78 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:24.953020 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aeb1c93e-6db5-49fd-b2fc-971e4753dd78 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:24.953726 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aeb1c93e-6db5-49fd-b2fc-971e4753dd78 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:24.954180 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aeb1c93e-6db5-49fd-b2fc-971e4753dd78 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:24.954635 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aeb1c93e-6db5-49fd-b2fc-971e4753dd78 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:25.084985 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-aeb1c93e-6db5-49fd-b2fc-971e4753dd78 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:25.093424 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-aeb1c93e-6db5-49fd-b2fc-971e4753dd78 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.153400 Aug 04 23:32:25.093994 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 821/1680] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:24 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:25.611364 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a8bc4cd9-756c-48ef-b8ee-267f19158a23 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:25.611969 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a8bc4cd9-756c-48ef-b8ee-267f19158a23 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:25.618606 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8bc4cd9-756c-48ef-b8ee-267f19158a23 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:25.619094 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8bc4cd9-756c-48ef-b8ee-267f19158a23 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:25.619523 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8bc4cd9-756c-48ef-b8ee-267f19158a23 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:25.620226 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8bc4cd9-756c-48ef-b8ee-267f19158a23 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:25.620684 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8bc4cd9-756c-48ef-b8ee-267f19158a23 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:25.621109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8bc4cd9-756c-48ef-b8ee-267f19158a23 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:25.683288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a8bc4cd9-756c-48ef-b8ee-267f19158a23 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:25.690773 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a8bc4cd9-756c-48ef-b8ee-267f19158a23 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d" status: 200 len: 1226 microversion: 2.1 time: 0.083210 Aug 04 23:32:25.691334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 860/1681] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:25 2022] GET /compute/v2.1/servers/71b8cd32-6b1e-4f42-9d4f-b90afbce7e3d => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:26.114200 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8de4c159-bd97-43fe-929e-aca1cc1ceef1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:26.114777 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8de4c159-bd97-43fe-929e-aca1cc1ceef1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:26.121845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8de4c159-bd97-43fe-929e-aca1cc1ceef1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:26.122328 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8de4c159-bd97-43fe-929e-aca1cc1ceef1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:26.122793 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8de4c159-bd97-43fe-929e-aca1cc1ceef1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:26.123488 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8de4c159-bd97-43fe-929e-aca1cc1ceef1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:26.123948 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8de4c159-bd97-43fe-929e-aca1cc1ceef1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:26.124463 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8de4c159-bd97-43fe-929e-aca1cc1ceef1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:26.272273 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8de4c159-bd97-43fe-929e-aca1cc1ceef1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:26.280768 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8de4c159-bd97-43fe-929e-aca1cc1ceef1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.170184 Aug 04 23:32:26.281330 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 822/1682] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:26 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:27.302321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7379bffd-5fb9-47b8-8acb-d63cbd1434c7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:27.302956 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7379bffd-5fb9-47b8-8acb-d63cbd1434c7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:27.310184 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7379bffd-5fb9-47b8-8acb-d63cbd1434c7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:27.310687 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7379bffd-5fb9-47b8-8acb-d63cbd1434c7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:27.311126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7379bffd-5fb9-47b8-8acb-d63cbd1434c7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:27.311816 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7379bffd-5fb9-47b8-8acb-d63cbd1434c7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:27.312269 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7379bffd-5fb9-47b8-8acb-d63cbd1434c7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:27.312692 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7379bffd-5fb9-47b8-8acb-d63cbd1434c7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:27.315278 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:32:27.444385 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7379bffd-5fb9-47b8-8acb-d63cbd1434c7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:27.451938 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7379bffd-5fb9-47b8-8acb-d63cbd1434c7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.153504 Aug 04 23:32:27.452536 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 861/1683] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:27 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:28.474869 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ef046259-1368-45be-8ad5-177640b43898 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:28.475822 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ef046259-1368-45be-8ad5-177640b43898 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:28.485045 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef046259-1368-45be-8ad5-177640b43898 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:28.485662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef046259-1368-45be-8ad5-177640b43898 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:28.486264 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef046259-1368-45be-8ad5-177640b43898 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:28.487167 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef046259-1368-45be-8ad5-177640b43898 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:28.487683 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef046259-1368-45be-8ad5-177640b43898 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:28.488123 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef046259-1368-45be-8ad5-177640b43898 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:28.642579 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ef046259-1368-45be-8ad5-177640b43898 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:28.650529 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ef046259-1368-45be-8ad5-177640b43898 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.180202 Aug 04 23:32:28.651128 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 823/1684] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:28 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:29.671645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-06719bd3-cef8-495a-ac02-dfb86d89aeff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:29.672236 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-06719bd3-cef8-495a-ac02-dfb86d89aeff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:29.678910 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-06719bd3-cef8-495a-ac02-dfb86d89aeff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:29.679387 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-06719bd3-cef8-495a-ac02-dfb86d89aeff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:29.679824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-06719bd3-cef8-495a-ac02-dfb86d89aeff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:29.680513 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-06719bd3-cef8-495a-ac02-dfb86d89aeff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:29.680962 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-06719bd3-cef8-495a-ac02-dfb86d89aeff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:29.681886 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-06719bd3-cef8-495a-ac02-dfb86d89aeff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:29.817755 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-06719bd3-cef8-495a-ac02-dfb86d89aeff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:29.826585 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-06719bd3-cef8-495a-ac02-dfb86d89aeff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.158823 Aug 04 23:32:29.827139 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 862/1685] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:29 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:30.847669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3cf686c4-7953-44b6-a8ad-840ac8064360 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:30.848287 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3cf686c4-7953-44b6-a8ad-840ac8064360 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:30.850816 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=50 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:32:30.857090 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3cf686c4-7953-44b6-a8ad-840ac8064360 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:30.857583 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3cf686c4-7953-44b6-a8ad-840ac8064360 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:30.858022 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3cf686c4-7953-44b6-a8ad-840ac8064360 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:30.858775 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3cf686c4-7953-44b6-a8ad-840ac8064360 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:30.859299 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3cf686c4-7953-44b6-a8ad-840ac8064360 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:30.859741 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3cf686c4-7953-44b6-a8ad-840ac8064360 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:30.998153 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3cf686c4-7953-44b6-a8ad-840ac8064360 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:31.006484 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3cf686c4-7953-44b6-a8ad-840ac8064360 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.162683 Aug 04 23:32:31.007050 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 824/1686] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:30 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:32:32.028766 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-398a9fb9-fc7d-4edd-aff5-36827bf9ef3f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:32.029378 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-398a9fb9-fc7d-4edd-aff5-36827bf9ef3f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:32.031753 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=50 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:32:32.036854 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-398a9fb9-fc7d-4edd-aff5-36827bf9ef3f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:32.037333 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-398a9fb9-fc7d-4edd-aff5-36827bf9ef3f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:32.037766 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-398a9fb9-fc7d-4edd-aff5-36827bf9ef3f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:32.038482 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-398a9fb9-fc7d-4edd-aff5-36827bf9ef3f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:32.038933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-398a9fb9-fc7d-4edd-aff5-36827bf9ef3f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:32.039351 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-398a9fb9-fc7d-4edd-aff5-36827bf9ef3f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:32.187764 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-398a9fb9-fc7d-4edd-aff5-36827bf9ef3f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:32.196208 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-398a9fb9-fc7d-4edd-aff5-36827bf9ef3f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.171824 Aug 04 23:32:32.196794 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 863/1687] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:32 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:33.218873 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-249c214b-d1a1-4e67-9d33-95614aa4fd9c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:33.219510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-249c214b-d1a1-4e67-9d33-95614aa4fd9c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:33.226188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-249c214b-d1a1-4e67-9d33-95614aa4fd9c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:33.226707 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-249c214b-d1a1-4e67-9d33-95614aa4fd9c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:33.227146 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-249c214b-d1a1-4e67-9d33-95614aa4fd9c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:33.227886 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-249c214b-d1a1-4e67-9d33-95614aa4fd9c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:33.228392 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-249c214b-d1a1-4e67-9d33-95614aa4fd9c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:33.228819 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-249c214b-d1a1-4e67-9d33-95614aa4fd9c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:33.361164 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-249c214b-d1a1-4e67-9d33-95614aa4fd9c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:33.369301 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-249c214b-d1a1-4e67-9d33-95614aa4fd9c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.154266 Aug 04 23:32:33.369876 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 825/1688] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:33 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:32:34.390486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-bdcb198c-cbfa-4412-bc88-08c9b20c3a0b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:34.391091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-bdcb198c-cbfa-4412-bc88-08c9b20c3a0b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:34.397541 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdcb198c-cbfa-4412-bc88-08c9b20c3a0b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:34.398024 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdcb198c-cbfa-4412-bc88-08c9b20c3a0b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:34.398484 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdcb198c-cbfa-4412-bc88-08c9b20c3a0b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:34.399179 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdcb198c-cbfa-4412-bc88-08c9b20c3a0b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:34.399629 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdcb198c-cbfa-4412-bc88-08c9b20c3a0b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:34.400236 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdcb198c-cbfa-4412-bc88-08c9b20c3a0b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:34.534011 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-bdcb198c-cbfa-4412-bc88-08c9b20c3a0b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:34.542020 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-bdcb198c-cbfa-4412-bc88-08c9b20c3a0b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.155431 Aug 04 23:32:34.542573 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 864/1689] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:34 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:35.563385 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4474ed8a-04fe-4981-9b83-196cbaabb303 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:35.563985 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4474ed8a-04fe-4981-9b83-196cbaabb303 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:35.570772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4474ed8a-04fe-4981-9b83-196cbaabb303 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:35.571254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4474ed8a-04fe-4981-9b83-196cbaabb303 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:35.572316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4474ed8a-04fe-4981-9b83-196cbaabb303 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:35.573134 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4474ed8a-04fe-4981-9b83-196cbaabb303 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:35.573591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4474ed8a-04fe-4981-9b83-196cbaabb303 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:35.574019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4474ed8a-04fe-4981-9b83-196cbaabb303 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:35.704588 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4474ed8a-04fe-4981-9b83-196cbaabb303 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:35.712129 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4474ed8a-04fe-4981-9b83-196cbaabb303 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.152621 Aug 04 23:32:35.712872 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 826/1690] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:35 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:32:36.733193 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-13e8155e-9dfd-4c3f-b393-4b043343d711 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:36.733802 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-13e8155e-9dfd-4c3f-b393-4b043343d711 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:36.746902 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-13e8155e-9dfd-4c3f-b393-4b043343d711 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:36.747378 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-13e8155e-9dfd-4c3f-b393-4b043343d711 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:36.747807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-13e8155e-9dfd-4c3f-b393-4b043343d711 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:36.748514 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-13e8155e-9dfd-4c3f-b393-4b043343d711 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:36.748960 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-13e8155e-9dfd-4c3f-b393-4b043343d711 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:36.749376 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-13e8155e-9dfd-4c3f-b393-4b043343d711 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:36.887628 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-13e8155e-9dfd-4c3f-b393-4b043343d711 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:36.895198 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-13e8155e-9dfd-4c3f-b393-4b043343d711 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.165917 Aug 04 23:32:36.895751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 865/1691] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:36 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:32:37.918156 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3d26c5ff-2567-4c1b-bd50-c2ad20b0a616 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:37.918823 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3d26c5ff-2567-4c1b-bd50-c2ad20b0a616 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:37.925288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d26c5ff-2567-4c1b-bd50-c2ad20b0a616 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:37.925768 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d26c5ff-2567-4c1b-bd50-c2ad20b0a616 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:37.926209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d26c5ff-2567-4c1b-bd50-c2ad20b0a616 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:37.926938 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d26c5ff-2567-4c1b-bd50-c2ad20b0a616 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:37.927392 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d26c5ff-2567-4c1b-bd50-c2ad20b0a616 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:37.927815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d26c5ff-2567-4c1b-bd50-c2ad20b0a616 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:38.062433 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3d26c5ff-2567-4c1b-bd50-c2ad20b0a616 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:38.070177 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3d26c5ff-2567-4c1b-bd50-c2ad20b0a616 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.156673 Aug 04 23:32:38.070771 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 827/1692] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:37 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:39.091853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-999b840c-4a2e-4046-b251-467762202182 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:39.092415 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-999b840c-4a2e-4046-b251-467762202182 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:39.098797 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-999b840c-4a2e-4046-b251-467762202182 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:39.099269 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-999b840c-4a2e-4046-b251-467762202182 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:39.099700 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-999b840c-4a2e-4046-b251-467762202182 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:39.100419 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-999b840c-4a2e-4046-b251-467762202182 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:39.100866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-999b840c-4a2e-4046-b251-467762202182 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:39.101284 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-999b840c-4a2e-4046-b251-467762202182 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:39.233834 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-999b840c-4a2e-4046-b251-467762202182 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:39.241358 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-999b840c-4a2e-4046-b251-467762202182 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.154339 Aug 04 23:32:39.241925 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 866/1693] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:39 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:40.262463 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-58c5883e-9265-4956-b24f-65be48072155 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:40.263064 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-58c5883e-9265-4956-b24f-65be48072155 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:40.269395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-58c5883e-9265-4956-b24f-65be48072155 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:40.269864 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-58c5883e-9265-4956-b24f-65be48072155 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:40.270288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-58c5883e-9265-4956-b24f-65be48072155 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:40.270991 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-58c5883e-9265-4956-b24f-65be48072155 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:40.271432 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-58c5883e-9265-4956-b24f-65be48072155 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:40.271843 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-58c5883e-9265-4956-b24f-65be48072155 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:40.427068 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-58c5883e-9265-4956-b24f-65be48072155 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:40.434721 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-58c5883e-9265-4956-b24f-65be48072155 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.176293 Aug 04 23:32:40.435282 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 828/1694] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:40 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:41.456458 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-172cf14b-41e4-4a75-b17b-03f71fa1a066 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:41.457113 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-172cf14b-41e4-4a75-b17b-03f71fa1a066 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:41.464548 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-172cf14b-41e4-4a75-b17b-03f71fa1a066 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:41.465019 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-172cf14b-41e4-4a75-b17b-03f71fa1a066 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:41.465453 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-172cf14b-41e4-4a75-b17b-03f71fa1a066 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:41.466187 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-172cf14b-41e4-4a75-b17b-03f71fa1a066 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:41.466668 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-172cf14b-41e4-4a75-b17b-03f71fa1a066 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:41.467093 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-172cf14b-41e4-4a75-b17b-03f71fa1a066 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:41.603170 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-172cf14b-41e4-4a75-b17b-03f71fa1a066 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:41.611564 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-172cf14b-41e4-4a75-b17b-03f71fa1a066 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.159011 Aug 04 23:32:41.612122 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 867/1695] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:41 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:42.633168 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4e04cad7-4eae-4f45-885e-dc35b65b1766 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:42.633764 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4e04cad7-4eae-4f45-885e-dc35b65b1766 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:42.640499 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e04cad7-4eae-4f45-885e-dc35b65b1766 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:42.641000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e04cad7-4eae-4f45-885e-dc35b65b1766 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:42.641421 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e04cad7-4eae-4f45-885e-dc35b65b1766 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:42.642129 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e04cad7-4eae-4f45-885e-dc35b65b1766 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:42.642612 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e04cad7-4eae-4f45-885e-dc35b65b1766 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:42.643233 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e04cad7-4eae-4f45-885e-dc35b65b1766 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:42.783182 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4e04cad7-4eae-4f45-885e-dc35b65b1766 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:42.785406 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:32:42.792851 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4e04cad7-4eae-4f45-885e-dc35b65b1766 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.163647 Aug 04 23:32:42.793417 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 829/1696] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:42 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:43.813174 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-44158221-ee0f-430b-979c-d0f2384c6db3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:43.813771 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-44158221-ee0f-430b-979c-d0f2384c6db3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:43.820534 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44158221-ee0f-430b-979c-d0f2384c6db3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:43.821013 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44158221-ee0f-430b-979c-d0f2384c6db3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:43.821520 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44158221-ee0f-430b-979c-d0f2384c6db3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:43.822211 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44158221-ee0f-430b-979c-d0f2384c6db3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:43.822687 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44158221-ee0f-430b-979c-d0f2384c6db3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:43.823110 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44158221-ee0f-430b-979c-d0f2384c6db3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:43.954042 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-44158221-ee0f-430b-979c-d0f2384c6db3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:43.961515 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-44158221-ee0f-430b-979c-d0f2384c6db3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.152313 Aug 04 23:32:43.962596 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 868/1697] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:43 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:44.984491 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e34c154d-7017-4e68-9602-018815b06d71 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:44.985087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e34c154d-7017-4e68-9602-018815b06d71 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:44.991624 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e34c154d-7017-4e68-9602-018815b06d71 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:44.992106 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e34c154d-7017-4e68-9602-018815b06d71 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:44.992543 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e34c154d-7017-4e68-9602-018815b06d71 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:44.993893 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e34c154d-7017-4e68-9602-018815b06d71 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:44.994382 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e34c154d-7017-4e68-9602-018815b06d71 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:44.994800 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e34c154d-7017-4e68-9602-018815b06d71 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:45.125356 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e34c154d-7017-4e68-9602-018815b06d71 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:45.133117 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e34c154d-7017-4e68-9602-018815b06d71 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.152962 Aug 04 23:32:45.133705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 830/1698] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:44 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:46.155244 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-17a17b36-e41d-4547-a30d-b39a0c383935 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:46.156070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-17a17b36-e41d-4547-a30d-b39a0c383935 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:46.162723 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-17a17b36-e41d-4547-a30d-b39a0c383935 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:46.163458 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-17a17b36-e41d-4547-a30d-b39a0c383935 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:46.163924 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-17a17b36-e41d-4547-a30d-b39a0c383935 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:46.164630 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-17a17b36-e41d-4547-a30d-b39a0c383935 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:46.165821 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-17a17b36-e41d-4547-a30d-b39a0c383935 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:46.166649 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-17a17b36-e41d-4547-a30d-b39a0c383935 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:46.316124 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-17a17b36-e41d-4547-a30d-b39a0c383935 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:46.323942 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-17a17b36-e41d-4547-a30d-b39a0c383935 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.172891 Aug 04 23:32:46.324731 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 869/1699] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:46 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:47.345777 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-49a5ceb0-da67-4fa6-b21e-2e435277eb22 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:47.346414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-49a5ceb0-da67-4fa6-b21e-2e435277eb22 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:47.353328 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49a5ceb0-da67-4fa6-b21e-2e435277eb22 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:47.353917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49a5ceb0-da67-4fa6-b21e-2e435277eb22 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:47.354352 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49a5ceb0-da67-4fa6-b21e-2e435277eb22 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:47.355069 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49a5ceb0-da67-4fa6-b21e-2e435277eb22 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:47.355539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49a5ceb0-da67-4fa6-b21e-2e435277eb22 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:47.355945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49a5ceb0-da67-4fa6-b21e-2e435277eb22 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:47.595632 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-49a5ceb0-da67-4fa6-b21e-2e435277eb22 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:47.603190 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-49a5ceb0-da67-4fa6-b21e-2e435277eb22 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.261208 Aug 04 23:32:47.603759 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 831/1700] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:47 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:48.624333 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5d031d82-f498-4f25-93ac-c9d7186d6d97 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:48.624976 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5d031d82-f498-4f25-93ac-c9d7186d6d97 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:48.631714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5d031d82-f498-4f25-93ac-c9d7186d6d97 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:48.632002 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5d031d82-f498-4f25-93ac-c9d7186d6d97 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:48.632307 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5d031d82-f498-4f25-93ac-c9d7186d6d97 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:48.633004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5d031d82-f498-4f25-93ac-c9d7186d6d97 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:48.633662 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5d031d82-f498-4f25-93ac-c9d7186d6d97 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:48.634033 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5d031d82-f498-4f25-93ac-c9d7186d6d97 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:48.820738 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5d031d82-f498-4f25-93ac-c9d7186d6d97 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:48.828359 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5d031d82-f498-4f25-93ac-c9d7186d6d97 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.207878 Aug 04 23:32:48.828916 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 870/1701] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:48 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:49.849190 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d7437f23-e815-4875-ae48-741c1c7210bf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:49.849737 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d7437f23-e815-4875-ae48-741c1c7210bf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:49.856177 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d7437f23-e815-4875-ae48-741c1c7210bf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:49.856649 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d7437f23-e815-4875-ae48-741c1c7210bf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:49.857078 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d7437f23-e815-4875-ae48-741c1c7210bf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:49.857780 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d7437f23-e815-4875-ae48-741c1c7210bf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:49.858205 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d7437f23-e815-4875-ae48-741c1c7210bf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:49.858654 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d7437f23-e815-4875-ae48-741c1c7210bf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:50.000541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d7437f23-e815-4875-ae48-741c1c7210bf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:50.009216 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d7437f23-e815-4875-ae48-741c1c7210bf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.163848 Aug 04 23:32:50.010889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 832/1702] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:49 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:50.505085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:32:50.505342 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:32:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:32:51.031308 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ea6ecb11-24cb-4e56-83ec-2653a26effc3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:51.031929 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ea6ecb11-24cb-4e56-83ec-2653a26effc3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:51.038335 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea6ecb11-24cb-4e56-83ec-2653a26effc3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:51.038849 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea6ecb11-24cb-4e56-83ec-2653a26effc3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:51.039281 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea6ecb11-24cb-4e56-83ec-2653a26effc3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:51.039975 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea6ecb11-24cb-4e56-83ec-2653a26effc3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:51.040431 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea6ecb11-24cb-4e56-83ec-2653a26effc3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:51.041441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea6ecb11-24cb-4e56-83ec-2653a26effc3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:51.177381 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ea6ecb11-24cb-4e56-83ec-2653a26effc3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:51.186021 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ea6ecb11-24cb-4e56-83ec-2653a26effc3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.158569 Aug 04 23:32:51.186616 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 871/1703] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:51 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:52.207285 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a18b1fc6-fd52-4ffd-a05c-967508adaea4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:52.207919 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a18b1fc6-fd52-4ffd-a05c-967508adaea4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:52.215190 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a18b1fc6-fd52-4ffd-a05c-967508adaea4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:52.215660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a18b1fc6-fd52-4ffd-a05c-967508adaea4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:52.216086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a18b1fc6-fd52-4ffd-a05c-967508adaea4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:52.216764 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a18b1fc6-fd52-4ffd-a05c-967508adaea4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:52.217207 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a18b1fc6-fd52-4ffd-a05c-967508adaea4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:52.217620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a18b1fc6-fd52-4ffd-a05c-967508adaea4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:52.353645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a18b1fc6-fd52-4ffd-a05c-967508adaea4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:52.361217 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a18b1fc6-fd52-4ffd-a05c-967508adaea4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.158020 Aug 04 23:32:52.361781 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 833/1704] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:52 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:53.383623 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5c7623b1-8445-498d-b3f1-a4cef86fceb6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:53.384225 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5c7623b1-8445-498d-b3f1-a4cef86fceb6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:53.391204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c7623b1-8445-498d-b3f1-a4cef86fceb6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:53.391689 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c7623b1-8445-498d-b3f1-a4cef86fceb6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:53.392124 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c7623b1-8445-498d-b3f1-a4cef86fceb6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:53.392815 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c7623b1-8445-498d-b3f1-a4cef86fceb6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:53.393264 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c7623b1-8445-498d-b3f1-a4cef86fceb6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:53.393685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c7623b1-8445-498d-b3f1-a4cef86fceb6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:53.524357 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5c7623b1-8445-498d-b3f1-a4cef86fceb6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:53.533043 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5c7623b1-8445-498d-b3f1-a4cef86fceb6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.153283 Aug 04 23:32:53.533601 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 872/1705] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:53 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:54.553375 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c27ea4f1-f0ec-4ef4-87a8-d12637d8d87d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:54.554011 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c27ea4f1-f0ec-4ef4-87a8-d12637d8d87d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:54.560311 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c27ea4f1-f0ec-4ef4-87a8-d12637d8d87d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:54.560797 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c27ea4f1-f0ec-4ef4-87a8-d12637d8d87d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:54.561231 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c27ea4f1-f0ec-4ef4-87a8-d12637d8d87d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:54.561924 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c27ea4f1-f0ec-4ef4-87a8-d12637d8d87d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:54.562400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c27ea4f1-f0ec-4ef4-87a8-d12637d8d87d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:54.562827 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c27ea4f1-f0ec-4ef4-87a8-d12637d8d87d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:54.697250 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c27ea4f1-f0ec-4ef4-87a8-d12637d8d87d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:54.705321 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c27ea4f1-f0ec-4ef4-87a8-d12637d8d87d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.156065 Aug 04 23:32:54.705877 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 834/1706] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:54 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:55.726747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-39374771-7691-4a5d-a7f9-9216c982ebc8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:55.727354 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-39374771-7691-4a5d-a7f9-9216c982ebc8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:55.734689 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39374771-7691-4a5d-a7f9-9216c982ebc8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:55.735184 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39374771-7691-4a5d-a7f9-9216c982ebc8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:55.735647 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39374771-7691-4a5d-a7f9-9216c982ebc8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:55.736376 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39374771-7691-4a5d-a7f9-9216c982ebc8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:55.736854 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39374771-7691-4a5d-a7f9-9216c982ebc8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:55.737304 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39374771-7691-4a5d-a7f9-9216c982ebc8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:55.876684 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-39374771-7691-4a5d-a7f9-9216c982ebc8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:55.884473 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-39374771-7691-4a5d-a7f9-9216c982ebc8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.161618 Aug 04 23:32:55.885088 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 873/1707] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:55 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:56.907214 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-49d16ec5-221e-4a75-a6ef-b2b1b3eb939a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:56.907768 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-49d16ec5-221e-4a75-a6ef-b2b1b3eb939a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:56.914329 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49d16ec5-221e-4a75-a6ef-b2b1b3eb939a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:56.914844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49d16ec5-221e-4a75-a6ef-b2b1b3eb939a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:56.915282 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49d16ec5-221e-4a75-a6ef-b2b1b3eb939a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:56.915977 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49d16ec5-221e-4a75-a6ef-b2b1b3eb939a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:56.916431 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49d16ec5-221e-4a75-a6ef-b2b1b3eb939a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:56.916858 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49d16ec5-221e-4a75-a6ef-b2b1b3eb939a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:57.049867 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-49d16ec5-221e-4a75-a6ef-b2b1b3eb939a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:57.057369 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-49d16ec5-221e-4a75-a6ef-b2b1b3eb939a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.154095 Aug 04 23:32:57.058021 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 835/1708] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:56 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:58.078376 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b0677aa4-6e3b-4b6b-8b6d-2a6f1b0bfb43 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:58.078993 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b0677aa4-6e3b-4b6b-8b6d-2a6f1b0bfb43 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:58.085567 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b0677aa4-6e3b-4b6b-8b6d-2a6f1b0bfb43 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:58.085974 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b0677aa4-6e3b-4b6b-8b6d-2a6f1b0bfb43 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:58.086433 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b0677aa4-6e3b-4b6b-8b6d-2a6f1b0bfb43 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:58.087128 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b0677aa4-6e3b-4b6b-8b6d-2a6f1b0bfb43 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:58.087576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b0677aa4-6e3b-4b6b-8b6d-2a6f1b0bfb43 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:58.088001 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b0677aa4-6e3b-4b6b-8b6d-2a6f1b0bfb43 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:58.091190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=78 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:32:58.224092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b0677aa4-6e3b-4b6b-8b6d-2a6f1b0bfb43 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:58.232373 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b0677aa4-6e3b-4b6b-8b6d-2a6f1b0bfb43 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.157855 Aug 04 23:32:58.232940 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 874/1709] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:58 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:32:59.253760 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d660d545-0e7f-48a3-a2f0-c87e50fe8781 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:32:59.254385 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d660d545-0e7f-48a3-a2f0-c87e50fe8781 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:32:59.260702 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d660d545-0e7f-48a3-a2f0-c87e50fe8781 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:59.261172 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d660d545-0e7f-48a3-a2f0-c87e50fe8781 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:59.261603 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d660d545-0e7f-48a3-a2f0-c87e50fe8781 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:59.262348 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d660d545-0e7f-48a3-a2f0-c87e50fe8781 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:32:59.263020 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d660d545-0e7f-48a3-a2f0-c87e50fe8781 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:32:59.263443 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d660d545-0e7f-48a3-a2f0-c87e50fe8781 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:32:59.394549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d660d545-0e7f-48a3-a2f0-c87e50fe8781 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:32:59.402101 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d660d545-0e7f-48a3-a2f0-c87e50fe8781 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.152200 Aug 04 23:32:59.402739 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 836/1710] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:32:59 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:33:00.422917 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f5188324-30cf-431e-860e-0a67987ce963 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:00.423572 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f5188324-30cf-431e-860e-0a67987ce963 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:00.430051 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f5188324-30cf-431e-860e-0a67987ce963 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:00.430582 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f5188324-30cf-431e-860e-0a67987ce963 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:00.431025 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f5188324-30cf-431e-860e-0a67987ce963 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:00.431724 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f5188324-30cf-431e-860e-0a67987ce963 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:00.432178 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f5188324-30cf-431e-860e-0a67987ce963 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:00.432605 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f5188324-30cf-431e-860e-0a67987ce963 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:00.568040 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f5188324-30cf-431e-860e-0a67987ce963 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:00.577012 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f5188324-30cf-431e-860e-0a67987ce963 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.158007 Aug 04 23:33:00.577578 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 875/1711] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:00 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:33:01.597830 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-54d394b2-cf20-48ad-99fd-10de583cea34 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:01.598462 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-54d394b2-cf20-48ad-99fd-10de583cea34 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:01.600759 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=26 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:33:01.606055 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54d394b2-cf20-48ad-99fd-10de583cea34 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:01.606681 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54d394b2-cf20-48ad-99fd-10de583cea34 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:01.607135 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54d394b2-cf20-48ad-99fd-10de583cea34 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:01.607848 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54d394b2-cf20-48ad-99fd-10de583cea34 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:01.608309 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54d394b2-cf20-48ad-99fd-10de583cea34 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:01.608736 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-54d394b2-cf20-48ad-99fd-10de583cea34 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:01.741067 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-54d394b2-cf20-48ad-99fd-10de583cea34 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:01.749773 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-54d394b2-cf20-48ad-99fd-10de583cea34 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.155795 Aug 04 23:33:01.750329 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 837/1712] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:01 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:33:02.771237 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e9f84d5a-e2db-4ce5-9777-afe96b10bbc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:02.772030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e9f84d5a-e2db-4ce5-9777-afe96b10bbc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:02.774232 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=26 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:33:02.781145 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e9f84d5a-e2db-4ce5-9777-afe96b10bbc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:02.781626 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e9f84d5a-e2db-4ce5-9777-afe96b10bbc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:02.782057 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e9f84d5a-e2db-4ce5-9777-afe96b10bbc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:02.782797 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e9f84d5a-e2db-4ce5-9777-afe96b10bbc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:02.783239 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e9f84d5a-e2db-4ce5-9777-afe96b10bbc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:02.783656 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e9f84d5a-e2db-4ce5-9777-afe96b10bbc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:02.920086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e9f84d5a-e2db-4ce5-9777-afe96b10bbc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:02.927700 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e9f84d5a-e2db-4ce5-9777-afe96b10bbc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.160306 Aug 04 23:33:02.928274 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 876/1713] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:02 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:33:03.595908 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:33:03.596584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:33:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:33:03.949318 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b49f0c58-f4ca-408d-ae7d-11f16e0cf266 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:03.950650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b49f0c58-f4ca-408d-ae7d-11f16e0cf266 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:03.957570 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b49f0c58-f4ca-408d-ae7d-11f16e0cf266 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:03.958054 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b49f0c58-f4ca-408d-ae7d-11f16e0cf266 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:03.958515 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b49f0c58-f4ca-408d-ae7d-11f16e0cf266 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:03.959220 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b49f0c58-f4ca-408d-ae7d-11f16e0cf266 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:03.959672 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b49f0c58-f4ca-408d-ae7d-11f16e0cf266 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:03.960119 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b49f0c58-f4ca-408d-ae7d-11f16e0cf266 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:04.120283 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b49f0c58-f4ca-408d-ae7d-11f16e0cf266 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:04.128026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b49f0c58-f4ca-408d-ae7d-11f16e0cf266 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.182717 Aug 04 23:33:04.128596 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 838/1714] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:03 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:33:05.149557 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-399320e1-2759-4738-88e6-e653cf6d3960 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:05.150173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-399320e1-2759-4738-88e6-e653cf6d3960 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:05.157217 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-399320e1-2759-4738-88e6-e653cf6d3960 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:05.157743 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-399320e1-2759-4738-88e6-e653cf6d3960 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:05.158169 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-399320e1-2759-4738-88e6-e653cf6d3960 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:05.158901 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-399320e1-2759-4738-88e6-e653cf6d3960 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:05.159347 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-399320e1-2759-4738-88e6-e653cf6d3960 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:05.159763 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-399320e1-2759-4738-88e6-e653cf6d3960 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:05.300871 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-399320e1-2759-4738-88e6-e653cf6d3960 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:05.308350 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-399320e1-2759-4738-88e6-e653cf6d3960 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.162782 Aug 04 23:33:05.308902 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 877/1715] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:05 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:06.331039 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f8302a95-a51b-47e9-8aca-74ea76975b0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:06.331652 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f8302a95-a51b-47e9-8aca-74ea76975b0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:06.338137 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f8302a95-a51b-47e9-8aca-74ea76975b0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:06.338647 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f8302a95-a51b-47e9-8aca-74ea76975b0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:06.339083 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f8302a95-a51b-47e9-8aca-74ea76975b0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:06.339771 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f8302a95-a51b-47e9-8aca-74ea76975b0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:06.340220 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f8302a95-a51b-47e9-8aca-74ea76975b0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:06.340762 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f8302a95-a51b-47e9-8aca-74ea76975b0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:06.471784 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f8302a95-a51b-47e9-8aca-74ea76975b0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:06.479368 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f8302a95-a51b-47e9-8aca-74ea76975b0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.152214 Aug 04 23:33:06.479924 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 839/1716] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:06 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:33:07.502311 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-71080b89-1d6a-408b-8a06-3517c0ff65ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:07.502980 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-71080b89-1d6a-408b-8a06-3517c0ff65ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:07.509626 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-71080b89-1d6a-408b-8a06-3517c0ff65ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:07.510105 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-71080b89-1d6a-408b-8a06-3517c0ff65ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:07.510588 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-71080b89-1d6a-408b-8a06-3517c0ff65ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:07.511291 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-71080b89-1d6a-408b-8a06-3517c0ff65ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:07.511741 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-71080b89-1d6a-408b-8a06-3517c0ff65ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:07.512209 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-71080b89-1d6a-408b-8a06-3517c0ff65ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:07.648756 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-71080b89-1d6a-408b-8a06-3517c0ff65ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:07.656640 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-71080b89-1d6a-408b-8a06-3517c0ff65ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.158931 Aug 04 23:33:07.657220 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 878/1717] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:07 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:33:08.678389 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-92a2cad4-a904-4479-a298-a15921d7736e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:08.679010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-92a2cad4-a904-4479-a298-a15921d7736e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:08.685859 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92a2cad4-a904-4479-a298-a15921d7736e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:08.686339 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92a2cad4-a904-4479-a298-a15921d7736e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:08.686805 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92a2cad4-a904-4479-a298-a15921d7736e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:08.687502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92a2cad4-a904-4479-a298-a15921d7736e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:08.687954 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92a2cad4-a904-4479-a298-a15921d7736e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:08.688378 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92a2cad4-a904-4479-a298-a15921d7736e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:08.825744 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-92a2cad4-a904-4479-a298-a15921d7736e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:08.833193 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-92a2cad4-a904-4479-a298-a15921d7736e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.158642 Aug 04 23:33:08.833755 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 840/1718] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:08 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:33:09.854913 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-07b75a43-ac16-4560-ac8f-37f9af80d2cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:09.855519 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-07b75a43-ac16-4560-ac8f-37f9af80d2cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:09.862036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-07b75a43-ac16-4560-ac8f-37f9af80d2cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:09.862483 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-07b75a43-ac16-4560-ac8f-37f9af80d2cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:09.862919 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-07b75a43-ac16-4560-ac8f-37f9af80d2cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:09.863610 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-07b75a43-ac16-4560-ac8f-37f9af80d2cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:09.864059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-07b75a43-ac16-4560-ac8f-37f9af80d2cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:09.864480 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-07b75a43-ac16-4560-ac8f-37f9af80d2cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:10.002660 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-07b75a43-ac16-4560-ac8f-37f9af80d2cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:10.010211 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-07b75a43-ac16-4560-ac8f-37f9af80d2cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.159247 Aug 04 23:33:10.010791 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 879/1719] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:09 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:33:11.032840 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9b93c642-d7da-491e-8d9a-c00932df9f27 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:11.033449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9b93c642-d7da-491e-8d9a-c00932df9f27 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:11.039849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9b93c642-d7da-491e-8d9a-c00932df9f27 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:11.040327 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9b93c642-d7da-491e-8d9a-c00932df9f27 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:11.040795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9b93c642-d7da-491e-8d9a-c00932df9f27 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:11.041476 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9b93c642-d7da-491e-8d9a-c00932df9f27 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:11.041925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9b93c642-d7da-491e-8d9a-c00932df9f27 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:11.042348 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9b93c642-d7da-491e-8d9a-c00932df9f27 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:11.183183 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9b93c642-d7da-491e-8d9a-c00932df9f27 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:11.191100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9b93c642-d7da-491e-8d9a-c00932df9f27 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.162400 Aug 04 23:33:11.191665 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 841/1720] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:11 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:33:12.212708 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7e116170-3b09-4829-a19c-78418ccdda05 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:12.213314 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7e116170-3b09-4829-a19c-78418ccdda05 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:12.220874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e116170-3b09-4829-a19c-78418ccdda05 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:12.221517 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e116170-3b09-4829-a19c-78418ccdda05 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:12.221982 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e116170-3b09-4829-a19c-78418ccdda05 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:12.222707 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e116170-3b09-4829-a19c-78418ccdda05 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:12.223157 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e116170-3b09-4829-a19c-78418ccdda05 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:12.223577 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e116170-3b09-4829-a19c-78418ccdda05 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:12.361828 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7e116170-3b09-4829-a19c-78418ccdda05 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:12.369589 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7e116170-3b09-4829-a19c-78418ccdda05 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.160791 Aug 04 23:33:12.370157 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 880/1721] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:12 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:33:13.391186 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-59a152b8-6756-4048-9ded-4456d653873f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:13.391850 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-59a152b8-6756-4048-9ded-4456d653873f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:13.398278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59a152b8-6756-4048-9ded-4456d653873f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:13.398782 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59a152b8-6756-4048-9ded-4456d653873f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:13.399212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59a152b8-6756-4048-9ded-4456d653873f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:13.399918 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59a152b8-6756-4048-9ded-4456d653873f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:13.400364 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59a152b8-6756-4048-9ded-4456d653873f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:13.400777 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59a152b8-6756-4048-9ded-4456d653873f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:13.540178 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-59a152b8-6756-4048-9ded-4456d653873f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:13.549328 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-59a152b8-6756-4048-9ded-4456d653873f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.161909 Aug 04 23:33:13.549884 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 842/1722] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:13 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:14.570817 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-31bb552e-9724-4403-aa46-43939b201590 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:14.571424 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-31bb552e-9724-4403-aa46-43939b201590 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:14.578165 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-31bb552e-9724-4403-aa46-43939b201590 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:14.578676 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-31bb552e-9724-4403-aa46-43939b201590 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:14.579116 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-31bb552e-9724-4403-aa46-43939b201590 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:14.579810 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-31bb552e-9724-4403-aa46-43939b201590 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:14.580268 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-31bb552e-9724-4403-aa46-43939b201590 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:14.580692 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-31bb552e-9724-4403-aa46-43939b201590 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:14.727752 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-31bb552e-9724-4403-aa46-43939b201590 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:14.735736 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-31bb552e-9724-4403-aa46-43939b201590 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.169172 Aug 04 23:33:14.736290 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 881/1723] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:14 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:33:15.757305 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-30032503-332a-4b4f-a1a6-abf247af2934 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:15.757987 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-30032503-332a-4b4f-a1a6-abf247af2934 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:15.765336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-30032503-332a-4b4f-a1a6-abf247af2934 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:15.765820 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-30032503-332a-4b4f-a1a6-abf247af2934 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:15.766296 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-30032503-332a-4b4f-a1a6-abf247af2934 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:15.767092 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-30032503-332a-4b4f-a1a6-abf247af2934 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:15.767549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-30032503-332a-4b4f-a1a6-abf247af2934 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:15.767975 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-30032503-332a-4b4f-a1a6-abf247af2934 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:15.770627 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=80 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:33:15.901108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-30032503-332a-4b4f-a1a6-abf247af2934 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:15.909428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-30032503-332a-4b4f-a1a6-abf247af2934 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.156052 Aug 04 23:33:15.909990 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 843/1724] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:15 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:33:16.468257 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-320d39b8-37f1-4b05-bd1e-2cf5a9c797b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:16.468948 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-320d39b8-37f1-4b05-bd1e-2cf5a9c797b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:16.475575 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-320d39b8-37f1-4b05-bd1e-2cf5a9c797b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:16.476061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-320d39b8-37f1-4b05-bd1e-2cf5a9c797b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:16.476493 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-320d39b8-37f1-4b05-bd1e-2cf5a9c797b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:16.477197 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-320d39b8-37f1-4b05-bd1e-2cf5a9c797b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:16.477649 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-320d39b8-37f1-4b05-bd1e-2cf5a9c797b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:16.478070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-320d39b8-37f1-4b05-bd1e-2cf5a9c797b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:16.930629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-12b26b47-276e-4ef5-8ab0-fe246988ac83 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:16.931224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-12b26b47-276e-4ef5-8ab0-fe246988ac83 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:16.938101 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-12b26b47-276e-4ef5-8ab0-fe246988ac83 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:16.938611 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-12b26b47-276e-4ef5-8ab0-fe246988ac83 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:16.939043 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-12b26b47-276e-4ef5-8ab0-fe246988ac83 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:16.939724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-12b26b47-276e-4ef5-8ab0-fe246988ac83 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:16.940170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-12b26b47-276e-4ef5-8ab0-fe246988ac83 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:16.940590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-12b26b47-276e-4ef5-8ab0-fe246988ac83 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:17.076234 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-12b26b47-276e-4ef5-8ab0-fe246988ac83 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:17.084026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-12b26b47-276e-4ef5-8ab0-fe246988ac83 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.157311 Aug 04 23:33:17.084509 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 844/1725] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:16 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:18.104346 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-eea543d7-2b88-4724-bd31-f5598c705cf3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:18.104996 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-eea543d7-2b88-4724-bd31-f5598c705cf3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:18.111426 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eea543d7-2b88-4724-bd31-f5598c705cf3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:18.111917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eea543d7-2b88-4724-bd31-f5598c705cf3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:18.112353 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eea543d7-2b88-4724-bd31-f5598c705cf3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:18.113046 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eea543d7-2b88-4724-bd31-f5598c705cf3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:18.113500 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eea543d7-2b88-4724-bd31-f5598c705cf3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:18.113921 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eea543d7-2b88-4724-bd31-f5598c705cf3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:18.247990 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-eea543d7-2b88-4724-bd31-f5598c705cf3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:18.256243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-eea543d7-2b88-4724-bd31-f5598c705cf3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.155819 Aug 04 23:33:18.256806 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 845/1726] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:18 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:19.278208 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-765d5eda-850b-4046-8a16-c288139247cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:19.278938 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-765d5eda-850b-4046-8a16-c288139247cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:19.285446 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-765d5eda-850b-4046-8a16-c288139247cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:19.285926 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-765d5eda-850b-4046-8a16-c288139247cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:19.286451 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-765d5eda-850b-4046-8a16-c288139247cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:19.287104 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-765d5eda-850b-4046-8a16-c288139247cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:19.287554 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-765d5eda-850b-4046-8a16-c288139247cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:19.287975 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-765d5eda-850b-4046-8a16-c288139247cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:19.423921 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-765d5eda-850b-4046-8a16-c288139247cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:19.431456 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-765d5eda-850b-4046-8a16-c288139247cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.157112 Aug 04 23:33:19.432020 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 846/1727] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:19 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:20.453227 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a4c91d9e-b622-4069-9dcd-e1202ade5781 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:20.453933 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a4c91d9e-b622-4069-9dcd-e1202ade5781 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:20.460441 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a4c91d9e-b622-4069-9dcd-e1202ade5781 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:20.460923 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a4c91d9e-b622-4069-9dcd-e1202ade5781 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:20.461358 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a4c91d9e-b622-4069-9dcd-e1202ade5781 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:20.462054 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a4c91d9e-b622-4069-9dcd-e1202ade5781 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:20.462554 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a4c91d9e-b622-4069-9dcd-e1202ade5781 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:20.462991 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a4c91d9e-b622-4069-9dcd-e1202ade5781 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:20.597231 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a4c91d9e-b622-4069-9dcd-e1202ade5781 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:20.604849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a4c91d9e-b622-4069-9dcd-e1202ade5781 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.156183 Aug 04 23:33:20.605415 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 847/1728] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:20 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:21.060365 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:33:21.060623 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:33:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:33:21.626957 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c6f542db-0404-431e-a099-6ed865791e13 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:21.627572 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c6f542db-0404-431e-a099-6ed865791e13 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:21.634037 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6f542db-0404-431e-a099-6ed865791e13 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:21.634555 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6f542db-0404-431e-a099-6ed865791e13 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:21.634992 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6f542db-0404-431e-a099-6ed865791e13 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:21.635683 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6f542db-0404-431e-a099-6ed865791e13 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:21.636134 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6f542db-0404-431e-a099-6ed865791e13 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:21.636557 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c6f542db-0404-431e-a099-6ed865791e13 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:21.769136 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c6f542db-0404-431e-a099-6ed865791e13 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:21.776593 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c6f542db-0404-431e-a099-6ed865791e13 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.153805 Aug 04 23:33:21.777153 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 848/1729] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:21 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:22.798713 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4602e620-178f-4108-9aed-97fe9a565ef7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:22.799426 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4602e620-178f-4108-9aed-97fe9a565ef7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:22.806548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4602e620-178f-4108-9aed-97fe9a565ef7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:22.807030 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4602e620-178f-4108-9aed-97fe9a565ef7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:22.807458 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4602e620-178f-4108-9aed-97fe9a565ef7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:22.808151 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4602e620-178f-4108-9aed-97fe9a565ef7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:22.808594 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4602e620-178f-4108-9aed-97fe9a565ef7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:22.809017 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4602e620-178f-4108-9aed-97fe9a565ef7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:22.948161 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4602e620-178f-4108-9aed-97fe9a565ef7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:22.957745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4602e620-178f-4108-9aed-97fe9a565ef7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.163821 Aug 04 23:33:22.958309 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 849/1730] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:22 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:23.938689 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:33:23.939282 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:33:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247/os-volume_attachments/5f345256-fed5-4b16-a195-56888e81102b (ip 10.222.0.33) !!! Aug 04 23:33:23.979000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-fb187da7-4eaf-4534-b8da-def6059865a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:23.979617 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-fb187da7-4eaf-4534-b8da-def6059865a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:23.986136 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fb187da7-4eaf-4534-b8da-def6059865a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:23.986763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fb187da7-4eaf-4534-b8da-def6059865a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:23.987247 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fb187da7-4eaf-4534-b8da-def6059865a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:23.988194 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fb187da7-4eaf-4534-b8da-def6059865a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:23.988673 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fb187da7-4eaf-4534-b8da-def6059865a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:23.989102 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fb187da7-4eaf-4534-b8da-def6059865a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:24.128534 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-fb187da7-4eaf-4534-b8da-def6059865a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:24.136191 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-fb187da7-4eaf-4534-b8da-def6059865a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.161050 Aug 04 23:33:24.136823 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 850/1731] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:23 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:25.159086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-872bed96-87aa-4f37-b56c-a95f16bca601 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:25.159746 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-872bed96-87aa-4f37-b56c-a95f16bca601 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:25.166034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-872bed96-87aa-4f37-b56c-a95f16bca601 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:25.166564 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-872bed96-87aa-4f37-b56c-a95f16bca601 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:25.167000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-872bed96-87aa-4f37-b56c-a95f16bca601 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:25.167688 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-872bed96-87aa-4f37-b56c-a95f16bca601 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:25.168137 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-872bed96-87aa-4f37-b56c-a95f16bca601 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:25.168560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-872bed96-87aa-4f37-b56c-a95f16bca601 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:25.305320 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-872bed96-87aa-4f37-b56c-a95f16bca601 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:25.313246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-872bed96-87aa-4f37-b56c-a95f16bca601 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.158586 Aug 04 23:33:25.313826 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 851/1732] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:25 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:26.333678 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-388ce748-b4df-49ef-8a69-b9ae46490167 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:26.334383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-388ce748-b4df-49ef-8a69-b9ae46490167 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:26.341106 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-388ce748-b4df-49ef-8a69-b9ae46490167 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:26.341587 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-388ce748-b4df-49ef-8a69-b9ae46490167 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:26.342023 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-388ce748-b4df-49ef-8a69-b9ae46490167 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:26.342945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-388ce748-b4df-49ef-8a69-b9ae46490167 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:26.343395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-388ce748-b4df-49ef-8a69-b9ae46490167 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:26.343813 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-388ce748-b4df-49ef-8a69-b9ae46490167 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:26.473580 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=13 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:33:26.485172 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-388ce748-b4df-49ef-8a69-b9ae46490167 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:26.492726 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-388ce748-b4df-49ef-8a69-b9ae46490167 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.163049 Aug 04 23:33:26.493683 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 852/1733] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:26 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:26.502869 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=51 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:33:27.516296 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-af8d40ec-a3d8-46eb-95fe-7e37f837becd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:27.516900 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-af8d40ec-a3d8-46eb-95fe-7e37f837becd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:27.523693 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-af8d40ec-a3d8-46eb-95fe-7e37f837becd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:27.524233 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-af8d40ec-a3d8-46eb-95fe-7e37f837becd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:27.524656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-af8d40ec-a3d8-46eb-95fe-7e37f837becd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:27.525434 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-af8d40ec-a3d8-46eb-95fe-7e37f837becd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:27.525885 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-af8d40ec-a3d8-46eb-95fe-7e37f837becd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:27.526344 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-af8d40ec-a3d8-46eb-95fe-7e37f837becd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:27.664121 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-af8d40ec-a3d8-46eb-95fe-7e37f837becd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:27.673131 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-af8d40ec-a3d8-46eb-95fe-7e37f837becd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.161983 Aug 04 23:33:27.673780 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 853/1734] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:27 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:28.695761 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c9f95768-3aa6-49c5-80fa-18bb4a9bb1dd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:28.696464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c9f95768-3aa6-49c5-80fa-18bb4a9bb1dd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:28.703520 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c9f95768-3aa6-49c5-80fa-18bb4a9bb1dd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:28.703998 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c9f95768-3aa6-49c5-80fa-18bb4a9bb1dd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:28.704647 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c9f95768-3aa6-49c5-80fa-18bb4a9bb1dd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:28.705249 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c9f95768-3aa6-49c5-80fa-18bb4a9bb1dd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:28.705701 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c9f95768-3aa6-49c5-80fa-18bb4a9bb1dd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:28.706115 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c9f95768-3aa6-49c5-80fa-18bb4a9bb1dd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:28.843952 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c9f95768-3aa6-49c5-80fa-18bb4a9bb1dd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:28.852948 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c9f95768-3aa6-49c5-80fa-18bb4a9bb1dd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.160962 Aug 04 23:33:28.853977 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 854/1735] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:28 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:29.875144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a61352de-0307-44d9-86ef-b8a1fc7c50b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:29.875831 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a61352de-0307-44d9-86ef-b8a1fc7c50b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:29.882382 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a61352de-0307-44d9-86ef-b8a1fc7c50b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:29.882878 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a61352de-0307-44d9-86ef-b8a1fc7c50b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:29.883317 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a61352de-0307-44d9-86ef-b8a1fc7c50b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:29.884022 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a61352de-0307-44d9-86ef-b8a1fc7c50b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:29.884481 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a61352de-0307-44d9-86ef-b8a1fc7c50b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:29.884906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a61352de-0307-44d9-86ef-b8a1fc7c50b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:30.033523 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a61352de-0307-44d9-86ef-b8a1fc7c50b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:30.041196 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a61352de-0307-44d9-86ef-b8a1fc7c50b6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.170039 Aug 04 23:33:30.041757 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 855/1736] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:29 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:31.062859 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8bc92269-d318-4d42-b92c-c03d37c129d3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:31.063800 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8bc92269-d318-4d42-b92c-c03d37c129d3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:31.071026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8bc92269-d318-4d42-b92c-c03d37c129d3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:31.071503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8bc92269-d318-4d42-b92c-c03d37c129d3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:31.071938 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8bc92269-d318-4d42-b92c-c03d37c129d3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:31.072634 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8bc92269-d318-4d42-b92c-c03d37c129d3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:31.073080 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8bc92269-d318-4d42-b92c-c03d37c129d3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:31.073504 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8bc92269-d318-4d42-b92c-c03d37c129d3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:31.218032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8bc92269-d318-4d42-b92c-c03d37c129d3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:31.226856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8bc92269-d318-4d42-b92c-c03d37c129d3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.168288 Aug 04 23:33:31.227430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 856/1737] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:31 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:32.249238 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e1dfbcd4-7e90-4ce9-bd14-719ee13db7df tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:32.250494 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e1dfbcd4-7e90-4ce9-bd14-719ee13db7df tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:32.252515 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=40 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:33:32.257648 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e1dfbcd4-7e90-4ce9-bd14-719ee13db7df tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:32.258132 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e1dfbcd4-7e90-4ce9-bd14-719ee13db7df tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:32.258601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e1dfbcd4-7e90-4ce9-bd14-719ee13db7df tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:32.259297 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e1dfbcd4-7e90-4ce9-bd14-719ee13db7df tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:32.259743 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e1dfbcd4-7e90-4ce9-bd14-719ee13db7df tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:32.260161 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e1dfbcd4-7e90-4ce9-bd14-719ee13db7df tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:32.401819 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e1dfbcd4-7e90-4ce9-bd14-719ee13db7df tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:32.409841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e1dfbcd4-7e90-4ce9-bd14-719ee13db7df tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.164908 Aug 04 23:33:32.410452 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 857/1738] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:32 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:33.430317 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-451e57b8-d1f5-4fcc-a797-93ad29ae27bd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:33.431024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-451e57b8-d1f5-4fcc-a797-93ad29ae27bd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:33.438047 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-451e57b8-d1f5-4fcc-a797-93ad29ae27bd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:33.438558 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-451e57b8-d1f5-4fcc-a797-93ad29ae27bd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:33.438994 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-451e57b8-d1f5-4fcc-a797-93ad29ae27bd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:33.439685 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-451e57b8-d1f5-4fcc-a797-93ad29ae27bd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:33.440135 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-451e57b8-d1f5-4fcc-a797-93ad29ae27bd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:33.440559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-451e57b8-d1f5-4fcc-a797-93ad29ae27bd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:33.577814 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-451e57b8-d1f5-4fcc-a797-93ad29ae27bd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:33.585360 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-451e57b8-d1f5-4fcc-a797-93ad29ae27bd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.158887 Aug 04 23:33:33.585930 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 858/1739] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:33 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:34.606614 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d2157de8-c2dc-47fd-b1d8-d5f1e1bcd1e0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:34.607327 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d2157de8-c2dc-47fd-b1d8-d5f1e1bcd1e0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:34.613740 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d2157de8-c2dc-47fd-b1d8-d5f1e1bcd1e0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:34.614214 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d2157de8-c2dc-47fd-b1d8-d5f1e1bcd1e0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:34.614685 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d2157de8-c2dc-47fd-b1d8-d5f1e1bcd1e0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:34.615373 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d2157de8-c2dc-47fd-b1d8-d5f1e1bcd1e0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:34.615822 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d2157de8-c2dc-47fd-b1d8-d5f1e1bcd1e0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:34.616242 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d2157de8-c2dc-47fd-b1d8-d5f1e1bcd1e0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:34.759843 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d2157de8-c2dc-47fd-b1d8-d5f1e1bcd1e0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:34.762073 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:33:34.769353 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d2157de8-c2dc-47fd-b1d8-d5f1e1bcd1e0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.166654 Aug 04 23:33:34.769970 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 859/1740] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:34 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:35.791975 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-64aea36e-eb4b-471e-877d-3a37f0e31447 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:35.792696 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-64aea36e-eb4b-471e-877d-3a37f0e31447 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:35.800400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64aea36e-eb4b-471e-877d-3a37f0e31447 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:35.800877 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64aea36e-eb4b-471e-877d-3a37f0e31447 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:35.801301 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64aea36e-eb4b-471e-877d-3a37f0e31447 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:35.801992 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64aea36e-eb4b-471e-877d-3a37f0e31447 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:35.802456 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64aea36e-eb4b-471e-877d-3a37f0e31447 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:35.802877 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64aea36e-eb4b-471e-877d-3a37f0e31447 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:35.938056 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-64aea36e-eb4b-471e-877d-3a37f0e31447 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:35.946100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-64aea36e-eb4b-471e-877d-3a37f0e31447 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.159774 Aug 04 23:33:35.946696 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 860/1741] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:35 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:33:36.967468 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1bc56023-40e0-4564-a77e-282c8141f6b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:36.968151 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1bc56023-40e0-4564-a77e-282c8141f6b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:36.975140 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1bc56023-40e0-4564-a77e-282c8141f6b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:36.975627 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1bc56023-40e0-4564-a77e-282c8141f6b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:36.976065 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1bc56023-40e0-4564-a77e-282c8141f6b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:36.976760 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1bc56023-40e0-4564-a77e-282c8141f6b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:36.977213 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1bc56023-40e0-4564-a77e-282c8141f6b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:36.977636 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1bc56023-40e0-4564-a77e-282c8141f6b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:37.115129 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1bc56023-40e0-4564-a77e-282c8141f6b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:37.122748 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1bc56023-40e0-4564-a77e-282c8141f6b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.159088 Aug 04 23:33:37.123317 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 861/1742] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:36 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:38.144150 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3587ccaa-af5c-4204-a4ee-6f44dd4337f2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:38.144801 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3587ccaa-af5c-4204-a4ee-6f44dd4337f2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:38.151084 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3587ccaa-af5c-4204-a4ee-6f44dd4337f2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:38.151567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3587ccaa-af5c-4204-a4ee-6f44dd4337f2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:38.151999 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3587ccaa-af5c-4204-a4ee-6f44dd4337f2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:38.152689 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3587ccaa-af5c-4204-a4ee-6f44dd4337f2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:38.153136 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3587ccaa-af5c-4204-a4ee-6f44dd4337f2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:38.153560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3587ccaa-af5c-4204-a4ee-6f44dd4337f2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:38.285533 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3587ccaa-af5c-4204-a4ee-6f44dd4337f2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:38.293057 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3587ccaa-af5c-4204-a4ee-6f44dd4337f2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.153224 Aug 04 23:33:38.293616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 862/1743] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:38 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:39.314531 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5d57c746-5dc4-4ba9-a1c6-20f245b2d445 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:39.315235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5d57c746-5dc4-4ba9-a1c6-20f245b2d445 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:39.321915 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d57c746-5dc4-4ba9-a1c6-20f245b2d445 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:39.322421 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d57c746-5dc4-4ba9-a1c6-20f245b2d445 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:39.322857 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d57c746-5dc4-4ba9-a1c6-20f245b2d445 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:39.323552 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d57c746-5dc4-4ba9-a1c6-20f245b2d445 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:39.324001 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d57c746-5dc4-4ba9-a1c6-20f245b2d445 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:39.324423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d57c746-5dc4-4ba9-a1c6-20f245b2d445 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:39.461101 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5d57c746-5dc4-4ba9-a1c6-20f245b2d445 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:39.469273 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5d57c746-5dc4-4ba9-a1c6-20f245b2d445 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.158481 Aug 04 23:33:39.469831 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 863/1744] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:39 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:40.490841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d255cf87-e4b1-4c3a-86cd-74ee90ba0795 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:40.491521 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d255cf87-e4b1-4c3a-86cd-74ee90ba0795 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:40.497972 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d255cf87-e4b1-4c3a-86cd-74ee90ba0795 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:40.498492 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d255cf87-e4b1-4c3a-86cd-74ee90ba0795 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:40.498931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d255cf87-e4b1-4c3a-86cd-74ee90ba0795 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:40.500373 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d255cf87-e4b1-4c3a-86cd-74ee90ba0795 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:40.500911 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d255cf87-e4b1-4c3a-86cd-74ee90ba0795 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:40.501335 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d255cf87-e4b1-4c3a-86cd-74ee90ba0795 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:40.637409 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d255cf87-e4b1-4c3a-86cd-74ee90ba0795 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:40.645765 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d255cf87-e4b1-4c3a-86cd-74ee90ba0795 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.158830 Aug 04 23:33:40.646334 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 864/1745] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:40 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:41.666943 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a0aea9c1-f0a4-4a91-a098-560881c32433 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:41.667622 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a0aea9c1-f0a4-4a91-a098-560881c32433 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:41.674899 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0aea9c1-f0a4-4a91-a098-560881c32433 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:41.675374 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0aea9c1-f0a4-4a91-a098-560881c32433 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:41.675799 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0aea9c1-f0a4-4a91-a098-560881c32433 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:41.676484 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0aea9c1-f0a4-4a91-a098-560881c32433 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:41.676929 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0aea9c1-f0a4-4a91-a098-560881c32433 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:41.677343 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0aea9c1-f0a4-4a91-a098-560881c32433 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:41.811504 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a0aea9c1-f0a4-4a91-a098-560881c32433 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:41.819896 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a0aea9c1-f0a4-4a91-a098-560881c32433 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.156727 Aug 04 23:33:41.820467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 865/1746] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:41 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:42.841187 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a455db2b-1e61-4689-acf2-02afb0fa2287 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:42.841802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a455db2b-1e61-4689-acf2-02afb0fa2287 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:42.849000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a455db2b-1e61-4689-acf2-02afb0fa2287 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:42.849476 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a455db2b-1e61-4689-acf2-02afb0fa2287 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:42.849910 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a455db2b-1e61-4689-acf2-02afb0fa2287 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:42.850698 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a455db2b-1e61-4689-acf2-02afb0fa2287 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:42.851163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a455db2b-1e61-4689-acf2-02afb0fa2287 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:42.851576 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a455db2b-1e61-4689-acf2-02afb0fa2287 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:42.988184 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a455db2b-1e61-4689-acf2-02afb0fa2287 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:42.999583 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a455db2b-1e61-4689-acf2-02afb0fa2287 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.161930 Aug 04 23:33:43.000649 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 866/1747] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:42 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:44.028101 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ea054d0d-1f27-42d7-8f85-ffa8e15802c1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:44.028857 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ea054d0d-1f27-42d7-8f85-ffa8e15802c1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:44.037130 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ea054d0d-1f27-42d7-8f85-ffa8e15802c1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:44.037712 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ea054d0d-1f27-42d7-8f85-ffa8e15802c1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:44.038244 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ea054d0d-1f27-42d7-8f85-ffa8e15802c1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:44.039090 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ea054d0d-1f27-42d7-8f85-ffa8e15802c1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:44.039614 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ea054d0d-1f27-42d7-8f85-ffa8e15802c1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:44.040107 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ea054d0d-1f27-42d7-8f85-ffa8e15802c1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:44.180505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ea054d0d-1f27-42d7-8f85-ffa8e15802c1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:44.188190 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ea054d0d-1f27-42d7-8f85-ffa8e15802c1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.164677 Aug 04 23:33:44.188919 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 867/1748] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:44 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:33:45.209742 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e728b3bb-8684-4894-ba4a-a0e1ccc47dab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:45.210469 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e728b3bb-8684-4894-ba4a-a0e1ccc47dab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:45.216912 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e728b3bb-8684-4894-ba4a-a0e1ccc47dab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:45.217337 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e728b3bb-8684-4894-ba4a-a0e1ccc47dab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:45.217774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e728b3bb-8684-4894-ba4a-a0e1ccc47dab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:45.218500 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e728b3bb-8684-4894-ba4a-a0e1ccc47dab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:45.219029 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e728b3bb-8684-4894-ba4a-a0e1ccc47dab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:45.219424 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e728b3bb-8684-4894-ba4a-a0e1ccc47dab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:45.355675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e728b3bb-8684-4894-ba4a-a0e1ccc47dab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:45.363482 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e728b3bb-8684-4894-ba4a-a0e1ccc47dab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.157644 Aug 04 23:33:45.364049 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 868/1749] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:45 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:46.384901 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-129e7d67-3f62-4b21-8de6-293f86eb6eab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:46.385584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-129e7d67-3f62-4b21-8de6-293f86eb6eab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:46.392587 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-129e7d67-3f62-4b21-8de6-293f86eb6eab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:46.393069 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-129e7d67-3f62-4b21-8de6-293f86eb6eab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:46.393511 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-129e7d67-3f62-4b21-8de6-293f86eb6eab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:46.394209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-129e7d67-3f62-4b21-8de6-293f86eb6eab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:46.394695 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-129e7d67-3f62-4b21-8de6-293f86eb6eab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:46.395123 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-129e7d67-3f62-4b21-8de6-293f86eb6eab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:46.539683 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-129e7d67-3f62-4b21-8de6-293f86eb6eab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:46.547475 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-129e7d67-3f62-4b21-8de6-293f86eb6eab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.166467 Aug 04 23:33:46.548043 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 869/1750] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:46 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:47.568423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5e92b870-f646-4399-bb9f-3fdfbe6fba49 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:47.569111 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5e92b870-f646-4399-bb9f-3fdfbe6fba49 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:47.579720 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e92b870-f646-4399-bb9f-3fdfbe6fba49 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:47.580298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e92b870-f646-4399-bb9f-3fdfbe6fba49 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:47.580824 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e92b870-f646-4399-bb9f-3fdfbe6fba49 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:47.581690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e92b870-f646-4399-bb9f-3fdfbe6fba49 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:47.582135 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e92b870-f646-4399-bb9f-3fdfbe6fba49 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:47.582591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e92b870-f646-4399-bb9f-3fdfbe6fba49 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:47.720071 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5e92b870-f646-4399-bb9f-3fdfbe6fba49 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:47.727602 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5e92b870-f646-4399-bb9f-3fdfbe6fba49 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.163367 Aug 04 23:33:47.728168 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 870/1751] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:47 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:33:48.752033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2b9d6de9-25ee-42c6-9d26-ceab3ed32c9e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:48.753059 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2b9d6de9-25ee-42c6-9d26-ceab3ed32c9e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:48.759637 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2b9d6de9-25ee-42c6-9d26-ceab3ed32c9e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:48.760115 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2b9d6de9-25ee-42c6-9d26-ceab3ed32c9e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:48.760548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2b9d6de9-25ee-42c6-9d26-ceab3ed32c9e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:48.761240 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2b9d6de9-25ee-42c6-9d26-ceab3ed32c9e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:48.761690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2b9d6de9-25ee-42c6-9d26-ceab3ed32c9e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:48.762107 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2b9d6de9-25ee-42c6-9d26-ceab3ed32c9e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:48.894489 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2b9d6de9-25ee-42c6-9d26-ceab3ed32c9e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:48.901911 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2b9d6de9-25ee-42c6-9d26-ceab3ed32c9e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.156066 Aug 04 23:33:48.902490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 871/1752] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:48 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:33:49.513682 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:33:49.514332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:33:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247/os-volume_attachments/5f345256-fed5-4b16-a195-56888e81102b (ip 10.222.0.33) !!! Aug 04 23:33:49.922887 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0f6503e2-f89c-4480-af93-7f78e5d8d216 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:49.923501 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0f6503e2-f89c-4480-af93-7f78e5d8d216 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:49.930096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f6503e2-f89c-4480-af93-7f78e5d8d216 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:49.930604 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f6503e2-f89c-4480-af93-7f78e5d8d216 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:49.931041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f6503e2-f89c-4480-af93-7f78e5d8d216 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:49.931736 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f6503e2-f89c-4480-af93-7f78e5d8d216 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:49.932188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f6503e2-f89c-4480-af93-7f78e5d8d216 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:49.932607 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f6503e2-f89c-4480-af93-7f78e5d8d216 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:50.072304 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0f6503e2-f89c-4480-af93-7f78e5d8d216 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:50.080514 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0f6503e2-f89c-4480-af93-7f78e5d8d216 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.161674 Aug 04 23:33:50.081346 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 872/1753] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:49 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:33:51.101280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-41120040-0800-44c1-8d2c-20737ab293fb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:51.101931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-41120040-0800-44c1-8d2c-20737ab293fb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:51.108426 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-41120040-0800-44c1-8d2c-20737ab293fb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:51.108902 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-41120040-0800-44c1-8d2c-20737ab293fb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:51.109414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-41120040-0800-44c1-8d2c-20737ab293fb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:51.110107 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-41120040-0800-44c1-8d2c-20737ab293fb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:51.110601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-41120040-0800-44c1-8d2c-20737ab293fb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:51.111076 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-41120040-0800-44c1-8d2c-20737ab293fb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:51.250668 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-41120040-0800-44c1-8d2c-20737ab293fb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:51.258399 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-41120040-0800-44c1-8d2c-20737ab293fb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.161086 Aug 04 23:33:51.258968 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 873/1754] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:51 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:52.280078 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-832ae35e-b9ba-4969-8f8a-65745e379d5b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:52.280817 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-832ae35e-b9ba-4969-8f8a-65745e379d5b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:52.288248 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-832ae35e-b9ba-4969-8f8a-65745e379d5b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:52.288719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-832ae35e-b9ba-4969-8f8a-65745e379d5b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:52.289148 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-832ae35e-b9ba-4969-8f8a-65745e379d5b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:52.289830 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-832ae35e-b9ba-4969-8f8a-65745e379d5b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:52.290273 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-832ae35e-b9ba-4969-8f8a-65745e379d5b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:52.290712 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-832ae35e-b9ba-4969-8f8a-65745e379d5b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:52.425743 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-832ae35e-b9ba-4969-8f8a-65745e379d5b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:52.433312 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-832ae35e-b9ba-4969-8f8a-65745e379d5b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.157274 Aug 04 23:33:52.433866 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 874/1755] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:52 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:53.455468 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b8bb58dc-e57f-4739-bae2-79f949b592ec tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:53.456165 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b8bb58dc-e57f-4739-bae2-79f949b592ec tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:53.462504 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8bb58dc-e57f-4739-bae2-79f949b592ec tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:53.462984 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8bb58dc-e57f-4739-bae2-79f949b592ec tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:53.463423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8bb58dc-e57f-4739-bae2-79f949b592ec tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:53.464114 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8bb58dc-e57f-4739-bae2-79f949b592ec tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:53.464561 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8bb58dc-e57f-4739-bae2-79f949b592ec tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:53.464983 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8bb58dc-e57f-4739-bae2-79f949b592ec tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:53.603048 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b8bb58dc-e57f-4739-bae2-79f949b592ec tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:53.611317 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b8bb58dc-e57f-4739-bae2-79f949b592ec tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.159869 Aug 04 23:33:53.611902 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 875/1756] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:53 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:54.632312 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a9f82ee3-4103-4c01-8f4b-b2ba83e17fe3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:54.633000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a9f82ee3-4103-4c01-8f4b-b2ba83e17fe3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:54.638878 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9f82ee3-4103-4c01-8f4b-b2ba83e17fe3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:54.639349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9f82ee3-4103-4c01-8f4b-b2ba83e17fe3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:54.639782 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9f82ee3-4103-4c01-8f4b-b2ba83e17fe3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:54.640675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9f82ee3-4103-4c01-8f4b-b2ba83e17fe3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:54.641475 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9f82ee3-4103-4c01-8f4b-b2ba83e17fe3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:54.642151 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9f82ee3-4103-4c01-8f4b-b2ba83e17fe3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:54.657042 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:33:54.775145 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a9f82ee3-4103-4c01-8f4b-b2ba83e17fe3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:54.782790 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a9f82ee3-4103-4c01-8f4b-b2ba83e17fe3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.154499 Aug 04 23:33:54.783359 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 876/1757] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:54 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:55.802983 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d70bf599-c841-44dc-ba30-15c1e67ed590 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:55.803738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d70bf599-c841-44dc-ba30-15c1e67ed590 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:55.810214 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d70bf599-c841-44dc-ba30-15c1e67ed590 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:55.810727 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d70bf599-c841-44dc-ba30-15c1e67ed590 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:55.811161 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d70bf599-c841-44dc-ba30-15c1e67ed590 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:55.811859 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d70bf599-c841-44dc-ba30-15c1e67ed590 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:55.812907 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d70bf599-c841-44dc-ba30-15c1e67ed590 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:55.813329 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d70bf599-c841-44dc-ba30-15c1e67ed590 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:55.946672 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d70bf599-c841-44dc-ba30-15c1e67ed590 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:55.955041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d70bf599-c841-44dc-ba30-15c1e67ed590 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.155910 Aug 04 23:33:55.955611 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 877/1758] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:55 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:56.975872 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-dde4a382-371b-4726-842d-3112030a8eb5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:56.976536 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-dde4a382-371b-4726-842d-3112030a8eb5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:56.982873 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dde4a382-371b-4726-842d-3112030a8eb5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:56.983342 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dde4a382-371b-4726-842d-3112030a8eb5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:56.983820 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dde4a382-371b-4726-842d-3112030a8eb5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:56.985021 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dde4a382-371b-4726-842d-3112030a8eb5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:56.985473 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dde4a382-371b-4726-842d-3112030a8eb5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:56.985895 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dde4a382-371b-4726-842d-3112030a8eb5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:57.120106 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-dde4a382-371b-4726-842d-3112030a8eb5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:57.128806 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-dde4a382-371b-4726-842d-3112030a8eb5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.156798 Aug 04 23:33:57.129363 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 878/1759] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:56 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:58.151297 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-51d5ab54-2809-43cb-a25e-2630ce66d93c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:58.151949 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-51d5ab54-2809-43cb-a25e-2630ce66d93c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:58.159504 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-51d5ab54-2809-43cb-a25e-2630ce66d93c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:58.159970 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-51d5ab54-2809-43cb-a25e-2630ce66d93c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:58.160397 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-51d5ab54-2809-43cb-a25e-2630ce66d93c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:58.161074 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-51d5ab54-2809-43cb-a25e-2630ce66d93c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:58.161514 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-51d5ab54-2809-43cb-a25e-2630ce66d93c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:58.161927 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-51d5ab54-2809-43cb-a25e-2630ce66d93c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:58.292958 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-51d5ab54-2809-43cb-a25e-2630ce66d93c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:58.301111 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-51d5ab54-2809-43cb-a25e-2630ce66d93c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.153724 Aug 04 23:33:58.301684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 879/1760] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:58 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:33:59.322816 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-dd616876-3a93-43ab-acb1-f4ecebfc7fea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:33:59.323522 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-dd616876-3a93-43ab-acb1-f4ecebfc7fea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:33:59.329817 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dd616876-3a93-43ab-acb1-f4ecebfc7fea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:59.330298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dd616876-3a93-43ab-acb1-f4ecebfc7fea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:59.330761 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dd616876-3a93-43ab-acb1-f4ecebfc7fea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:59.331463 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dd616876-3a93-43ab-acb1-f4ecebfc7fea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:33:59.331918 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dd616876-3a93-43ab-acb1-f4ecebfc7fea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:33:59.332338 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dd616876-3a93-43ab-acb1-f4ecebfc7fea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:33:59.473476 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-dd616876-3a93-43ab-acb1-f4ecebfc7fea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:33:59.481029 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-dd616876-3a93-43ab-acb1-f4ecebfc7fea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.162060 Aug 04 23:33:59.481599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 880/1761] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:33:59 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:34:00.502280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a128ee43-c287-493c-918a-f99f2dd70fa4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:34:00.503031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a128ee43-c287-493c-918a-f99f2dd70fa4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:34:00.509332 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a128ee43-c287-493c-918a-f99f2dd70fa4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:00.509808 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a128ee43-c287-493c-918a-f99f2dd70fa4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:00.510251 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a128ee43-c287-493c-918a-f99f2dd70fa4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:00.510971 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a128ee43-c287-493c-918a-f99f2dd70fa4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:00.511425 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a128ee43-c287-493c-918a-f99f2dd70fa4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:00.511855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a128ee43-c287-493c-918a-f99f2dd70fa4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:00.648406 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a128ee43-c287-493c-918a-f99f2dd70fa4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:34:00.656665 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a128ee43-c287-493c-918a-f99f2dd70fa4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.158346 Aug 04 23:34:00.657242 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 881/1762] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:34:00 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:34:01.677596 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f762fd01-3c74-4e59-a48e-1fb53648555c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:34:01.678262 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f762fd01-3c74-4e59-a48e-1fb53648555c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:34:01.684726 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f762fd01-3c74-4e59-a48e-1fb53648555c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:01.685212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f762fd01-3c74-4e59-a48e-1fb53648555c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:01.685649 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f762fd01-3c74-4e59-a48e-1fb53648555c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:01.686344 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f762fd01-3c74-4e59-a48e-1fb53648555c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:01.687413 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f762fd01-3c74-4e59-a48e-1fb53648555c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:01.687924 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f762fd01-3c74-4e59-a48e-1fb53648555c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:01.822083 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f762fd01-3c74-4e59-a48e-1fb53648555c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:34:01.830520 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f762fd01-3c74-4e59-a48e-1fb53648555c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.156745 Aug 04 23:34:01.831100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 882/1763] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:34:01 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:34:02.119904 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.objects.instance [None req-320d39b8-37f1-4b05-bd1e-2cf5a9c797b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lazy-loading 'services' on Instance uuid c786164b-4aee-4a6a-9208-29f6ae31f247 {{(pid=129791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:34:02.851770 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8260751c-db1b-4062-8dd7-9b54794c5b8a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:34:02.852380 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8260751c-db1b-4062-8dd7-9b54794c5b8a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:34:02.854682 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=52 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:34:02.859899 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8260751c-db1b-4062-8dd7-9b54794c5b8a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:02.860379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8260751c-db1b-4062-8dd7-9b54794c5b8a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:02.860811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8260751c-db1b-4062-8dd7-9b54794c5b8a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:02.861503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8260751c-db1b-4062-8dd7-9b54794c5b8a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:02.861951 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8260751c-db1b-4062-8dd7-9b54794c5b8a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:02.862388 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8260751c-db1b-4062-8dd7-9b54794c5b8a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:02.995122 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8260751c-db1b-4062-8dd7-9b54794c5b8a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:34:03.002819 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8260751c-db1b-4062-8dd7-9b54794c5b8a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.154906 Aug 04 23:34:03.003382 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 883/1764] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:34:02 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:34:04.024763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-bbfba20c-8c0a-4945-b457-0ddabfafe9e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:34:04.025452 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-bbfba20c-8c0a-4945-b457-0ddabfafe9e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:34:04.032441 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bbfba20c-8c0a-4945-b457-0ddabfafe9e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:04.032914 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bbfba20c-8c0a-4945-b457-0ddabfafe9e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:04.033350 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bbfba20c-8c0a-4945-b457-0ddabfafe9e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:04.034042 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bbfba20c-8c0a-4945-b457-0ddabfafe9e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:04.034531 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bbfba20c-8c0a-4945-b457-0ddabfafe9e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:04.034956 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bbfba20c-8c0a-4945-b457-0ddabfafe9e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:04.170946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-bbfba20c-8c0a-4945-b457-0ddabfafe9e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:34:04.179450 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-bbfba20c-8c0a-4945-b457-0ddabfafe9e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.159068 Aug 04 23:34:04.180244 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 884/1765] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:34:04 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:34:05.200954 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-63152075-7881-4bc2-9734-0b55fb8dc96a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:34:05.201599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-63152075-7881-4bc2-9734-0b55fb8dc96a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:34:05.207957 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-63152075-7881-4bc2-9734-0b55fb8dc96a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:05.208429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-63152075-7881-4bc2-9734-0b55fb8dc96a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:05.208858 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-63152075-7881-4bc2-9734-0b55fb8dc96a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:05.209537 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-63152075-7881-4bc2-9734-0b55fb8dc96a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:05.209976 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-63152075-7881-4bc2-9734-0b55fb8dc96a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:05.210420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-63152075-7881-4bc2-9734-0b55fb8dc96a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:05.346280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-63152075-7881-4bc2-9734-0b55fb8dc96a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:34:05.353846 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-63152075-7881-4bc2-9734-0b55fb8dc96a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.156705 Aug 04 23:34:05.354420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 885/1766] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:34:05 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:34:06.374905 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d0d5ca90-2285-4007-9cdb-db3d5a79314b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:34:06.375555 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d0d5ca90-2285-4007-9cdb-db3d5a79314b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:34:06.382200 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d0d5ca90-2285-4007-9cdb-db3d5a79314b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:06.382743 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d0d5ca90-2285-4007-9cdb-db3d5a79314b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:06.383183 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d0d5ca90-2285-4007-9cdb-db3d5a79314b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:06.383874 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d0d5ca90-2285-4007-9cdb-db3d5a79314b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:06.384321 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d0d5ca90-2285-4007-9cdb-db3d5a79314b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:06.384740 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d0d5ca90-2285-4007-9cdb-db3d5a79314b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:06.518838 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d0d5ca90-2285-4007-9cdb-db3d5a79314b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:34:06.533745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d0d5ca90-2285-4007-9cdb-db3d5a79314b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.162678 Aug 04 23:34:06.534352 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 886/1767] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:34:06 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:34:07.554745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2f8feb61-0a13-4305-8157-4a7fc54c7cfd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:34:07.555404 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2f8feb61-0a13-4305-8157-4a7fc54c7cfd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:34:07.562074 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f8feb61-0a13-4305-8157-4a7fc54c7cfd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:07.562597 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f8feb61-0a13-4305-8157-4a7fc54c7cfd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:07.563035 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f8feb61-0a13-4305-8157-4a7fc54c7cfd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:07.564309 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f8feb61-0a13-4305-8157-4a7fc54c7cfd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:07.564758 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f8feb61-0a13-4305-8157-4a7fc54c7cfd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:07.565437 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f8feb61-0a13-4305-8157-4a7fc54c7cfd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:07.699732 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2f8feb61-0a13-4305-8157-4a7fc54c7cfd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:34:07.708621 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2f8feb61-0a13-4305-8157-4a7fc54c7cfd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.157944 Aug 04 23:34:07.709180 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 887/1768] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:34:07 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:34:08.729716 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-53a710ec-2026-47b6-9f1c-5120cb69d835 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:34:08.730430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-53a710ec-2026-47b6-9f1c-5120cb69d835 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:34:08.737353 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53a710ec-2026-47b6-9f1c-5120cb69d835 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:08.737827 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53a710ec-2026-47b6-9f1c-5120cb69d835 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:08.738261 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53a710ec-2026-47b6-9f1c-5120cb69d835 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:08.738973 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53a710ec-2026-47b6-9f1c-5120cb69d835 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:08.739423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53a710ec-2026-47b6-9f1c-5120cb69d835 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:08.739844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53a710ec-2026-47b6-9f1c-5120cb69d835 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:08.873440 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-53a710ec-2026-47b6-9f1c-5120cb69d835 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:34:08.880944 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-53a710ec-2026-47b6-9f1c-5120cb69d835 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.155103 Aug 04 23:34:08.881502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 888/1769] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:34:08 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:34:09.901407 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-330d7000-4916-4800-8e29-406e74f4cd47 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:34:09.902036 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-330d7000-4916-4800-8e29-406e74f4cd47 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:34:09.908414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-330d7000-4916-4800-8e29-406e74f4cd47 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:09.908889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-330d7000-4916-4800-8e29-406e74f4cd47 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:09.909324 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-330d7000-4916-4800-8e29-406e74f4cd47 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:09.910015 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-330d7000-4916-4800-8e29-406e74f4cd47 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:09.910494 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-330d7000-4916-4800-8e29-406e74f4cd47 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:09.910920 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-330d7000-4916-4800-8e29-406e74f4cd47 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:10.052338 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-330d7000-4916-4800-8e29-406e74f4cd47 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:34:10.060037 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-330d7000-4916-4800-8e29-406e74f4cd47 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.162529 Aug 04 23:34:10.060787 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 889/1770] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:34:09 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:34:11.081823 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9f9f97b7-40d7-4366-ad1e-872d77fbaf9b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:34:11.082529 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9f9f97b7-40d7-4366-ad1e-872d77fbaf9b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:34:11.089007 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9f9f97b7-40d7-4366-ad1e-872d77fbaf9b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:11.089517 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9f9f97b7-40d7-4366-ad1e-872d77fbaf9b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:11.089945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9f9f97b7-40d7-4366-ad1e-872d77fbaf9b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:11.090675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9f9f97b7-40d7-4366-ad1e-872d77fbaf9b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:11.091122 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9f9f97b7-40d7-4366-ad1e-872d77fbaf9b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:11.091536 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9f9f97b7-40d7-4366-ad1e-872d77fbaf9b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:11.227585 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9f9f97b7-40d7-4366-ad1e-872d77fbaf9b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:34:11.235267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9f9f97b7-40d7-4366-ad1e-872d77fbaf9b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.157949 Aug 04 23:34:11.235834 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 890/1771] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:34:11 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:34:12.123898 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=4 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:34:12.257477 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7ed75065-9cec-4b93-ac73-736a9ab4dae1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:34:12.258065 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7ed75065-9cec-4b93-ac73-736a9ab4dae1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:34:12.264661 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ed75065-9cec-4b93-ac73-736a9ab4dae1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:12.265133 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ed75065-9cec-4b93-ac73-736a9ab4dae1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:12.265562 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ed75065-9cec-4b93-ac73-736a9ab4dae1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:12.266242 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ed75065-9cec-4b93-ac73-736a9ab4dae1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:12.266726 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ed75065-9cec-4b93-ac73-736a9ab4dae1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:12.267139 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ed75065-9cec-4b93-ac73-736a9ab4dae1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:12.399229 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7ed75065-9cec-4b93-ac73-736a9ab4dae1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:34:12.406748 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7ed75065-9cec-4b93-ac73-736a9ab4dae1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.153177 Aug 04 23:34:12.407308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 891/1772] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:34:12 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:34:13.429150 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-48d6cf65-dce9-47d2-bb36-9bb0461c9b0f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:34:13.429841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-48d6cf65-dce9-47d2-bb36-9bb0461c9b0f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:34:13.436192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48d6cf65-dce9-47d2-bb36-9bb0461c9b0f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:13.436716 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48d6cf65-dce9-47d2-bb36-9bb0461c9b0f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:13.437093 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48d6cf65-dce9-47d2-bb36-9bb0461c9b0f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:13.437776 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48d6cf65-dce9-47d2-bb36-9bb0461c9b0f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:13.438221 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48d6cf65-dce9-47d2-bb36-9bb0461c9b0f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:13.438668 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-48d6cf65-dce9-47d2-bb36-9bb0461c9b0f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:13.575979 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-48d6cf65-dce9-47d2-bb36-9bb0461c9b0f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:34:13.583626 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-48d6cf65-dce9-47d2-bb36-9bb0461c9b0f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.158569 Aug 04 23:34:13.584184 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 892/1773] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:34:13 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:34:14.604477 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2aefa84b-614c-49f2-bb5e-16a63d08bf98 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:34:14.605247 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2aefa84b-614c-49f2-bb5e-16a63d08bf98 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:34:14.611984 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2aefa84b-614c-49f2-bb5e-16a63d08bf98 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:14.612758 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2aefa84b-614c-49f2-bb5e-16a63d08bf98 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:14.613203 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2aefa84b-614c-49f2-bb5e-16a63d08bf98 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:14.613893 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2aefa84b-614c-49f2-bb5e-16a63d08bf98 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:14.614382 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2aefa84b-614c-49f2-bb5e-16a63d08bf98 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:14.614833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2aefa84b-614c-49f2-bb5e-16a63d08bf98 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:14.617337 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:34:14.750434 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2aefa84b-614c-49f2-bb5e-16a63d08bf98 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:34:14.758749 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2aefa84b-614c-49f2-bb5e-16a63d08bf98 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.158258 Aug 04 23:34:14.759309 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 893/1774] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:34:14 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:34:15.779303 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4ba3e0b7-ff36-4ba8-8cf0-cbcf2a654fdd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:34:15.779992 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4ba3e0b7-ff36-4ba8-8cf0-cbcf2a654fdd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:34:15.786600 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4ba3e0b7-ff36-4ba8-8cf0-cbcf2a654fdd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:15.787084 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4ba3e0b7-ff36-4ba8-8cf0-cbcf2a654fdd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:15.787520 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4ba3e0b7-ff36-4ba8-8cf0-cbcf2a654fdd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:15.788214 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4ba3e0b7-ff36-4ba8-8cf0-cbcf2a654fdd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:15.788671 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4ba3e0b7-ff36-4ba8-8cf0-cbcf2a654fdd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:15.789092 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4ba3e0b7-ff36-4ba8-8cf0-cbcf2a654fdd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:15.927499 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4ba3e0b7-ff36-4ba8-8cf0-cbcf2a654fdd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:34:15.935466 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4ba3e0b7-ff36-4ba8-8cf0-cbcf2a654fdd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.160049 Aug 04 23:34:15.936029 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 894/1775] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:34:15 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:34:16.592308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-df6d5908-45ff-4c80-a87f-c4460c48fa04 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:34:16.592804 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-df6d5908-45ff-4c80-a87f-c4460c48fa04 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:34:16.599261 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-df6d5908-45ff-4c80-a87f-c4460c48fa04 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:16.599734 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-df6d5908-45ff-4c80-a87f-c4460c48fa04 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:16.600161 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-df6d5908-45ff-4c80-a87f-c4460c48fa04 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:16.600842 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-df6d5908-45ff-4c80-a87f-c4460c48fa04 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:34:16.601292 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-df6d5908-45ff-4c80-a87f-c4460c48fa04 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:34:16.601708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-df6d5908-45ff-4c80-a87f-c4460c48fa04 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:34:26.596585 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=25 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:34:26.620623 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=15 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:34:43.417638 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:34:43.418293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:34:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247/os-volume_attachments/5f345256-fed5-4b16-a195-56888e81102b (ip 10.222.0.33) !!! Aug 04 23:35:16.543283 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-320d39b8-37f1-4b05-bd1e-2cf5a9c797b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247/os-volume_attachments/5f345256-fed5-4b16-a195-56888e81102b" status: 202 len: 0 microversion: 2.1 time: 120.078936 Aug 04 23:35:16.544158 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 882/1776] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Aug 4 23:33:16 2022] DELETE /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247/os-volume_attachments/5f345256-fed5-4b16-a195-56888e81102b => generated 0 bytes in 120081 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:35:16.551406 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ba3603a5-4fb3-491b-9d21-208a609eabc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:35:16.552107 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ba3603a5-4fb3-491b-9d21-208a609eabc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:35:16.562902 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba3603a5-4fb3-491b-9d21-208a609eabc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:35:16.563466 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba3603a5-4fb3-491b-9d21-208a609eabc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:35:16.563904 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba3603a5-4fb3-491b-9d21-208a609eabc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:35:16.564615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba3603a5-4fb3-491b-9d21-208a609eabc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:35:16.565804 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba3603a5-4fb3-491b-9d21-208a609eabc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:35:16.566237 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba3603a5-4fb3-491b-9d21-208a609eabc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:35:16.668002 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.objects.instance [None req-df6d5908-45ff-4c80-a87f-c4460c48fa04 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lazy-loading 'services' on Instance uuid c786164b-4aee-4a6a-9208-29f6ae31f247 {{(pid=129790) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:35:16.719582 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ba3603a5-4fb3-491b-9d21-208a609eabc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:35:16.728204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ba3603a5-4fb3-491b-9d21-208a609eabc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.182915 Aug 04 23:35:16.728771 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 883/1777] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:35:16 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:35:16.738638 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a566098c-3ef8-4af3-a3d5-794dd5930331 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:35:16.738638 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a566098c-3ef8-4af3-a3d5-794dd5930331 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:35:16.740863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a566098c-3ef8-4af3-a3d5-794dd5930331 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:35:16.741341 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a566098c-3ef8-4af3-a3d5-794dd5930331 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:35:16.741839 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a566098c-3ef8-4af3-a3d5-794dd5930331 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:35:16.742574 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a566098c-3ef8-4af3-a3d5-794dd5930331 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:35:16.743024 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a566098c-3ef8-4af3-a3d5-794dd5930331 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:35:16.743439 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a566098c-3ef8-4af3-a3d5-794dd5930331 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:35:26.672719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=4 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:35:26.737872 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=4 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:35:26.763766 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:36:02.217361 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-df6d5908-45ff-4c80-a87f-c4460c48fa04 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c820ab00-3357-48d0-997f-bba661844e63) Aug 04 23:36:02.219640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-df6d5908-45ff-4c80-a87f-c4460c48fa04 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Request method failure captured: Aug 04 23:36:02.219640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: DELETE /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247/os-volume_attachments/5f345256-fed5-4b16-a195-56888e81102b HTTP/1.1 Aug 04 23:36:02.219640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:36:02.219640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:36:02.219640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:36:02.219640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:36:02.219640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:36:02.219640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:36:02.219640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:36:02.219640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:36:02.219640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FUYhX2TojNXAcA603ptQ9cSfNJYH-1IUoAk5kZ1Xhubg5tN0qtpjimLeaP4DiWFcLxH2g5RKdF89ROPd4N0_vnzOqa3rgLnlkGR2sYAQx46hu4JhEOZYCJsuiCjpxL8apQRiWT6nAtjhYZ6EKOCs_uZdEradeyWqviJYCWy4ptjup4 Aug 04 23:36:02.219640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:36:02.219640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:36:02.219640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:36:02.219640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:36:02.219640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:36:02.219640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:36:02.219640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: 53d297a325844e15bfc7ac1b305789a2 Aug 04 23:36:02.219640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1426913507 Aug 04 23:36:02.219640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:36:02.219640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:36:02.221467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d297a325844e15bfc7ac1b305789a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53d297a325844e15bfc7ac1b305789a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d297a325844e15bfc7ac1b305789a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53d297a325844e15bfc7ac1b305789a2"}]}] Aug 04 23:36:02.221467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-VolumesSnapshotTestJSON-1426913507 Aug 04 23:36:02.221467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: 53d297a325844e15bfc7ac1b305789a2 Aug 04 23:36:02.221467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1426913507 Aug 04 23:36:02.221467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-VolumesSnapshotTestJSON-1426913507-project Aug 04 23:36:02.221467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:36:02.221467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:36:02.221467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: 146d37206ef046fe98141e20a6835701 Aug 04 23:36:02.221467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-VolumesSnapshotTestJSON-1426913507-project Aug 04 23:36:02.221467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:36:02.223246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c820ab00-3357-48d0-997f-bba661844e63) Aug 04 23:36:02.223246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'server_id': 'c786164b-4aee-4a6a-9208-29f6ae31f247', 'id': '5f345256-fed5-4b16-a195-56888e81102b'} Aug 04 23:36:02.223246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:36:02.223246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:36:02.223246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 23:36:02.223246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 23:36:02.223246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 23:36:02.223246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 23:36:02.223246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 04 23:36:02.223246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 04 23:36:02.223246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 04 23:36:02.223246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 04 23:36:02.223246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 04 23:36:02.223246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 04 23:36:02.223246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 04 23:36:02.223246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 04 23:36:02.223246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:36:02.225192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:36:02.225192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:36:02.225192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:36:02.225192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c820ab00-3357-48d0-997f-bba661844e63) Aug 04 23:36:02.225192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:36:02.225192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:36:02.225192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:36:02.225192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:36:02.225192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 04 23:36:02.225192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 04 23:36:02.225192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 04 23:36:02.225192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 04 23:36:02.225192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 23:36:02.225192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 23:36:02.225192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 23:36:02.225192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 23:36:02.225192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 23:36:02.225192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 23:36:02.225192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 04 23:36:02.226620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 04 23:36:02.226620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 04 23:36:02.226620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 04 23:36:02.226620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 04 23:36:02.226620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 04 23:36:02.226620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 04 23:36:02.226620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 04 23:36:02.226620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:36:02.226620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:36:02.226620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:36:02.226620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:36:02.226620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c820ab00-3357-48d0-997f-bba661844e63) Aug 04 23:36:02.226620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:36:02.226620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:36:02.226620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:36:02.226620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:36:02.226620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 04 23:36:02.228103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 04 23:36:02.228103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 23:36:02.228103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 23:36:02.228103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 23:36:02.228103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 23:36:02.228103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 04 23:36:02.228103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 04 23:36:02.228103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 04 23:36:02.228103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 23:36:02.228103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 04 23:36:02.228103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 04 23:36:02.228103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c820ab00-3357-48d0-997f-bba661844e63) Aug 04 23:36:02.228103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:36:02.228103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:36:02.228103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:36:02.228103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:36:02.228103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:36:02.228103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:36:02.229856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:36:02.229856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:36:02.229856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:36:02.229856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:36:02.229856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 04 23:36:02.229856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 23:36:02.229856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c820ab00-3357-48d0-997f-bba661844e63) Aug 04 23:36:02.229856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:36:02.229856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:36:02.229856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:36:02.229856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:36:02.229856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:36:02.229856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:36:02.229856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:36:02.229856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:36:02.229856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c820ab00-3357-48d0-997f-bba661844e63) Aug 04 23:36:02.229856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:36:02.231423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-df6d5908-45ff-4c80-a87f-c4460c48fa04 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c820ab00-3357-48d0-997f-bba661844e63) {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:36:02.231423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-df6d5908-45ff-4c80-a87f-c4460c48fa04 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247/os-volume_attachments/5f345256-fed5-4b16-a195-56888e81102b" status: 400 len: 269 microversion: 2.1 time: 105.697783 Aug 04 23:36:02.231423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 895/1778] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Aug 4 23:34:16 2022] DELETE /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247/os-volume_attachments/5f345256-fed5-4b16-a195-56888e81102b => generated 269 bytes in 105699 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 23:36:02.231423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4c2d8c36-c2e2-4867-bddf-80e7d824735d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:36:02.231810 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4c2d8c36-c2e2-4867-bddf-80e7d824735d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: e5609e6d-20ca-45b4-8edf-9b0eff540469] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:36:02.235489 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c2d8c36-c2e2-4867-bddf-80e7d824735d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:02.236350 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c2d8c36-c2e2-4867-bddf-80e7d824735d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:02.237130 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c2d8c36-c2e2-4867-bddf-80e7d824735d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:02.237481 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c2d8c36-c2e2-4867-bddf-80e7d824735d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:02.237945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c2d8c36-c2e2-4867-bddf-80e7d824735d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:02.239690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c2d8c36-c2e2-4867-bddf-80e7d824735d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:02.265323 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4c2d8c36-c2e2-4867-bddf-80e7d824735d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: e5609e6d-20ca-45b4-8edf-9b0eff540469] Going to try to terminate instance {{(pid=129790) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 23:36:02.270668 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.objects.instance [None req-a566098c-3ef8-4af3-a3d5-794dd5930331 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lazy-loading 'services' on Instance uuid c786164b-4aee-4a6a-9208-29f6ae31f247 {{(pid=129791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:36:02.350738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4c2d8c36-c2e2-4867-bddf-80e7d824735d tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469" status: 204 len: 0 microversion: 2.1 time: 0.126600 Aug 04 23:36:02.351430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 896/1779] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:36:02 2022] DELETE /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 23:36:02.484803 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-05408409-4211-4159-b70f-32c0d54e456c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:36:02.485509 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-05408409-4211-4159-b70f-32c0d54e456c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:36:02.491868 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-05408409-4211-4159-b70f-32c0d54e456c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:02.492348 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-05408409-4211-4159-b70f-32c0d54e456c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:02.492781 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-05408409-4211-4159-b70f-32c0d54e456c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:02.493477 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-05408409-4211-4159-b70f-32c0d54e456c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:02.493956 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-05408409-4211-4159-b70f-32c0d54e456c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:02.494428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-05408409-4211-4159-b70f-32c0d54e456c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:02.627990 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-05408409-4211-4159-b70f-32c0d54e456c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:36:02.636901 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-05408409-4211-4159-b70f-32c0d54e456c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.284042 Aug 04 23:36:02.637463 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 897/1780] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:36:02 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:36:02.642005 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f5ec85bf-91f5-42d7-a962-5da90cd056d1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:36:02.642641 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f5ec85bf-91f5-42d7-a962-5da90cd056d1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: e5609e6d-20ca-45b4-8edf-9b0eff540469] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:36:02.649735 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f5ec85bf-91f5-42d7-a962-5da90cd056d1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:02.650223 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f5ec85bf-91f5-42d7-a962-5da90cd056d1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:02.650687 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f5ec85bf-91f5-42d7-a962-5da90cd056d1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:02.651529 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f5ec85bf-91f5-42d7-a962-5da90cd056d1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:02.651990 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f5ec85bf-91f5-42d7-a962-5da90cd056d1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:02.652417 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f5ec85bf-91f5-42d7-a962-5da90cd056d1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:02.870093 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f5ec85bf-91f5-42d7-a962-5da90cd056d1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:36:02.877868 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f5ec85bf-91f5-42d7-a962-5da90cd056d1 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469" status: 200 len: 1672 microversion: 2.1 time: 0.239363 Aug 04 23:36:02.878434 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 898/1781] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:36:02 2022] GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469 => generated 1672 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:36:03.839282 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3df6106d-412e-4f9f-b122-012a11a9dfd3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:36:03.840719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3df6106d-412e-4f9f-b122-012a11a9dfd3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:36:03.848674 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3df6106d-412e-4f9f-b122-012a11a9dfd3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:03.849546 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3df6106d-412e-4f9f-b122-012a11a9dfd3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:03.850162 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3df6106d-412e-4f9f-b122-012a11a9dfd3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:03.851746 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3df6106d-412e-4f9f-b122-012a11a9dfd3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:03.852634 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3df6106d-412e-4f9f-b122-012a11a9dfd3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:03.853361 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3df6106d-412e-4f9f-b122-012a11a9dfd3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:03.883072 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3df6106d-412e-4f9f-b122-012a11a9dfd3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Going to try to terminate instance {{(pid=129790) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 23:36:03.989924 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3df6106d-412e-4f9f-b122-012a11a9dfd3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 204 len: 0 microversion: 2.1 time: 0.154195 Aug 04 23:36:03.990952 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 899/1782] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:36:03 2022] DELETE /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 23:36:04.060716 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-dd267269-4e0a-472e-bcc2-c1946540fe3f req-11b54087-0ef6-4e55-8a68-980fc0c597ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a0c9ea5-2710-4533-b166-010d46ab0027", "tag": "288e902d-3b66-41d9-a3c5-5e1bbfb5e18b"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:36:04.073276 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-dd267269-4e0a-472e-bcc2-c1946540fe3f req-11b54087-0ef6-4e55-8a68-980fc0c597ad service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:04.073760 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-dd267269-4e0a-472e-bcc2-c1946540fe3f req-11b54087-0ef6-4e55-8a68-980fc0c597ad service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:04.074202 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-dd267269-4e0a-472e-bcc2-c1946540fe3f req-11b54087-0ef6-4e55-8a68-980fc0c597ad service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:04.087721 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-dd267269-4e0a-472e-bcc2-c1946540fe3f req-11b54087-0ef6-4e55-8a68-980fc0c597ad service nova] Creating event network-changed:288e902d-3b66-41d9-a3c5-5e1bbfb5e18b for instance 7a0c9ea5-2710-4533-b166-010d46ab0027 on hv-cinder-85221 Aug 04 23:36:04.092945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-dd267269-4e0a-472e-bcc2-c1946540fe3f req-11b54087-0ef6-4e55-8a68-980fc0c597ad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100562 Aug 04 23:36:04.096718 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 900/1783] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:36:04.102631 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9bbdc97d-496f-41da-bc95-981a93a4dc0b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:36:04.103357 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9bbdc97d-496f-41da-bc95-981a93a4dc0b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: e5609e6d-20ca-45b4-8edf-9b0eff540469] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:36:04.110001 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9bbdc97d-496f-41da-bc95-981a93a4dc0b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:04.110535 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9bbdc97d-496f-41da-bc95-981a93a4dc0b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:04.110982 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9bbdc97d-496f-41da-bc95-981a93a4dc0b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:04.111717 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9bbdc97d-496f-41da-bc95-981a93a4dc0b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:04.112182 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9bbdc97d-496f-41da-bc95-981a93a4dc0b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:04.112614 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9bbdc97d-496f-41da-bc95-981a93a4dc0b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:04.197242 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9bbdc97d-496f-41da-bc95-981a93a4dc0b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a00aba057b548b1bc81e68acffea150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd21e824d843aea197d84ef1ab1319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:36:04.206698 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9bbdc97d-496f-41da-bc95-981a93a4dc0b tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469" status: 200 len: 1605 microversion: 2.1 time: 0.108399 Aug 04 23:36:04.220832 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 901/1784] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:36:04 2022] GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469 => generated 1605 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:36:04.220832 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e798eaf6-1419-45f3-9690-032af850a81f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:36:04.220832 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e798eaf6-1419-45f3-9690-032af850a81f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:36:04.223774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e798eaf6-1419-45f3-9690-032af850a81f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:04.224667 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e798eaf6-1419-45f3-9690-032af850a81f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:04.225191 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e798eaf6-1419-45f3-9690-032af850a81f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:04.225976 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e798eaf6-1419-45f3-9690-032af850a81f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:04.226536 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e798eaf6-1419-45f3-9690-032af850a81f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:04.227034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e798eaf6-1419-45f3-9690-032af850a81f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:04.392059 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e798eaf6-1419-45f3-9690-032af850a81f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:36:04.420369 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e798eaf6-1419-45f3-9690-032af850a81f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1569 microversion: 2.1 time: 0.209058 Aug 04 23:36:04.422406 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 902/1785] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:36:04 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:36:04.657560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-7a5fffb3-a0e7-4452-ae3f-4cfd7ace1410 req-383c50a1-95f9-454a-8a90-33d054cfcdfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5609e6d-20ca-45b4-8edf-9b0eff540469", "name": "network-vif-deleted", "tag": "9a91d1e1-4dd3-4c52-9e85-b40ec734aa85"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:36:04.682241 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-7a5fffb3-a0e7-4452-ae3f-4cfd7ace1410 req-383c50a1-95f9-454a-8a90-33d054cfcdfc service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:04.693366 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-7a5fffb3-a0e7-4452-ae3f-4cfd7ace1410 req-383c50a1-95f9-454a-8a90-33d054cfcdfc service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:04.693961 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-7a5fffb3-a0e7-4452-ae3f-4cfd7ace1410 req-383c50a1-95f9-454a-8a90-33d054cfcdfc service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:04.737113 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-7a5fffb3-a0e7-4452-ae3f-4cfd7ace1410 req-383c50a1-95f9-454a-8a90-33d054cfcdfc service nova] Creating event network-vif-deleted:9a91d1e1-4dd3-4c52-9e85-b40ec734aa85 for instance e5609e6d-20ca-45b4-8edf-9b0eff540469 on hv-cinder-85221 Aug 04 23:36:04.744726 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-7a5fffb3-a0e7-4452-ae3f-4cfd7ace1410 req-383c50a1-95f9-454a-8a90-33d054cfcdfc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215339 Aug 04 23:36:04.745654 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 903/1786] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:36:05.230178 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-32ae58c7-3b0f-4cb0-a3df-1750a9ba5e97 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:36:05.230918 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-32ae58c7-3b0f-4cb0-a3df-1750a9ba5e97 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: e5609e6d-20ca-45b4-8edf-9b0eff540469] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:36:05.242582 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32ae58c7-3b0f-4cb0-a3df-1750a9ba5e97 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:05.243005 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32ae58c7-3b0f-4cb0-a3df-1750a9ba5e97 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:05.243505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32ae58c7-3b0f-4cb0-a3df-1750a9ba5e97 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:05.244158 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32ae58c7-3b0f-4cb0-a3df-1750a9ba5e97 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:05.244608 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32ae58c7-3b0f-4cb0-a3df-1750a9ba5e97 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:05.245028 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32ae58c7-3b0f-4cb0-a3df-1750a9ba5e97 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:05.259881 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-32ae58c7-3b0f-4cb0-a3df-1750a9ba5e97 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] HTTP exception thrown: Instance e5609e6d-20ca-45b4-8edf-9b0eff540469 could not be found. Aug 04 23:36:05.261541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-32ae58c7-3b0f-4cb0-a3df-1750a9ba5e97 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Request method failure captured: Aug 04 23:36:05.261541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469 HTTP/1.1 Aug 04 23:36:05.261541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:36:05.261541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:36:05.261541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:36:05.261541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:36:05.261541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:36:05.261541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:36:05.261541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:36:05.261541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:36:05.261541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FRJZMt_ovgBvylQQkOcY773MPZMsH8E61Dm1eLB6D0DgOOyRBI6G0yizu_QS-puIt--Wzz0jIf7la2DtjZkT40s5ZQw8pt2ehw_CTLUmEDuF9PwY_Sam_5zdViqLq68DjmONE54QtGf94GQ2KGKeOyXIby2fSy9S1J2kzxo2Jyuz1g Aug 04 23:36:05.261541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:36:05.261541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:36:05.261541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:36:05.261541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:36:05.261541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:36:05.261541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:36:05.261541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: c5dd21e824d843aea197d84ef1ab1319 Aug 04 23:36:05.261541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-AttachVolumeTestJSON-2132667042 Aug 04 23:36:05.261541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:36:05.261541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:36:05.263041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c5dd21e824d843aea197d84ef1ab1319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c5dd21e824d843aea197d84ef1ab1319"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c5dd21e824d843aea197d84ef1ab1319"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c5dd21e824d843aea197d84ef1ab1319"}]}] Aug 04 23:36:05.263041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-AttachVolumeTestJSON-2132667042 Aug 04 23:36:05.263041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: c5dd21e824d843aea197d84ef1ab1319 Aug 04 23:36:05.263041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2132667042 Aug 04 23:36:05.263041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-AttachVolumeTestJSON-2132667042-project Aug 04 23:36:05.263041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:36:05.263041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:36:05.263041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: 3a00aba057b548b1bc81e68acffea150 Aug 04 23:36:05.263041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-AttachVolumeTestJSON-2132667042-project Aug 04 23:36:05.263041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:36:05.263041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Instance e5609e6d-20ca-45b4-8edf-9b0eff540469 could not be found. Aug 04 23:36:05.263041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': 'e5609e6d-20ca-45b4-8edf-9b0eff540469'} Aug 04 23:36:05.264079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:36:05.264079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:36:05.264079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:36:05.264079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:36:05.264079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:36:05.264079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:36:05.264079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:36:05.264079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:36:05.264079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:36:05.264079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:36:05.264079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5609e6d-20ca-45b4-8edf-9b0eff540469 could not be found. Aug 04 23:36:05.264079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:36:05.264079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:36:05.264079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:36:05.264079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:36:05.264079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:36:05.264079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:36:05.264079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:36:05.264079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:36:05.264079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:36:05.265731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:36:05.265731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:36:05.265731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:36:05.265731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:36:05.265731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:36:05.265731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:36:05.265731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:36:05.265731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5609e6d-20ca-45b4-8edf-9b0eff540469 could not be found. Aug 04 23:36:05.265731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:36:05.265731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:36:05.265731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:36:05.265731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:36:05.265731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:36:05.265731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:36:05.265731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:36:05.265731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:36:05.265731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5609e6d-20ca-45b4-8edf-9b0eff540469 could not be found. Aug 04 23:36:05.265731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:36:05.267647 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-32ae58c7-3b0f-4cb0-a3df-1750a9ba5e97 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Returning 404 to user: Instance e5609e6d-20ca-45b4-8edf-9b0eff540469 could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:36:05.267647 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-32ae58c7-3b0f-4cb0-a3df-1750a9ba5e97 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469" status: 404 len: 111 microversion: 2.1 time: 0.037480 Aug 04 23:36:05.267647 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 904/1787] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:36:05 2022] GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 23:36:05.273507 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-965d3d8a-6d70-4f8e-9ede-0ac897421481 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '.version_select at 0x7f6d25c99f70>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:36:05.277995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR oslo.messaging._drivers.impl_rabbit [None req-965d3d8a-6d70-4f8e-9ede-0ac897421481 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [b96003f9-b314-4a23-b8ad-ce66a5546d8b] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 23:36:06.284175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [None req-965d3d8a-6d70-4f8e-9ede-0ac897421481 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [b96003f9-b314-4a23-b8ad-ce66a5546d8b] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 35810. Aug 04 23:36:06.303825 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-965d3d8a-6d70-4f8e-9ede-0ac897421481 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1056720062" status: 202 len: 0 microversion: 2.1 time: 1.035328 Aug 04 23:36:06.304412 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 905/1788] 10.222.0.33 () {58 vars in 1221 bytes} [Thu Aug 4 23:36:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1056720062 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:36:06.309089 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-cfadaaa4-e2b9-4a3a-8ff1-90b00a4b673b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:36:06.309696 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-cfadaaa4-e2b9-4a3a-8ff1-90b00a4b673b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:36:06.317546 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cfadaaa4-e2b9-4a3a-8ff1-90b00a4b673b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:06.318032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cfadaaa4-e2b9-4a3a-8ff1-90b00a4b673b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:06.318495 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cfadaaa4-e2b9-4a3a-8ff1-90b00a4b673b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:06.319196 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cfadaaa4-e2b9-4a3a-8ff1-90b00a4b673b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:06.319641 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cfadaaa4-e2b9-4a3a-8ff1-90b00a4b673b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:06.320061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cfadaaa4-e2b9-4a3a-8ff1-90b00a4b673b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:06.505083 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-cfadaaa4-e2b9-4a3a-8ff1-90b00a4b673b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:36:06.514210 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-cfadaaa4-e2b9-4a3a-8ff1-90b00a4b673b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.208746 Aug 04 23:36:06.515078 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 906/1789] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:36:06 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:36:07.535855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ad314135-f20e-4824-b72f-0d25070b5909 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:36:07.536513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ad314135-f20e-4824-b72f-0d25070b5909 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:36:07.542979 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad314135-f20e-4824-b72f-0d25070b5909 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:07.543464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad314135-f20e-4824-b72f-0d25070b5909 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:07.543896 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad314135-f20e-4824-b72f-0d25070b5909 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:07.544592 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad314135-f20e-4824-b72f-0d25070b5909 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:07.545041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad314135-f20e-4824-b72f-0d25070b5909 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:07.545463 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad314135-f20e-4824-b72f-0d25070b5909 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:07.684217 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ad314135-f20e-4824-b72f-0d25070b5909 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:36:07.692352 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ad314135-f20e-4824-b72f-0d25070b5909 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.160949 Aug 04 23:36:07.692919 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 907/1790] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:36:07 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:36:08.713107 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-50aeb8a7-5fd8-4e4f-9764-e762d0055895 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:36:08.713813 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-50aeb8a7-5fd8-4e4f-9764-e762d0055895 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:36:08.720059 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-50aeb8a7-5fd8-4e4f-9764-e762d0055895 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:08.720530 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-50aeb8a7-5fd8-4e4f-9764-e762d0055895 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:08.720960 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-50aeb8a7-5fd8-4e4f-9764-e762d0055895 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:08.721637 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-50aeb8a7-5fd8-4e4f-9764-e762d0055895 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:08.722079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-50aeb8a7-5fd8-4e4f-9764-e762d0055895 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:08.722572 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-50aeb8a7-5fd8-4e4f-9764-e762d0055895 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:08.855104 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-50aeb8a7-5fd8-4e4f-9764-e762d0055895 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:36:08.863424 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-50aeb8a7-5fd8-4e4f-9764-e762d0055895 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.153501 Aug 04 23:36:08.864010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 908/1791] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:36:08 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:36:09.884944 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2db57c73-80c0-4342-8b33-28db59e656a1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:36:09.885654 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2db57c73-80c0-4342-8b33-28db59e656a1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:36:09.892074 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2db57c73-80c0-4342-8b33-28db59e656a1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:09.892555 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2db57c73-80c0-4342-8b33-28db59e656a1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:09.892989 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2db57c73-80c0-4342-8b33-28db59e656a1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:09.893716 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2db57c73-80c0-4342-8b33-28db59e656a1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:09.894935 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2db57c73-80c0-4342-8b33-28db59e656a1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:09.895749 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2db57c73-80c0-4342-8b33-28db59e656a1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:10.032752 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2db57c73-80c0-4342-8b33-28db59e656a1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:36:10.042267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2db57c73-80c0-4342-8b33-28db59e656a1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.161262 Aug 04 23:36:10.042880 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 909/1792] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:36:09 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:36:11.064238 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ef6dd0eb-0f60-43b9-a52a-1266b5346a6c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:36:11.064918 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ef6dd0eb-0f60-43b9-a52a-1266b5346a6c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:36:11.071989 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef6dd0eb-0f60-43b9-a52a-1266b5346a6c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:11.072465 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef6dd0eb-0f60-43b9-a52a-1266b5346a6c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:11.072899 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef6dd0eb-0f60-43b9-a52a-1266b5346a6c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:11.073586 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef6dd0eb-0f60-43b9-a52a-1266b5346a6c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:11.074034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef6dd0eb-0f60-43b9-a52a-1266b5346a6c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:11.074484 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef6dd0eb-0f60-43b9-a52a-1266b5346a6c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:11.207621 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ef6dd0eb-0f60-43b9-a52a-1266b5346a6c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:36:11.215199 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ef6dd0eb-0f60-43b9-a52a-1266b5346a6c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.155191 Aug 04 23:36:11.215760 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 910/1793] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:36:11 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:36:12.235029 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4cb33e75-93c0-4bab-b528-67a42ce12e2a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:36:12.235749 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4cb33e75-93c0-4bab-b528-67a42ce12e2a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:36:12.242391 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cb33e75-93c0-4bab-b528-67a42ce12e2a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:12.242872 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cb33e75-93c0-4bab-b528-67a42ce12e2a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:12.243301 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cb33e75-93c0-4bab-b528-67a42ce12e2a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:12.243989 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cb33e75-93c0-4bab-b528-67a42ce12e2a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:12.244440 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cb33e75-93c0-4bab-b528-67a42ce12e2a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:12.244860 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cb33e75-93c0-4bab-b528-67a42ce12e2a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:12.276218 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=4 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:36:12.376742 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4cb33e75-93c0-4bab-b528-67a42ce12e2a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:36:12.385240 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4cb33e75-93c0-4bab-b528-67a42ce12e2a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.154173 Aug 04 23:36:12.385800 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 911/1794] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:36:12 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:36:13.407116 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b268e203-51f4-4e5c-9a7f-2ab84433e966 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:36:13.407810 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b268e203-51f4-4e5c-9a7f-2ab84433e966 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:36:13.414269 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b268e203-51f4-4e5c-9a7f-2ab84433e966 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:13.414786 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b268e203-51f4-4e5c-9a7f-2ab84433e966 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:13.415220 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b268e203-51f4-4e5c-9a7f-2ab84433e966 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:13.415911 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b268e203-51f4-4e5c-9a7f-2ab84433e966 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:13.416364 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b268e203-51f4-4e5c-9a7f-2ab84433e966 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:13.416786 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b268e203-51f4-4e5c-9a7f-2ab84433e966 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:13.420909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:36:13.561411 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b268e203-51f4-4e5c-9a7f-2ab84433e966 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:36:13.571262 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b268e203-51f4-4e5c-9a7f-2ab84433e966 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.167905 Aug 04 23:36:13.571835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 912/1795] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:36:13 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:36:14.592688 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-499aa60f-35ca-41a0-b9f3-219a05ab24d2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:36:14.593405 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-499aa60f-35ca-41a0-b9f3-219a05ab24d2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:36:14.600552 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-499aa60f-35ca-41a0-b9f3-219a05ab24d2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:14.601038 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-499aa60f-35ca-41a0-b9f3-219a05ab24d2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:14.601769 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-499aa60f-35ca-41a0-b9f3-219a05ab24d2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:14.602531 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-499aa60f-35ca-41a0-b9f3-219a05ab24d2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:14.602987 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-499aa60f-35ca-41a0-b9f3-219a05ab24d2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:14.603413 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-499aa60f-35ca-41a0-b9f3-219a05ab24d2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:14.742506 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-499aa60f-35ca-41a0-b9f3-219a05ab24d2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:36:14.750614 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-499aa60f-35ca-41a0-b9f3-219a05ab24d2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.161710 Aug 04 23:36:14.751198 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 913/1796] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:36:14 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:36:15.772841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-96f1d325-b3be-46cd-b46a-82b0cb6a9fd7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:36:15.773676 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-96f1d325-b3be-46cd-b46a-82b0cb6a9fd7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:36:15.782477 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-96f1d325-b3be-46cd-b46a-82b0cb6a9fd7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:15.783331 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-96f1d325-b3be-46cd-b46a-82b0cb6a9fd7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:15.784107 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-96f1d325-b3be-46cd-b46a-82b0cb6a9fd7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:15.785912 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-96f1d325-b3be-46cd-b46a-82b0cb6a9fd7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:15.786766 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-96f1d325-b3be-46cd-b46a-82b0cb6a9fd7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:15.787511 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-96f1d325-b3be-46cd-b46a-82b0cb6a9fd7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:15.963317 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-96f1d325-b3be-46cd-b46a-82b0cb6a9fd7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:36:15.970945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-96f1d325-b3be-46cd-b46a-82b0cb6a9fd7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.202391 Aug 04 23:36:15.971519 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 914/1797] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:36:15 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:36:16.646581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2cd5d1a4-211d-4952-bd25-7c104b3ab218 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:36:16.647110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2cd5d1a4-211d-4952-bd25-7c104b3ab218 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:36:16.653196 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2cd5d1a4-211d-4952-bd25-7c104b3ab218 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:16.653677 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2cd5d1a4-211d-4952-bd25-7c104b3ab218 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:16.654115 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2cd5d1a4-211d-4952-bd25-7c104b3ab218 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:16.654855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2cd5d1a4-211d-4952-bd25-7c104b3ab218 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:36:16.655312 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2cd5d1a4-211d-4952-bd25-7c104b3ab218 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:36:16.655742 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2cd5d1a4-211d-4952-bd25-7c104b3ab218 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:36:23.605288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:36:23.606067 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:36:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247/os-volume_attachments/5f345256-fed5-4b16-a195-56888e81102b (ip 10.222.0.33) !!! Aug 04 23:36:26.651408 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:36:26.675559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=20 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:37:09.523534 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:37:09.524296 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:37:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247/os-volume_attachments/5f345256-fed5-4b16-a195-56888e81102b (ip 10.222.0.33) !!! Aug 04 23:37:16.862963 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-a566098c-3ef8-4af3-a3d5-794dd5930331 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cb900f1c-fcc9-4182-8941-7de184da4b86) Aug 04 23:37:16.865293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a566098c-3ef8-4af3-a3d5-794dd5930331 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Request method failure captured: Aug 04 23:37:16.865293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: DELETE /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247/os-volume_attachments/5f345256-fed5-4b16-a195-56888e81102b HTTP/1.1 Aug 04 23:37:16.865293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:37:16.865293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:37:16.865293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:37:16.865293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 0 Aug 04 23:37:16.865293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:37:16.865293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:37:16.865293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:37:16.865293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:37:16.865293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FUYhX2TojNXAcA603ptQ9cSfNJYH-1IUoAk5kZ1Xhubg5tN0qtpjimLeaP4DiWFcLxH2g5RKdF89ROPd4N0_vnzOqa3rgLnlkGR2sYAQx46hu4JhEOZYCJsuiCjpxL8apQRiWT6nAtjhYZ6EKOCs_uZdEradeyWqviJYCWy4ptjup4 Aug 04 23:37:16.865293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:37:16.865293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:37:16.865293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:37:16.865293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:37:16.865293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:37:16.865293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:37:16.865293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: 53d297a325844e15bfc7ac1b305789a2 Aug 04 23:37:16.865293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1426913507 Aug 04 23:37:16.865293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:37:16.865293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:37:16.867223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d297a325844e15bfc7ac1b305789a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53d297a325844e15bfc7ac1b305789a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d297a325844e15bfc7ac1b305789a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53d297a325844e15bfc7ac1b305789a2"}]}] Aug 04 23:37:16.867223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-VolumesSnapshotTestJSON-1426913507 Aug 04 23:37:16.867223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: 53d297a325844e15bfc7ac1b305789a2 Aug 04 23:37:16.867223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1426913507 Aug 04 23:37:16.867223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-VolumesSnapshotTestJSON-1426913507-project Aug 04 23:37:16.867223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:37:16.867223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:37:16.867223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: 146d37206ef046fe98141e20a6835701 Aug 04 23:37:16.867223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-VolumesSnapshotTestJSON-1426913507-project Aug 04 23:37:16.867223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: > Aug 04 23:37:16.868389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cb900f1c-fcc9-4182-8941-7de184da4b86) Aug 04 23:37:16.868389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'server_id': 'c786164b-4aee-4a6a-9208-29f6ae31f247', 'id': '5f345256-fed5-4b16-a195-56888e81102b'} Aug 04 23:37:16.868389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:37:16.868389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:37:16.868389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 23:37:16.868389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 23:37:16.868389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 23:37:16.868389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 23:37:16.868389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 04 23:37:16.868389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 04 23:37:16.868389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 04 23:37:16.868389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 04 23:37:16.868389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 04 23:37:16.868389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 04 23:37:16.868389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 04 23:37:16.868389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 04 23:37:16.868389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:37:16.869837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:37:16.869837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:37:16.869837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:37:16.869837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cb900f1c-fcc9-4182-8941-7de184da4b86) Aug 04 23:37:16.869837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:37:16.869837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:37:16.869837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:37:16.869837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:37:16.869837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 04 23:37:16.869837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 04 23:37:16.869837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 04 23:37:16.869837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 04 23:37:16.869837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 23:37:16.869837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 23:37:16.869837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 23:37:16.869837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 23:37:16.869837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 23:37:16.869837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 23:37:16.869837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 04 23:37:16.871388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 04 23:37:16.871388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 04 23:37:16.871388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 04 23:37:16.871388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 04 23:37:16.871388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 04 23:37:16.871388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 04 23:37:16.871388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 04 23:37:16.871388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:37:16.871388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:37:16.871388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:37:16.871388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:37:16.871388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cb900f1c-fcc9-4182-8941-7de184da4b86) Aug 04 23:37:16.871388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:37:16.871388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:37:16.871388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:37:16.871388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:37:16.871388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 04 23:37:16.872873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 04 23:37:16.872873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 23:37:16.872873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 23:37:16.872873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 23:37:16.872873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 23:37:16.872873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 04 23:37:16.872873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 04 23:37:16.872873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 04 23:37:16.872873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 23:37:16.872873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 04 23:37:16.872873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 04 23:37:16.872873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cb900f1c-fcc9-4182-8941-7de184da4b86) Aug 04 23:37:16.872873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:37:16.872873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:37:16.872873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:37:16.872873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:37:16.872873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:37:16.872873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:37:16.874334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:37:16.874334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:37:16.874334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:37:16.874334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:37:16.874334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 04 23:37:16.874334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 23:37:16.874334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cb900f1c-fcc9-4182-8941-7de184da4b86) Aug 04 23:37:16.874334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:37:16.874334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:37:16.874334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:37:16.874334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:37:16.874334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:37:16.874334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:37:16.874334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:37:16.874334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:37:16.874334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cb900f1c-fcc9-4182-8941-7de184da4b86) Aug 04 23:37:16.874334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:37:16.875777 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a566098c-3ef8-4af3-a3d5-794dd5930331 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cb900f1c-fcc9-4182-8941-7de184da4b86) {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:37:16.875777 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a566098c-3ef8-4af3-a3d5-794dd5930331 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247/os-volume_attachments/5f345256-fed5-4b16-a195-56888e81102b" status: 400 len: 269 microversion: 2.1 time: 120.137012 Aug 04 23:37:16.875777 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 884/1798] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Aug 4 23:35:16 2022] DELETE /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247/os-volume_attachments/5f345256-fed5-4b16-a195-56888e81102b => generated 269 bytes in 120138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 23:37:16.875777 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-73e25d55-9de5-429a-a6a9-a4d14ff23fc1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:16.876153 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-73e25d55-9de5-429a-a6a9-a4d14ff23fc1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:16.882621 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-73e25d55-9de5-429a-a6a9-a4d14ff23fc1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:16.883111 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-73e25d55-9de5-429a-a6a9-a4d14ff23fc1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:16.883548 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-73e25d55-9de5-429a-a6a9-a4d14ff23fc1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:16.884245 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-73e25d55-9de5-429a-a6a9-a4d14ff23fc1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:16.884694 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-73e25d55-9de5-429a-a6a9-a4d14ff23fc1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:16.885114 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-73e25d55-9de5-429a-a6a9-a4d14ff23fc1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:17.022190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-73e25d55-9de5-429a-a6a9-a4d14ff23fc1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:17.029933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-73e25d55-9de5-429a-a6a9-a4d14ff23fc1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.161303 Aug 04 23:37:17.030764 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 885/1799] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:16 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:17.035497 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a83e3612-1ead-408b-8eea-5178fe965555 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:17.036035 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a83e3612-1ead-408b-8eea-5178fe965555 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:17.041799 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a83e3612-1ead-408b-8eea-5178fe965555 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:17.042275 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a83e3612-1ead-408b-8eea-5178fe965555 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:17.042805 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a83e3612-1ead-408b-8eea-5178fe965555 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:17.043434 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a83e3612-1ead-408b-8eea-5178fe965555 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:17.043868 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a83e3612-1ead-408b-8eea-5178fe965555 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:17.044286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a83e3612-1ead-408b-8eea-5178fe965555 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:17.155912 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.objects.instance [None req-2cd5d1a4-211d-4952-bd25-7c104b3ab218 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lazy-loading 'services' on Instance uuid c786164b-4aee-4a6a-9208-29f6ae31f247 {{(pid=129790) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:37:17.284022 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.objects.instance [None req-a83e3612-1ead-408b-8eea-5178fe965555 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lazy-loading 'services' on Instance uuid c786164b-4aee-4a6a-9208-29f6ae31f247 {{(pid=129791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 23:37:17.312781 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-2cd5d1a4-211d-4952-bd25-7c104b3ab218 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-75f8b9ee-9ca2-4ecf-a4ec-bf0238555140) Aug 04 23:37:17.315209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2cd5d1a4-211d-4952-bd25-7c104b3ab218 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Request method failure captured: Aug 04 23:37:17.315209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: DELETE /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247/os-volume_attachments/5f345256-fed5-4b16-a195-56888e81102b HTTP/1.1 Aug 04 23:37:17.315209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:37:17.315209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:37:17.315209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:37:17.315209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:37:17.315209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:37:17.315209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:37:17.315209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:37:17.315209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:37:17.315209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FUYhX2TojNXAcA603ptQ9cSfNJYH-1IUoAk5kZ1Xhubg5tN0qtpjimLeaP4DiWFcLxH2g5RKdF89ROPd4N0_vnzOqa3rgLnlkGR2sYAQx46hu4JhEOZYCJsuiCjpxL8apQRiWT6nAtjhYZ6EKOCs_uZdEradeyWqviJYCWy4ptjup4 Aug 04 23:37:17.315209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:37:17.315209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:37:17.315209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:37:17.315209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:37:17.315209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:37:17.315209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:37:17.315209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: 53d297a325844e15bfc7ac1b305789a2 Aug 04 23:37:17.315209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1426913507 Aug 04 23:37:17.315209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:37:17.315209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:37:17.317853 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d297a325844e15bfc7ac1b305789a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53d297a325844e15bfc7ac1b305789a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d297a325844e15bfc7ac1b305789a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53d297a325844e15bfc7ac1b305789a2"}]}] Aug 04 23:37:17.317853 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-VolumesSnapshotTestJSON-1426913507 Aug 04 23:37:17.317853 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: 53d297a325844e15bfc7ac1b305789a2 Aug 04 23:37:17.317853 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1426913507 Aug 04 23:37:17.317853 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-VolumesSnapshotTestJSON-1426913507-project Aug 04 23:37:17.317853 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:37:17.317853 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:37:17.317853 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: 146d37206ef046fe98141e20a6835701 Aug 04 23:37:17.317853 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-VolumesSnapshotTestJSON-1426913507-project Aug 04 23:37:17.317853 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:37:17.318833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-75f8b9ee-9ca2-4ecf-a4ec-bf0238555140) Aug 04 23:37:17.318833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'server_id': 'c786164b-4aee-4a6a-9208-29f6ae31f247', 'id': '5f345256-fed5-4b16-a195-56888e81102b'} Aug 04 23:37:17.318833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:37:17.318833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:37:17.318833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 23:37:17.318833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 23:37:17.318833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 23:37:17.318833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 23:37:17.318833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 04 23:37:17.318833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 04 23:37:17.318833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 04 23:37:17.318833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 04 23:37:17.318833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 04 23:37:17.318833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 04 23:37:17.318833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 04 23:37:17.318833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 04 23:37:17.318833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:37:17.319995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:37:17.319995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:37:17.319995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:37:17.319995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-75f8b9ee-9ca2-4ecf-a4ec-bf0238555140) Aug 04 23:37:17.319995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:37:17.319995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:37:17.319995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:37:17.319995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:37:17.319995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 04 23:37:17.319995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 04 23:37:17.319995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 04 23:37:17.319995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 04 23:37:17.319995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 23:37:17.319995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 23:37:17.319995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 23:37:17.319995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 23:37:17.319995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 23:37:17.319995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 23:37:17.319995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 04 23:37:17.321280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 04 23:37:17.321280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 04 23:37:17.321280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 04 23:37:17.321280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 04 23:37:17.321280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 04 23:37:17.321280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 04 23:37:17.321280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 04 23:37:17.321280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:37:17.321280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:37:17.321280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:37:17.321280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:37:17.321280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-75f8b9ee-9ca2-4ecf-a4ec-bf0238555140) Aug 04 23:37:17.321280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:37:17.321280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:37:17.321280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:37:17.321280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:37:17.321280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 04 23:37:17.322490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 04 23:37:17.322490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 23:37:17.322490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 23:37:17.322490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 23:37:17.322490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 23:37:17.322490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 04 23:37:17.322490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 04 23:37:17.322490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 04 23:37:17.322490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 23:37:17.322490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 04 23:37:17.322490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 04 23:37:17.322490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-75f8b9ee-9ca2-4ecf-a4ec-bf0238555140) Aug 04 23:37:17.322490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:37:17.322490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:37:17.322490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:37:17.322490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:37:17.322490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:37:17.322490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:37:17.323798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:37:17.323798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:37:17.323798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:37:17.323798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:37:17.323798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 04 23:37:17.323798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 23:37:17.323798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-75f8b9ee-9ca2-4ecf-a4ec-bf0238555140) Aug 04 23:37:17.323798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:37:17.323798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:37:17.323798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:37:17.323798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:37:17.323798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:37:17.323798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:37:17.323798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:37:17.323798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:37:17.323798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-75f8b9ee-9ca2-4ecf-a4ec-bf0238555140) Aug 04 23:37:17.323798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:37:17.324977 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2cd5d1a4-211d-4952-bd25-7c104b3ab218 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-75f8b9ee-9ca2-4ecf-a4ec-bf0238555140) {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:37:17.324977 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2cd5d1a4-211d-4952-bd25-7c104b3ab218 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247/os-volume_attachments/5f345256-fed5-4b16-a195-56888e81102b" status: 400 len: 269 microversion: 2.1 time: 60.674736 Aug 04 23:37:17.324977 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 915/1800] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Aug 4 23:36:16 2022] DELETE /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247/os-volume_attachments/5f345256-fed5-4b16-a195-56888e81102b => generated 269 bytes in 60676 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 23:37:17.385018 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-a83e3612-1ead-408b-8eea-5178fe965555 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb335725-a58d-40cf-bb07-e3d9d66d6533) Aug 04 23:37:17.387216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a83e3612-1ead-408b-8eea-5178fe965555 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Request method failure captured: Aug 04 23:37:17.387216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: DELETE /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247/os-volume_attachments/5f345256-fed5-4b16-a195-56888e81102b HTTP/1.1 Aug 04 23:37:17.387216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:37:17.387216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:37:17.387216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:37:17.387216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 0 Aug 04 23:37:17.387216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:37:17.387216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:37:17.387216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:37:17.387216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:37:17.387216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FUYhX2TojNXAcA603ptQ9cSfNJYH-1IUoAk5kZ1Xhubg5tN0qtpjimLeaP4DiWFcLxH2g5RKdF89ROPd4N0_vnzOqa3rgLnlkGR2sYAQx46hu4JhEOZYCJsuiCjpxL8apQRiWT6nAtjhYZ6EKOCs_uZdEradeyWqviJYCWy4ptjup4 Aug 04 23:37:17.387216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:37:17.387216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:37:17.387216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:37:17.387216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:37:17.387216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:37:17.387216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:37:17.387216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: 53d297a325844e15bfc7ac1b305789a2 Aug 04 23:37:17.387216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1426913507 Aug 04 23:37:17.387216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:37:17.387216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:37:17.388698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d297a325844e15bfc7ac1b305789a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53d297a325844e15bfc7ac1b305789a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d297a325844e15bfc7ac1b305789a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53d297a325844e15bfc7ac1b305789a2"}]}] Aug 04 23:37:17.388698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-VolumesSnapshotTestJSON-1426913507 Aug 04 23:37:17.388698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: 53d297a325844e15bfc7ac1b305789a2 Aug 04 23:37:17.388698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1426913507 Aug 04 23:37:17.388698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-VolumesSnapshotTestJSON-1426913507-project Aug 04 23:37:17.388698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:37:17.388698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:37:17.388698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: 146d37206ef046fe98141e20a6835701 Aug 04 23:37:17.388698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-VolumesSnapshotTestJSON-1426913507-project Aug 04 23:37:17.388698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: > Aug 04 23:37:17.389518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb335725-a58d-40cf-bb07-e3d9d66d6533) Aug 04 23:37:17.389518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'server_id': 'c786164b-4aee-4a6a-9208-29f6ae31f247', 'id': '5f345256-fed5-4b16-a195-56888e81102b'} Aug 04 23:37:17.389518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:37:17.389518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:37:17.389518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 23:37:17.389518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 23:37:17.389518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 23:37:17.389518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 23:37:17.389518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 04 23:37:17.389518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 04 23:37:17.389518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 04 23:37:17.389518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 04 23:37:17.389518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 04 23:37:17.389518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 04 23:37:17.389518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 04 23:37:17.389518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 04 23:37:17.389518 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:37:17.391077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:37:17.391077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:37:17.391077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:37:17.391077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb335725-a58d-40cf-bb07-e3d9d66d6533) Aug 04 23:37:17.391077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:37:17.391077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:37:17.391077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:37:17.391077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:37:17.391077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 04 23:37:17.391077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 04 23:37:17.391077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 04 23:37:17.391077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 04 23:37:17.391077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 23:37:17.391077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 23:37:17.391077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 23:37:17.391077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 23:37:17.391077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 23:37:17.391077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 23:37:17.391077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 04 23:37:17.392651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 04 23:37:17.392651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 04 23:37:17.392651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 04 23:37:17.392651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 04 23:37:17.392651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 04 23:37:17.392651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 04 23:37:17.392651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 04 23:37:17.392651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 23:37:17.392651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 23:37:17.392651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 23:37:17.392651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 23:37:17.392651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb335725-a58d-40cf-bb07-e3d9d66d6533) Aug 04 23:37:17.392651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:37:17.392651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:37:17.392651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:37:17.392651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:37:17.392651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 04 23:37:17.394136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 04 23:37:17.394136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 23:37:17.394136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 23:37:17.394136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 23:37:17.394136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 23:37:17.394136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 04 23:37:17.394136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 04 23:37:17.394136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 04 23:37:17.394136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 23:37:17.394136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 04 23:37:17.394136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 04 23:37:17.394136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb335725-a58d-40cf-bb07-e3d9d66d6533) Aug 04 23:37:17.394136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:37:17.394136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:37:17.394136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:37:17.394136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:37:17.394136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:37:17.394136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:37:17.395603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:37:17.395603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:37:17.395603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:37:17.395603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:37:17.395603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 04 23:37:17.395603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 23:37:17.395603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb335725-a58d-40cf-bb07-e3d9d66d6533) Aug 04 23:37:17.395603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:37:17.395603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:37:17.395603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:37:17.395603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:37:17.395603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:37:17.395603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:37:17.395603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:37:17.395603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:37:17.395603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb335725-a58d-40cf-bb07-e3d9d66d6533) Aug 04 23:37:17.395603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:37:17.397117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a83e3612-1ead-408b-8eea-5178fe965555 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb335725-a58d-40cf-bb07-e3d9d66d6533) {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:37:17.397117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a83e3612-1ead-408b-8eea-5178fe965555 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247/os-volume_attachments/5f345256-fed5-4b16-a195-56888e81102b" status: 400 len: 269 microversion: 2.1 time: 0.356930 Aug 04 23:37:17.397117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 886/1801] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Aug 4 23:37:17 2022] DELETE /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247/os-volume_attachments/5f345256-fed5-4b16-a195-56888e81102b => generated 269 bytes in 358 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 23:37:18.052797 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f2c9926c-5d21-48fa-a520-b7f6f85426c4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:18.053401 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f2c9926c-5d21-48fa-a520-b7f6f85426c4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:18.059744 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f2c9926c-5d21-48fa-a520-b7f6f85426c4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:18.060218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f2c9926c-5d21-48fa-a520-b7f6f85426c4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:18.060648 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f2c9926c-5d21-48fa-a520-b7f6f85426c4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:18.061337 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f2c9926c-5d21-48fa-a520-b7f6f85426c4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:18.061782 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f2c9926c-5d21-48fa-a520-b7f6f85426c4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:18.062198 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f2c9926c-5d21-48fa-a520-b7f6f85426c4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:18.197079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f2c9926c-5d21-48fa-a520-b7f6f85426c4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:18.204665 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f2c9926c-5d21-48fa-a520-b7f6f85426c4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.157264 Aug 04 23:37:18.205497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 916/1802] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:18 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:19.225783 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f99b7ebd-67d8-4849-bef1-dbac0238f8af tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:19.226436 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f99b7ebd-67d8-4849-bef1-dbac0238f8af tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:19.233087 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f99b7ebd-67d8-4849-bef1-dbac0238f8af tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:19.233568 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f99b7ebd-67d8-4849-bef1-dbac0238f8af tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:19.233997 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f99b7ebd-67d8-4849-bef1-dbac0238f8af tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:19.234716 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f99b7ebd-67d8-4849-bef1-dbac0238f8af tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:19.235179 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f99b7ebd-67d8-4849-bef1-dbac0238f8af tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:19.235602 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f99b7ebd-67d8-4849-bef1-dbac0238f8af tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:19.369411 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f99b7ebd-67d8-4849-bef1-dbac0238f8af tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:19.376883 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f99b7ebd-67d8-4849-bef1-dbac0238f8af tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.155624 Aug 04 23:37:19.377432 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 887/1803] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:19 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:20.397846 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b8f53d66-4e56-4b58-a0d2-c1370a66cb8b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:20.398482 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b8f53d66-4e56-4b58-a0d2-c1370a66cb8b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:20.405263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8f53d66-4e56-4b58-a0d2-c1370a66cb8b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:20.405800 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8f53d66-4e56-4b58-a0d2-c1370a66cb8b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:20.406440 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8f53d66-4e56-4b58-a0d2-c1370a66cb8b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:20.407159 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8f53d66-4e56-4b58-a0d2-c1370a66cb8b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:20.407695 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8f53d66-4e56-4b58-a0d2-c1370a66cb8b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:20.408158 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8f53d66-4e56-4b58-a0d2-c1370a66cb8b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:20.542756 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b8f53d66-4e56-4b58-a0d2-c1370a66cb8b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:20.551293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b8f53d66-4e56-4b58-a0d2-c1370a66cb8b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.157403 Aug 04 23:37:20.551864 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 917/1804] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:20 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:21.572346 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2f3a4c0c-03fd-46e6-8000-4ebb1da1fce8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:21.572957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2f3a4c0c-03fd-46e6-8000-4ebb1da1fce8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:21.579345 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f3a4c0c-03fd-46e6-8000-4ebb1da1fce8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:21.579822 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f3a4c0c-03fd-46e6-8000-4ebb1da1fce8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:21.580275 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f3a4c0c-03fd-46e6-8000-4ebb1da1fce8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:21.580938 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f3a4c0c-03fd-46e6-8000-4ebb1da1fce8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:21.581388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f3a4c0c-03fd-46e6-8000-4ebb1da1fce8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:21.581944 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2f3a4c0c-03fd-46e6-8000-4ebb1da1fce8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:21.721924 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2f3a4c0c-03fd-46e6-8000-4ebb1da1fce8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:21.729900 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2f3a4c0c-03fd-46e6-8000-4ebb1da1fce8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.161549 Aug 04 23:37:21.730475 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 888/1805] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:21 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:22.750997 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7a40c6d0-1904-478b-94c5-27d7df9dfdb7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:22.751630 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7a40c6d0-1904-478b-94c5-27d7df9dfdb7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:22.759089 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a40c6d0-1904-478b-94c5-27d7df9dfdb7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:22.759573 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a40c6d0-1904-478b-94c5-27d7df9dfdb7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:22.760014 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a40c6d0-1904-478b-94c5-27d7df9dfdb7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:22.760695 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a40c6d0-1904-478b-94c5-27d7df9dfdb7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:22.761145 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a40c6d0-1904-478b-94c5-27d7df9dfdb7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:22.761567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a40c6d0-1904-478b-94c5-27d7df9dfdb7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:22.894703 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7a40c6d0-1904-478b-94c5-27d7df9dfdb7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:22.902616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7a40c6d0-1904-478b-94c5-27d7df9dfdb7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.155487 Aug 04 23:37:22.903194 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 918/1806] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:22 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:23.924387 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-20be7961-d4d6-40dd-9240-912cbbd90222 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:23.925018 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-20be7961-d4d6-40dd-9240-912cbbd90222 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:23.931150 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20be7961-d4d6-40dd-9240-912cbbd90222 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:23.931673 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20be7961-d4d6-40dd-9240-912cbbd90222 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:23.932097 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20be7961-d4d6-40dd-9240-912cbbd90222 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:23.933047 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20be7961-d4d6-40dd-9240-912cbbd90222 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:23.933498 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20be7961-d4d6-40dd-9240-912cbbd90222 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:23.933915 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20be7961-d4d6-40dd-9240-912cbbd90222 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:24.076467 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-20be7961-d4d6-40dd-9240-912cbbd90222 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:24.084561 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-20be7961-d4d6-40dd-9240-912cbbd90222 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.164225 Aug 04 23:37:24.085123 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 889/1807] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:23 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:25.104816 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-597f77e4-bfd6-40ac-9fbe-edc22e67dce4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:25.105365 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-597f77e4-bfd6-40ac-9fbe-edc22e67dce4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:25.111648 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-597f77e4-bfd6-40ac-9fbe-edc22e67dce4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:25.112129 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-597f77e4-bfd6-40ac-9fbe-edc22e67dce4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:25.112677 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-597f77e4-bfd6-40ac-9fbe-edc22e67dce4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:25.113449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-597f77e4-bfd6-40ac-9fbe-edc22e67dce4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:25.113903 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-597f77e4-bfd6-40ac-9fbe-edc22e67dce4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:25.114330 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-597f77e4-bfd6-40ac-9fbe-edc22e67dce4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:25.244152 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-597f77e4-bfd6-40ac-9fbe-edc22e67dce4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:25.251582 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-597f77e4-bfd6-40ac-9fbe-edc22e67dce4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.150786 Aug 04 23:37:25.252128 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 919/1808] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:25 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:26.273026 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0562541f-8af3-4261-b70c-ee6f5187a85f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:26.273583 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0562541f-8af3-4261-b70c-ee6f5187a85f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:26.280095 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0562541f-8af3-4261-b70c-ee6f5187a85f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:26.280580 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0562541f-8af3-4261-b70c-ee6f5187a85f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:26.281014 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0562541f-8af3-4261-b70c-ee6f5187a85f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:26.281707 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0562541f-8af3-4261-b70c-ee6f5187a85f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:26.282160 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0562541f-8af3-4261-b70c-ee6f5187a85f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:26.282632 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0562541f-8af3-4261-b70c-ee6f5187a85f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:26.413922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0562541f-8af3-4261-b70c-ee6f5187a85f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:26.421535 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0562541f-8af3-4261-b70c-ee6f5187a85f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.152495 Aug 04 23:37:26.422115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 890/1809] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:26 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:27.443310 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-fd6a5c6f-5a42-4fce-9f79-4467adbda07d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:27.443915 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-fd6a5c6f-5a42-4fce-9f79-4467adbda07d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:27.450882 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fd6a5c6f-5a42-4fce-9f79-4467adbda07d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:27.451360 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fd6a5c6f-5a42-4fce-9f79-4467adbda07d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:27.451795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fd6a5c6f-5a42-4fce-9f79-4467adbda07d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:27.452487 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fd6a5c6f-5a42-4fce-9f79-4467adbda07d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:27.452934 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fd6a5c6f-5a42-4fce-9f79-4467adbda07d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:27.453353 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fd6a5c6f-5a42-4fce-9f79-4467adbda07d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:27.594698 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-fd6a5c6f-5a42-4fce-9f79-4467adbda07d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:27.604506 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-fd6a5c6f-5a42-4fce-9f79-4467adbda07d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.165720 Aug 04 23:37:27.605123 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 920/1810] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:27 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:28.625079 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-334e8732-77e7-4ce8-a075-b10ff90ac57b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:28.625669 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-334e8732-77e7-4ce8-a075-b10ff90ac57b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:28.632759 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-334e8732-77e7-4ce8-a075-b10ff90ac57b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:28.633237 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-334e8732-77e7-4ce8-a075-b10ff90ac57b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:28.633664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-334e8732-77e7-4ce8-a075-b10ff90ac57b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:28.634354 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-334e8732-77e7-4ce8-a075-b10ff90ac57b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:28.634818 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-334e8732-77e7-4ce8-a075-b10ff90ac57b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:28.635235 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-334e8732-77e7-4ce8-a075-b10ff90ac57b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:28.765619 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-334e8732-77e7-4ce8-a075-b10ff90ac57b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:28.773834 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-334e8732-77e7-4ce8-a075-b10ff90ac57b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.152593 Aug 04 23:37:28.774428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 891/1811] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:28 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:29.795103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4d71df2d-8ac1-4b52-873d-8522a4ee8bd0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:29.795717 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4d71df2d-8ac1-4b52-873d-8522a4ee8bd0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:29.802946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4d71df2d-8ac1-4b52-873d-8522a4ee8bd0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:29.803429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4d71df2d-8ac1-4b52-873d-8522a4ee8bd0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:29.803859 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4d71df2d-8ac1-4b52-873d-8522a4ee8bd0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:29.804545 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4d71df2d-8ac1-4b52-873d-8522a4ee8bd0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:29.804994 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4d71df2d-8ac1-4b52-873d-8522a4ee8bd0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:29.805413 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4d71df2d-8ac1-4b52-873d-8522a4ee8bd0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:29.941584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4d71df2d-8ac1-4b52-873d-8522a4ee8bd0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:29.949251 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4d71df2d-8ac1-4b52-873d-8522a4ee8bd0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.158037 Aug 04 23:37:29.949819 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 921/1812] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:29 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:30.971172 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-404a0069-6245-40d0-b8ce-44d74f238310 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:30.972459 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-404a0069-6245-40d0-b8ce-44d74f238310 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:30.979036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-404a0069-6245-40d0-b8ce-44d74f238310 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:30.979499 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-404a0069-6245-40d0-b8ce-44d74f238310 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:30.979933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-404a0069-6245-40d0-b8ce-44d74f238310 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:30.980654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-404a0069-6245-40d0-b8ce-44d74f238310 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:30.981107 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-404a0069-6245-40d0-b8ce-44d74f238310 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:30.981533 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-404a0069-6245-40d0-b8ce-44d74f238310 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:31.114823 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-404a0069-6245-40d0-b8ce-44d74f238310 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:31.122352 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-404a0069-6245-40d0-b8ce-44d74f238310 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.155058 Aug 04 23:37:31.122945 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 892/1813] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:30 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:32.143297 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-279cba1c-71aa-407d-ae83-b57a60a62ec7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:32.144123 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-279cba1c-71aa-407d-ae83-b57a60a62ec7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:32.150813 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-279cba1c-71aa-407d-ae83-b57a60a62ec7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:32.151299 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-279cba1c-71aa-407d-ae83-b57a60a62ec7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:32.151723 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-279cba1c-71aa-407d-ae83-b57a60a62ec7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:32.152406 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-279cba1c-71aa-407d-ae83-b57a60a62ec7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:32.152849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-279cba1c-71aa-407d-ae83-b57a60a62ec7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:32.153263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-279cba1c-71aa-407d-ae83-b57a60a62ec7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:32.285567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-279cba1c-71aa-407d-ae83-b57a60a62ec7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:32.293120 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-279cba1c-71aa-407d-ae83-b57a60a62ec7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.153772 Aug 04 23:37:32.293676 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 922/1814] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:32 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:33.314499 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e0370cd8-3819-4149-9b27-a4c8a26b57e5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:33.315114 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e0370cd8-3819-4149-9b27-a4c8a26b57e5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:33.321931 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0370cd8-3819-4149-9b27-a4c8a26b57e5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:33.322447 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0370cd8-3819-4149-9b27-a4c8a26b57e5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:33.322890 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0370cd8-3819-4149-9b27-a4c8a26b57e5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:33.323618 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0370cd8-3819-4149-9b27-a4c8a26b57e5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:33.324071 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0370cd8-3819-4149-9b27-a4c8a26b57e5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:33.324492 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0370cd8-3819-4149-9b27-a4c8a26b57e5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:33.464476 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e0370cd8-3819-4149-9b27-a4c8a26b57e5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:33.472444 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e0370cd8-3819-4149-9b27-a4c8a26b57e5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.161573 Aug 04 23:37:33.473061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 893/1815] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:33 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:34.493862 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-17ec0e16-0b26-4bb3-b504-4602a1a6f6b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:34.494509 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-17ec0e16-0b26-4bb3-b504-4602a1a6f6b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:34.501044 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17ec0e16-0b26-4bb3-b504-4602a1a6f6b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:34.501524 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17ec0e16-0b26-4bb3-b504-4602a1a6f6b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:34.501963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17ec0e16-0b26-4bb3-b504-4602a1a6f6b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:34.502742 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17ec0e16-0b26-4bb3-b504-4602a1a6f6b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:34.503199 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17ec0e16-0b26-4bb3-b504-4602a1a6f6b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:34.503624 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17ec0e16-0b26-4bb3-b504-4602a1a6f6b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:34.637032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-17ec0e16-0b26-4bb3-b504-4602a1a6f6b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:34.645784 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-17ec0e16-0b26-4bb3-b504-4602a1a6f6b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.155751 Aug 04 23:37:34.646399 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 923/1816] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:34 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:35.668456 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4e872b38-ce91-463b-a866-25d06a3e7982 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:35.669076 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4e872b38-ce91-463b-a866-25d06a3e7982 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:35.676399 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4e872b38-ce91-463b-a866-25d06a3e7982 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:35.676880 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4e872b38-ce91-463b-a866-25d06a3e7982 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:35.677309 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4e872b38-ce91-463b-a866-25d06a3e7982 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:35.677996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4e872b38-ce91-463b-a866-25d06a3e7982 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:35.678465 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4e872b38-ce91-463b-a866-25d06a3e7982 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:35.678879 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4e872b38-ce91-463b-a866-25d06a3e7982 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:35.819206 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4e872b38-ce91-463b-a866-25d06a3e7982 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:35.826777 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4e872b38-ce91-463b-a866-25d06a3e7982 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.162301 Aug 04 23:37:35.827354 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 894/1817] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:35 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:36.847375 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5c2e1e45-2c7a-4396-b4d1-b3818962e562 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:36.847985 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5c2e1e45-2c7a-4396-b4d1-b3818962e562 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:36.854383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c2e1e45-2c7a-4396-b4d1-b3818962e562 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:36.854874 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c2e1e45-2c7a-4396-b4d1-b3818962e562 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:36.855309 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c2e1e45-2c7a-4396-b4d1-b3818962e562 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:36.855995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c2e1e45-2c7a-4396-b4d1-b3818962e562 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:36.856458 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c2e1e45-2c7a-4396-b4d1-b3818962e562 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:36.856871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c2e1e45-2c7a-4396-b4d1-b3818962e562 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:36.990978 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5c2e1e45-2c7a-4396-b4d1-b3818962e562 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:36.999060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5c2e1e45-2c7a-4396-b4d1-b3818962e562 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.155686 Aug 04 23:37:36.999692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 924/1818] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:36 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:38.020244 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-16414ca8-492f-41e2-aeb0-3999e60a2ac4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:38.020893 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-16414ca8-492f-41e2-aeb0-3999e60a2ac4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:38.027181 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-16414ca8-492f-41e2-aeb0-3999e60a2ac4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:38.027659 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-16414ca8-492f-41e2-aeb0-3999e60a2ac4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:38.028093 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-16414ca8-492f-41e2-aeb0-3999e60a2ac4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:38.028787 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-16414ca8-492f-41e2-aeb0-3999e60a2ac4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:38.029242 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-16414ca8-492f-41e2-aeb0-3999e60a2ac4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:38.029663 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-16414ca8-492f-41e2-aeb0-3999e60a2ac4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:38.164097 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-16414ca8-492f-41e2-aeb0-3999e60a2ac4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:38.171719 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-16414ca8-492f-41e2-aeb0-3999e60a2ac4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.155559 Aug 04 23:37:38.172285 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 895/1819] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:38 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:39.194418 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f6ba36db-c848-4866-a288-4f7331afcdcc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:39.195036 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f6ba36db-c848-4866-a288-4f7331afcdcc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:39.201860 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f6ba36db-c848-4866-a288-4f7331afcdcc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:39.202339 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f6ba36db-c848-4866-a288-4f7331afcdcc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:39.202924 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f6ba36db-c848-4866-a288-4f7331afcdcc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:39.203622 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f6ba36db-c848-4866-a288-4f7331afcdcc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:39.204068 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f6ba36db-c848-4866-a288-4f7331afcdcc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:39.204492 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f6ba36db-c848-4866-a288-4f7331afcdcc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:39.339795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f6ba36db-c848-4866-a288-4f7331afcdcc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:39.347968 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f6ba36db-c848-4866-a288-4f7331afcdcc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.158541 Aug 04 23:37:39.348536 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 925/1820] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:39 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:40.369080 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-041023a9-24bb-4145-8d49-d175f860c2e3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:40.369672 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-041023a9-24bb-4145-8d49-d175f860c2e3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:40.376124 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-041023a9-24bb-4145-8d49-d175f860c2e3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:40.376595 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-041023a9-24bb-4145-8d49-d175f860c2e3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:40.377074 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-041023a9-24bb-4145-8d49-d175f860c2e3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:40.377764 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-041023a9-24bb-4145-8d49-d175f860c2e3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:40.378207 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-041023a9-24bb-4145-8d49-d175f860c2e3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:40.378667 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-041023a9-24bb-4145-8d49-d175f860c2e3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:40.512529 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-041023a9-24bb-4145-8d49-d175f860c2e3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:40.520102 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-041023a9-24bb-4145-8d49-d175f860c2e3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.154929 Aug 04 23:37:40.520670 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 896/1821] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:40 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:41.540796 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3334789f-0523-46c4-b18d-cbfb268db948 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:41.541396 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3334789f-0523-46c4-b18d-cbfb268db948 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:41.547879 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3334789f-0523-46c4-b18d-cbfb268db948 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:41.548369 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3334789f-0523-46c4-b18d-cbfb268db948 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:41.548804 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3334789f-0523-46c4-b18d-cbfb268db948 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:41.550209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3334789f-0523-46c4-b18d-cbfb268db948 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:41.550705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3334789f-0523-46c4-b18d-cbfb268db948 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:41.551126 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3334789f-0523-46c4-b18d-cbfb268db948 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:41.694992 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3334789f-0523-46c4-b18d-cbfb268db948 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:41.702625 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3334789f-0523-46c4-b18d-cbfb268db948 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.165686 Aug 04 23:37:41.703187 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 926/1822] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:41 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:42.725276 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9f8880e9-c40e-4576-8ab2-c361b4ed1f5c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:42.725885 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9f8880e9-c40e-4576-8ab2-c361b4ed1f5c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:42.732495 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9f8880e9-c40e-4576-8ab2-c361b4ed1f5c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:42.732964 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9f8880e9-c40e-4576-8ab2-c361b4ed1f5c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:42.733388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9f8880e9-c40e-4576-8ab2-c361b4ed1f5c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:42.734066 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9f8880e9-c40e-4576-8ab2-c361b4ed1f5c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:42.734546 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9f8880e9-c40e-4576-8ab2-c361b4ed1f5c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:42.734962 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9f8880e9-c40e-4576-8ab2-c361b4ed1f5c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:42.740237 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=75 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:37:42.872444 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9f8880e9-c40e-4576-8ab2-c361b4ed1f5c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:42.880579 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9f8880e9-c40e-4576-8ab2-c361b4ed1f5c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.160733 Aug 04 23:37:42.881165 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 897/1823] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:42 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:43.902485 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-57fdc2a8-90cb-4e2d-8d34-f08a8a870e7e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:43.903090 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-57fdc2a8-90cb-4e2d-8d34-f08a8a870e7e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:43.909902 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57fdc2a8-90cb-4e2d-8d34-f08a8a870e7e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:43.910395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57fdc2a8-90cb-4e2d-8d34-f08a8a870e7e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:43.910835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57fdc2a8-90cb-4e2d-8d34-f08a8a870e7e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:43.911515 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57fdc2a8-90cb-4e2d-8d34-f08a8a870e7e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:43.911961 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57fdc2a8-90cb-4e2d-8d34-f08a8a870e7e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:43.912380 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57fdc2a8-90cb-4e2d-8d34-f08a8a870e7e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:44.054799 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-57fdc2a8-90cb-4e2d-8d34-f08a8a870e7e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:44.062476 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-57fdc2a8-90cb-4e2d-8d34-f08a8a870e7e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.163956 Aug 04 23:37:44.063044 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 927/1824] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:43 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:45.084031 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2c22bb4f-404d-4114-87a9-5f70dc547d66 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:45.084623 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2c22bb4f-404d-4114-87a9-5f70dc547d66 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:45.091224 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c22bb4f-404d-4114-87a9-5f70dc547d66 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:45.091648 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c22bb4f-404d-4114-87a9-5f70dc547d66 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:45.092178 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c22bb4f-404d-4114-87a9-5f70dc547d66 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:45.092807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c22bb4f-404d-4114-87a9-5f70dc547d66 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:45.093257 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c22bb4f-404d-4114-87a9-5f70dc547d66 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:45.093678 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c22bb4f-404d-4114-87a9-5f70dc547d66 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:45.226794 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2c22bb4f-404d-4114-87a9-5f70dc547d66 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:45.234645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2c22bb4f-404d-4114-87a9-5f70dc547d66 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.155093 Aug 04 23:37:45.235224 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 898/1825] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:45 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:46.256113 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-074edb45-7ee8-44a8-83a1-1ea069aa4a4e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:46.256713 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-074edb45-7ee8-44a8-83a1-1ea069aa4a4e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:46.263258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-074edb45-7ee8-44a8-83a1-1ea069aa4a4e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:46.263741 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-074edb45-7ee8-44a8-83a1-1ea069aa4a4e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:46.264175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-074edb45-7ee8-44a8-83a1-1ea069aa4a4e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:46.264929 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-074edb45-7ee8-44a8-83a1-1ea069aa4a4e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:46.265382 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-074edb45-7ee8-44a8-83a1-1ea069aa4a4e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:46.265802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-074edb45-7ee8-44a8-83a1-1ea069aa4a4e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:46.503785 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-074edb45-7ee8-44a8-83a1-1ea069aa4a4e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:46.511312 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-074edb45-7ee8-44a8-83a1-1ea069aa4a4e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.259081 Aug 04 23:37:46.511799 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 928/1826] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:46 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:47.531901 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8e094ba8-9cf4-4e1d-897b-24d8b0727b7f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:47.532496 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8e094ba8-9cf4-4e1d-897b-24d8b0727b7f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:47.534888 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=29 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:37:47.539999 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e094ba8-9cf4-4e1d-897b-24d8b0727b7f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:47.540476 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e094ba8-9cf4-4e1d-897b-24d8b0727b7f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:47.540907 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e094ba8-9cf4-4e1d-897b-24d8b0727b7f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:47.541598 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e094ba8-9cf4-4e1d-897b-24d8b0727b7f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:47.542048 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e094ba8-9cf4-4e1d-897b-24d8b0727b7f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:47.542492 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e094ba8-9cf4-4e1d-897b-24d8b0727b7f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:47.737538 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8e094ba8-9cf4-4e1d-897b-24d8b0727b7f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:47.745848 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8e094ba8-9cf4-4e1d-897b-24d8b0727b7f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.217798 Aug 04 23:37:47.746468 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 899/1827] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:47 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:37:48.767636 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2fcd18a6-09ce-484b-98d4-1e2d9f357dad tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:48.768446 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2fcd18a6-09ce-484b-98d4-1e2d9f357dad tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:48.770631 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=27 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:37:48.776023 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fcd18a6-09ce-484b-98d4-1e2d9f357dad tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:48.776512 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fcd18a6-09ce-484b-98d4-1e2d9f357dad tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:48.776947 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fcd18a6-09ce-484b-98d4-1e2d9f357dad tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:48.777643 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fcd18a6-09ce-484b-98d4-1e2d9f357dad tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:48.778092 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fcd18a6-09ce-484b-98d4-1e2d9f357dad tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:48.778544 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fcd18a6-09ce-484b-98d4-1e2d9f357dad tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:48.781224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=83 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:37:48.915525 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2fcd18a6-09ce-484b-98d4-1e2d9f357dad tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:48.923047 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2fcd18a6-09ce-484b-98d4-1e2d9f357dad tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.159278 Aug 04 23:37:48.923611 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 929/1828] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:48 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:49.943280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-117aeb1c-90c8-4352-9db8-d0d10bb5a4ca tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:49.944061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-117aeb1c-90c8-4352-9db8-d0d10bb5a4ca tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:49.952131 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-117aeb1c-90c8-4352-9db8-d0d10bb5a4ca tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:49.952618 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-117aeb1c-90c8-4352-9db8-d0d10bb5a4ca tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:49.953052 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-117aeb1c-90c8-4352-9db8-d0d10bb5a4ca tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:49.953773 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-117aeb1c-90c8-4352-9db8-d0d10bb5a4ca tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:49.954223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-117aeb1c-90c8-4352-9db8-d0d10bb5a4ca tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:49.954679 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-117aeb1c-90c8-4352-9db8-d0d10bb5a4ca tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:50.126748 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-117aeb1c-90c8-4352-9db8-d0d10bb5a4ca tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:50.135700 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-117aeb1c-90c8-4352-9db8-d0d10bb5a4ca tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.196225 Aug 04 23:37:50.136280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 900/1829] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:49 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:51.157305 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a460d8bd-6205-4546-822c-9f6bb5f3d10f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:51.157939 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a460d8bd-6205-4546-822c-9f6bb5f3d10f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:51.164788 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a460d8bd-6205-4546-822c-9f6bb5f3d10f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:51.165259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a460d8bd-6205-4546-822c-9f6bb5f3d10f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:51.165687 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a460d8bd-6205-4546-822c-9f6bb5f3d10f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:51.166384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a460d8bd-6205-4546-822c-9f6bb5f3d10f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:51.166872 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a460d8bd-6205-4546-822c-9f6bb5f3d10f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:51.167289 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a460d8bd-6205-4546-822c-9f6bb5f3d10f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:51.301009 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a460d8bd-6205-4546-822c-9f6bb5f3d10f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:51.308849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a460d8bd-6205-4546-822c-9f6bb5f3d10f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.155481 Aug 04 23:37:51.309404 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 930/1830] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:51 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:52.331689 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7515282d-4708-4c17-8b2b-a6658b174a21 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:52.332285 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7515282d-4708-4c17-8b2b-a6658b174a21 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:52.338375 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7515282d-4708-4c17-8b2b-a6658b174a21 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:52.338862 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7515282d-4708-4c17-8b2b-a6658b174a21 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:52.339294 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7515282d-4708-4c17-8b2b-a6658b174a21 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:52.339977 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7515282d-4708-4c17-8b2b-a6658b174a21 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:52.340431 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7515282d-4708-4c17-8b2b-a6658b174a21 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:52.340851 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7515282d-4708-4c17-8b2b-a6658b174a21 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:52.474661 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7515282d-4708-4c17-8b2b-a6658b174a21 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:52.482174 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7515282d-4708-4c17-8b2b-a6658b174a21 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.155104 Aug 04 23:37:52.482870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 901/1831] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:52 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:53.504032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d586b998-f3a6-4a73-b8c6-00021a6302e0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:53.504639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d586b998-f3a6-4a73-b8c6-00021a6302e0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:53.511089 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d586b998-f3a6-4a73-b8c6-00021a6302e0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:53.511571 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d586b998-f3a6-4a73-b8c6-00021a6302e0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:53.512006 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d586b998-f3a6-4a73-b8c6-00021a6302e0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:53.512705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d586b998-f3a6-4a73-b8c6-00021a6302e0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:53.513161 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d586b998-f3a6-4a73-b8c6-00021a6302e0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:53.513589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d586b998-f3a6-4a73-b8c6-00021a6302e0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:53.646968 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d586b998-f3a6-4a73-b8c6-00021a6302e0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:53.654651 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d586b998-f3a6-4a73-b8c6-00021a6302e0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.154437 Aug 04 23:37:53.655226 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 931/1832] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:53 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:54.676376 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f722147f-4917-416b-9996-3d1d522170ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:54.677015 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f722147f-4917-416b-9996-3d1d522170ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:54.683724 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f722147f-4917-416b-9996-3d1d522170ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:54.684202 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f722147f-4917-416b-9996-3d1d522170ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:54.684635 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f722147f-4917-416b-9996-3d1d522170ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:54.685327 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f722147f-4917-416b-9996-3d1d522170ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:54.685776 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f722147f-4917-416b-9996-3d1d522170ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:54.686197 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f722147f-4917-416b-9996-3d1d522170ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:54.818807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f722147f-4917-416b-9996-3d1d522170ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:54.826410 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f722147f-4917-416b-9996-3d1d522170ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.154069 Aug 04 23:37:54.826985 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 902/1833] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:54 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:55.848407 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2037cd77-3e35-4ca8-8b58-acece92c46be tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:55.849022 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2037cd77-3e35-4ca8-8b58-acece92c46be tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:55.855318 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2037cd77-3e35-4ca8-8b58-acece92c46be tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:55.855797 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2037cd77-3e35-4ca8-8b58-acece92c46be tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:55.856230 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2037cd77-3e35-4ca8-8b58-acece92c46be tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:55.856914 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2037cd77-3e35-4ca8-8b58-acece92c46be tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:55.857367 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2037cd77-3e35-4ca8-8b58-acece92c46be tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:55.857786 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2037cd77-3e35-4ca8-8b58-acece92c46be tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:55.996488 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2037cd77-3e35-4ca8-8b58-acece92c46be tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:56.005570 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2037cd77-3e35-4ca8-8b58-acece92c46be tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.160955 Aug 04 23:37:56.006152 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 932/1834] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:55 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:57.026596 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-564204d6-c0d3-449d-b6e5-a83fc11b6a61 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:57.027208 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-564204d6-c0d3-449d-b6e5-a83fc11b6a61 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:57.033615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-564204d6-c0d3-449d-b6e5-a83fc11b6a61 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:57.034093 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-564204d6-c0d3-449d-b6e5-a83fc11b6a61 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:57.034563 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-564204d6-c0d3-449d-b6e5-a83fc11b6a61 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:57.035250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-564204d6-c0d3-449d-b6e5-a83fc11b6a61 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:57.035697 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-564204d6-c0d3-449d-b6e5-a83fc11b6a61 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:57.036116 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-564204d6-c0d3-449d-b6e5-a83fc11b6a61 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:57.167068 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-564204d6-c0d3-449d-b6e5-a83fc11b6a61 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:57.175517 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-564204d6-c0d3-449d-b6e5-a83fc11b6a61 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.152817 Aug 04 23:37:57.176120 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 903/1835] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:57 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:58.196769 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-86eca64e-74aa-4194-b265-1ae0cbd25471 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:58.197353 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-86eca64e-74aa-4194-b265-1ae0cbd25471 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:58.203934 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86eca64e-74aa-4194-b265-1ae0cbd25471 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:58.205158 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86eca64e-74aa-4194-b265-1ae0cbd25471 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:58.205639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86eca64e-74aa-4194-b265-1ae0cbd25471 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:58.206308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86eca64e-74aa-4194-b265-1ae0cbd25471 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:58.206788 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86eca64e-74aa-4194-b265-1ae0cbd25471 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:58.207218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-86eca64e-74aa-4194-b265-1ae0cbd25471 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:58.343287 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-86eca64e-74aa-4194-b265-1ae0cbd25471 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:58.351104 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-86eca64e-74aa-4194-b265-1ae0cbd25471 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.158421 Aug 04 23:37:58.351663 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 933/1836] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:58 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:37:59.372576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5499cf8a-dff8-454f-8aff-873ed13176c4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:37:59.373215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5499cf8a-dff8-454f-8aff-873ed13176c4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:37:59.379770 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5499cf8a-dff8-454f-8aff-873ed13176c4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:59.380248 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5499cf8a-dff8-454f-8aff-873ed13176c4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:59.380682 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5499cf8a-dff8-454f-8aff-873ed13176c4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:59.381371 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5499cf8a-dff8-454f-8aff-873ed13176c4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:37:59.381818 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5499cf8a-dff8-454f-8aff-873ed13176c4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:37:59.382237 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5499cf8a-dff8-454f-8aff-873ed13176c4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:37:59.513033 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5499cf8a-dff8-454f-8aff-873ed13176c4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:37:59.521247 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5499cf8a-dff8-454f-8aff-873ed13176c4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.152564 Aug 04 23:37:59.521800 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 904/1837] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:37:59 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:00.542386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-462d1e60-8f68-4cfa-9990-ef6d38094734 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:00.543107 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-462d1e60-8f68-4cfa-9990-ef6d38094734 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:00.552963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-462d1e60-8f68-4cfa-9990-ef6d38094734 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:00.553443 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-462d1e60-8f68-4cfa-9990-ef6d38094734 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:00.553878 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-462d1e60-8f68-4cfa-9990-ef6d38094734 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:00.554603 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-462d1e60-8f68-4cfa-9990-ef6d38094734 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:00.555045 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-462d1e60-8f68-4cfa-9990-ef6d38094734 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:00.555461 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-462d1e60-8f68-4cfa-9990-ef6d38094734 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:00.688896 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-462d1e60-8f68-4cfa-9990-ef6d38094734 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:00.696481 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-462d1e60-8f68-4cfa-9990-ef6d38094734 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.157904 Aug 04 23:38:00.697049 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 934/1838] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:00 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:01.717244 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4a636ac4-69a8-466a-9cd9-0c0fe9ea99f3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:01.717859 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4a636ac4-69a8-466a-9cd9-0c0fe9ea99f3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:01.724814 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4a636ac4-69a8-466a-9cd9-0c0fe9ea99f3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:01.725291 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4a636ac4-69a8-466a-9cd9-0c0fe9ea99f3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:01.725715 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4a636ac4-69a8-466a-9cd9-0c0fe9ea99f3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:01.726416 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4a636ac4-69a8-466a-9cd9-0c0fe9ea99f3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:01.726863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4a636ac4-69a8-466a-9cd9-0c0fe9ea99f3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:01.727278 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4a636ac4-69a8-466a-9cd9-0c0fe9ea99f3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:01.864179 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4a636ac4-69a8-466a-9cd9-0c0fe9ea99f3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:01.872598 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4a636ac4-69a8-466a-9cd9-0c0fe9ea99f3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.159212 Aug 04 23:38:01.873167 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 905/1839] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:01 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:02.894007 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-650be62b-be94-4e9c-9b33-1226a40ab4b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:02.894645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-650be62b-be94-4e9c-9b33-1226a40ab4b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:02.901021 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-650be62b-be94-4e9c-9b33-1226a40ab4b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:02.901498 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-650be62b-be94-4e9c-9b33-1226a40ab4b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:02.901931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-650be62b-be94-4e9c-9b33-1226a40ab4b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:02.902649 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-650be62b-be94-4e9c-9b33-1226a40ab4b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:02.903095 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-650be62b-be94-4e9c-9b33-1226a40ab4b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:02.903517 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-650be62b-be94-4e9c-9b33-1226a40ab4b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:03.035876 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-650be62b-be94-4e9c-9b33-1226a40ab4b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:03.043741 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-650be62b-be94-4e9c-9b33-1226a40ab4b8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.154213 Aug 04 23:38:03.044342 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 935/1840] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:02 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:03.427617 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:38:03.428233 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:38:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:38:04.065492 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9df4c9ab-64b1-4d84-9765-c460a7be2605 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:04.066002 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9df4c9ab-64b1-4d84-9765-c460a7be2605 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:04.080090 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9df4c9ab-64b1-4d84-9765-c460a7be2605 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:04.080573 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9df4c9ab-64b1-4d84-9765-c460a7be2605 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:04.081012 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9df4c9ab-64b1-4d84-9765-c460a7be2605 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:04.081727 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9df4c9ab-64b1-4d84-9765-c460a7be2605 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:04.082185 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9df4c9ab-64b1-4d84-9765-c460a7be2605 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:04.082638 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9df4c9ab-64b1-4d84-9765-c460a7be2605 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:04.225695 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9df4c9ab-64b1-4d84-9765-c460a7be2605 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:04.233342 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9df4c9ab-64b1-4d84-9765-c460a7be2605 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.172276 Aug 04 23:38:04.233910 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 906/1841] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:04 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:05.257148 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2486e38a-acec-485d-a3a6-984e87d9b264 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:05.257763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2486e38a-acec-485d-a3a6-984e87d9b264 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:05.264101 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2486e38a-acec-485d-a3a6-984e87d9b264 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:05.264591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2486e38a-acec-485d-a3a6-984e87d9b264 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:05.265014 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2486e38a-acec-485d-a3a6-984e87d9b264 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:05.265718 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2486e38a-acec-485d-a3a6-984e87d9b264 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:05.266164 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2486e38a-acec-485d-a3a6-984e87d9b264 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:05.268781 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2486e38a-acec-485d-a3a6-984e87d9b264 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:05.424554 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2486e38a-acec-485d-a3a6-984e87d9b264 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:05.432396 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2486e38a-acec-485d-a3a6-984e87d9b264 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.181302 Aug 04 23:38:05.432960 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 936/1842] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:05 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:06.453150 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c51cba60-8242-4db3-a9d7-25e36e90442c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:06.453758 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c51cba60-8242-4db3-a9d7-25e36e90442c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:06.461637 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c51cba60-8242-4db3-a9d7-25e36e90442c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:06.462113 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c51cba60-8242-4db3-a9d7-25e36e90442c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:06.462572 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c51cba60-8242-4db3-a9d7-25e36e90442c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:06.463265 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c51cba60-8242-4db3-a9d7-25e36e90442c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:06.463705 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c51cba60-8242-4db3-a9d7-25e36e90442c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:06.464127 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c51cba60-8242-4db3-a9d7-25e36e90442c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:06.606127 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c51cba60-8242-4db3-a9d7-25e36e90442c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:06.614587 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c51cba60-8242-4db3-a9d7-25e36e90442c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.165171 Aug 04 23:38:06.615164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 907/1843] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:06 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:07.636254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-92348139-a54f-4c30-8a30-45556d3d41d5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:07.637643 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-92348139-a54f-4c30-8a30-45556d3d41d5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:07.643699 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92348139-a54f-4c30-8a30-45556d3d41d5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:07.644182 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92348139-a54f-4c30-8a30-45556d3d41d5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:07.644613 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92348139-a54f-4c30-8a30-45556d3d41d5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:07.645315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92348139-a54f-4c30-8a30-45556d3d41d5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:07.645763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92348139-a54f-4c30-8a30-45556d3d41d5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:07.646180 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92348139-a54f-4c30-8a30-45556d3d41d5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:07.791795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-92348139-a54f-4c30-8a30-45556d3d41d5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:07.800124 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-92348139-a54f-4c30-8a30-45556d3d41d5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.167777 Aug 04 23:38:07.800702 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 937/1844] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:07 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:38:08.821627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-95305b6a-4f79-493c-bf52-d4da850d10da tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:08.822215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-95305b6a-4f79-493c-bf52-d4da850d10da tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:08.828654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95305b6a-4f79-493c-bf52-d4da850d10da tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:08.829138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95305b6a-4f79-493c-bf52-d4da850d10da tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:08.830098 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95305b6a-4f79-493c-bf52-d4da850d10da tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:08.831095 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95305b6a-4f79-493c-bf52-d4da850d10da tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:08.831548 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95305b6a-4f79-493c-bf52-d4da850d10da tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:08.831969 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95305b6a-4f79-493c-bf52-d4da850d10da tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:08.963983 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-95305b6a-4f79-493c-bf52-d4da850d10da tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:08.971811 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-95305b6a-4f79-493c-bf52-d4da850d10da tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.154074 Aug 04 23:38:08.972369 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 908/1845] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:08 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:38:09.996137 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d8d4968d-e542-4958-aaa2-254e172fb40f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:09.996775 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d8d4968d-e542-4958-aaa2-254e172fb40f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:10.004941 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d8d4968d-e542-4958-aaa2-254e172fb40f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:10.005437 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d8d4968d-e542-4958-aaa2-254e172fb40f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:10.005873 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d8d4968d-e542-4958-aaa2-254e172fb40f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:10.006607 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d8d4968d-e542-4958-aaa2-254e172fb40f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:10.007051 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d8d4968d-e542-4958-aaa2-254e172fb40f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:10.007468 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d8d4968d-e542-4958-aaa2-254e172fb40f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:10.160902 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d8d4968d-e542-4958-aaa2-254e172fb40f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:10.170188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d8d4968d-e542-4958-aaa2-254e172fb40f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.178056 Aug 04 23:38:10.171441 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 938/1846] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:09 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:38:11.198925 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8bcdbd4b-d8f2-4849-8f33-63e2ebd79a60 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:11.199539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8bcdbd4b-d8f2-4849-8f33-63e2ebd79a60 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:11.206696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8bcdbd4b-d8f2-4849-8f33-63e2ebd79a60 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:11.207171 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8bcdbd4b-d8f2-4849-8f33-63e2ebd79a60 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:11.207602 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8bcdbd4b-d8f2-4849-8f33-63e2ebd79a60 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:11.208290 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8bcdbd4b-d8f2-4849-8f33-63e2ebd79a60 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:11.208738 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8bcdbd4b-d8f2-4849-8f33-63e2ebd79a60 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:11.209156 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8bcdbd4b-d8f2-4849-8f33-63e2ebd79a60 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:11.340900 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8bcdbd4b-d8f2-4849-8f33-63e2ebd79a60 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:11.349510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8bcdbd4b-d8f2-4849-8f33-63e2ebd79a60 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.154704 Aug 04 23:38:11.350079 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 909/1847] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:11 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:12.370891 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-743186b6-4780-4a50-8c97-277bf2b3003c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:12.371510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-743186b6-4780-4a50-8c97-277bf2b3003c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:12.378474 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-743186b6-4780-4a50-8c97-277bf2b3003c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:12.378963 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-743186b6-4780-4a50-8c97-277bf2b3003c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:12.379404 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-743186b6-4780-4a50-8c97-277bf2b3003c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:12.380121 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-743186b6-4780-4a50-8c97-277bf2b3003c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:12.380573 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-743186b6-4780-4a50-8c97-277bf2b3003c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:12.380997 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-743186b6-4780-4a50-8c97-277bf2b3003c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:12.519585 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-743186b6-4780-4a50-8c97-277bf2b3003c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:12.527237 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-743186b6-4780-4a50-8c97-277bf2b3003c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.160589 Aug 04 23:38:12.527808 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 939/1848] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:12 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:13.549485 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-567941c8-5c5c-4761-8e75-579be9fab9a4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:13.550105 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-567941c8-5c5c-4761-8e75-579be9fab9a4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:13.557392 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-567941c8-5c5c-4761-8e75-579be9fab9a4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:13.557886 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-567941c8-5c5c-4761-8e75-579be9fab9a4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:13.558325 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-567941c8-5c5c-4761-8e75-579be9fab9a4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:13.559089 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-567941c8-5c5c-4761-8e75-579be9fab9a4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:13.559543 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-567941c8-5c5c-4761-8e75-579be9fab9a4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:13.559966 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-567941c8-5c5c-4761-8e75-579be9fab9a4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:13.563662 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=78 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:38:13.713095 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-567941c8-5c5c-4761-8e75-579be9fab9a4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:13.721612 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-567941c8-5c5c-4761-8e75-579be9fab9a4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.176640 Aug 04 23:38:13.722198 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 910/1849] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:13 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:14.742566 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9a5912fb-a5f3-4924-83c2-905e6f24b19e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:14.743220 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9a5912fb-a5f3-4924-83c2-905e6f24b19e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:14.749903 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a5912fb-a5f3-4924-83c2-905e6f24b19e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:14.750545 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a5912fb-a5f3-4924-83c2-905e6f24b19e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:14.751706 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a5912fb-a5f3-4924-83c2-905e6f24b19e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:14.752517 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a5912fb-a5f3-4924-83c2-905e6f24b19e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:14.752977 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a5912fb-a5f3-4924-83c2-905e6f24b19e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:14.753405 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a5912fb-a5f3-4924-83c2-905e6f24b19e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:14.902507 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9a5912fb-a5f3-4924-83c2-905e6f24b19e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:14.911934 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9a5912fb-a5f3-4924-83c2-905e6f24b19e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.173017 Aug 04 23:38:14.912519 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 940/1850] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:14 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:15.933562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3f4dea9d-805f-4048-b6f3-dd16f2dfcd90 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:15.934200 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3f4dea9d-805f-4048-b6f3-dd16f2dfcd90 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:15.942101 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3f4dea9d-805f-4048-b6f3-dd16f2dfcd90 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:15.942695 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3f4dea9d-805f-4048-b6f3-dd16f2dfcd90 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:15.943131 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3f4dea9d-805f-4048-b6f3-dd16f2dfcd90 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:15.943835 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3f4dea9d-805f-4048-b6f3-dd16f2dfcd90 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:15.944284 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3f4dea9d-805f-4048-b6f3-dd16f2dfcd90 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:15.944701 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3f4dea9d-805f-4048-b6f3-dd16f2dfcd90 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:16.096268 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3f4dea9d-805f-4048-b6f3-dd16f2dfcd90 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:16.104085 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3f4dea9d-805f-4048-b6f3-dd16f2dfcd90 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.174583 Aug 04 23:38:16.104653 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 911/1851] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:15 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:17.126562 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a01ec224-7ae5-4006-8fc3-057352b85bf4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:17.127164 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a01ec224-7ae5-4006-8fc3-057352b85bf4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:17.133925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a01ec224-7ae5-4006-8fc3-057352b85bf4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:17.134434 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a01ec224-7ae5-4006-8fc3-057352b85bf4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:17.134871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a01ec224-7ae5-4006-8fc3-057352b85bf4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:17.135570 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a01ec224-7ae5-4006-8fc3-057352b85bf4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:17.136023 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a01ec224-7ae5-4006-8fc3-057352b85bf4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:17.136446 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a01ec224-7ae5-4006-8fc3-057352b85bf4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:17.282195 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a01ec224-7ae5-4006-8fc3-057352b85bf4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:17.291735 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a01ec224-7ae5-4006-8fc3-057352b85bf4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.169162 Aug 04 23:38:17.292313 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 941/1852] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:17 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:18.315238 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ddfbeef7-de10-4185-8785-9889c3cce540 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:18.315990 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ddfbeef7-de10-4185-8785-9889c3cce540 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:18.318242 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=26 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:38:18.325035 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ddfbeef7-de10-4185-8785-9889c3cce540 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:18.325655 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ddfbeef7-de10-4185-8785-9889c3cce540 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:18.326442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ddfbeef7-de10-4185-8785-9889c3cce540 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:18.327448 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ddfbeef7-de10-4185-8785-9889c3cce540 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:18.328042 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ddfbeef7-de10-4185-8785-9889c3cce540 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:18.328784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ddfbeef7-de10-4185-8785-9889c3cce540 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:18.485379 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ddfbeef7-de10-4185-8785-9889c3cce540 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:18.499870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ddfbeef7-de10-4185-8785-9889c3cce540 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.190113 Aug 04 23:38:18.500785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 912/1853] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:18 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:19.521898 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-596758a3-3486-4441-a6b1-232177fbaf8a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:19.522612 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-596758a3-3486-4441-a6b1-232177fbaf8a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:19.525020 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=26 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:38:19.531133 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-596758a3-3486-4441-a6b1-232177fbaf8a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:19.531630 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-596758a3-3486-4441-a6b1-232177fbaf8a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:19.532072 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-596758a3-3486-4441-a6b1-232177fbaf8a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:19.532849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-596758a3-3486-4441-a6b1-232177fbaf8a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:19.533253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-596758a3-3486-4441-a6b1-232177fbaf8a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:19.533683 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-596758a3-3486-4441-a6b1-232177fbaf8a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:19.536911 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=78 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:38:19.691745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-596758a3-3486-4441-a6b1-232177fbaf8a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:19.699822 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-596758a3-3486-4441-a6b1-232177fbaf8a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.182029 Aug 04 23:38:19.700409 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 942/1854] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:19 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:20.722338 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-96ff0fac-ddaa-422a-a75f-02244ea5b63e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:20.723138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-96ff0fac-ddaa-422a-a75f-02244ea5b63e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:20.729882 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96ff0fac-ddaa-422a-a75f-02244ea5b63e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:20.730383 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96ff0fac-ddaa-422a-a75f-02244ea5b63e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:20.730835 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96ff0fac-ddaa-422a-a75f-02244ea5b63e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:20.731552 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96ff0fac-ddaa-422a-a75f-02244ea5b63e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:20.731998 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96ff0fac-ddaa-422a-a75f-02244ea5b63e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:20.732420 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96ff0fac-ddaa-422a-a75f-02244ea5b63e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:20.888484 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-96ff0fac-ddaa-422a-a75f-02244ea5b63e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:20.897246 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-96ff0fac-ddaa-422a-a75f-02244ea5b63e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.179645 Aug 04 23:38:20.897862 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 913/1855] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:20 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:21.070768 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:38:21.071594 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:38:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:38:21.921116 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-cc44c1fb-7269-47d2-b233-e4fbb2368c04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:21.922477 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-cc44c1fb-7269-47d2-b233-e4fbb2368c04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:21.934435 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc44c1fb-7269-47d2-b233-e4fbb2368c04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:21.935047 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc44c1fb-7269-47d2-b233-e4fbb2368c04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:21.935740 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc44c1fb-7269-47d2-b233-e4fbb2368c04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:21.936536 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc44c1fb-7269-47d2-b233-e4fbb2368c04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:21.936998 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc44c1fb-7269-47d2-b233-e4fbb2368c04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:21.937429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc44c1fb-7269-47d2-b233-e4fbb2368c04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:22.082550 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-cc44c1fb-7269-47d2-b233-e4fbb2368c04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:22.090320 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-cc44c1fb-7269-47d2-b233-e4fbb2368c04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.174814 Aug 04 23:38:22.090922 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 943/1856] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:21 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:23.111738 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1f2013e2-a56b-4ecb-b2e4-f8c75f156b8b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:23.112308 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1f2013e2-a56b-4ecb-b2e4-f8c75f156b8b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:23.118409 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f2013e2-a56b-4ecb-b2e4-f8c75f156b8b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:23.118900 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f2013e2-a56b-4ecb-b2e4-f8c75f156b8b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:23.119354 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f2013e2-a56b-4ecb-b2e4-f8c75f156b8b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:23.120058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f2013e2-a56b-4ecb-b2e4-f8c75f156b8b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:23.120510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f2013e2-a56b-4ecb-b2e4-f8c75f156b8b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:23.120934 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f2013e2-a56b-4ecb-b2e4-f8c75f156b8b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:23.263341 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1f2013e2-a56b-4ecb-b2e4-f8c75f156b8b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:23.272170 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1f2013e2-a56b-4ecb-b2e4-f8c75f156b8b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.164220 Aug 04 23:38:23.272829 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 914/1857] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:23 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:23.949140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:38:23.949393 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:38:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:38:24.295042 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5c652bb2-c61c-4ef0-ac92-96d452be1e34 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:24.296042 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5c652bb2-c61c-4ef0-ac92-96d452be1e34 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:24.304163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c652bb2-c61c-4ef0-ac92-96d452be1e34 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:24.305069 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c652bb2-c61c-4ef0-ac92-96d452be1e34 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:24.305610 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c652bb2-c61c-4ef0-ac92-96d452be1e34 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:24.306471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c652bb2-c61c-4ef0-ac92-96d452be1e34 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:24.307024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c652bb2-c61c-4ef0-ac92-96d452be1e34 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:24.307548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c652bb2-c61c-4ef0-ac92-96d452be1e34 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:24.504627 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5c652bb2-c61c-4ef0-ac92-96d452be1e34 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:24.513028 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5c652bb2-c61c-4ef0-ac92-96d452be1e34 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.222555 Aug 04 23:38:24.513619 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 944/1858] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:24 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:25.534551 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-db2ce814-f3c0-40b2-845c-2c5a0f69112a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:25.535201 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-db2ce814-f3c0-40b2-845c-2c5a0f69112a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:25.542170 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-db2ce814-f3c0-40b2-845c-2c5a0f69112a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:25.542695 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-db2ce814-f3c0-40b2-845c-2c5a0f69112a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:25.543127 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-db2ce814-f3c0-40b2-845c-2c5a0f69112a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:25.543854 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-db2ce814-f3c0-40b2-845c-2c5a0f69112a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:25.544305 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-db2ce814-f3c0-40b2-845c-2c5a0f69112a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:25.544729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-db2ce814-f3c0-40b2-845c-2c5a0f69112a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:25.700441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-db2ce814-f3c0-40b2-845c-2c5a0f69112a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:25.709395 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-db2ce814-f3c0-40b2-845c-2c5a0f69112a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.178839 Aug 04 23:38:25.710240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 915/1859] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:25 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:26.732391 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3c37bfbe-e196-4f24-85fc-067bc1e35f06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:26.733049 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3c37bfbe-e196-4f24-85fc-067bc1e35f06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:26.740362 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c37bfbe-e196-4f24-85fc-067bc1e35f06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:26.740842 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c37bfbe-e196-4f24-85fc-067bc1e35f06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:26.741281 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c37bfbe-e196-4f24-85fc-067bc1e35f06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:26.741993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c37bfbe-e196-4f24-85fc-067bc1e35f06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:26.742468 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c37bfbe-e196-4f24-85fc-067bc1e35f06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:26.742896 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c37bfbe-e196-4f24-85fc-067bc1e35f06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:26.900112 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3c37bfbe-e196-4f24-85fc-067bc1e35f06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:26.909636 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3c37bfbe-e196-4f24-85fc-067bc1e35f06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.181282 Aug 04 23:38:26.910225 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 945/1860] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:26 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:27.933328 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1a802de5-e57f-400a-afed-6d79cd6104a5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:27.933986 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1a802de5-e57f-400a-afed-6d79cd6104a5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:27.940857 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a802de5-e57f-400a-afed-6d79cd6104a5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:27.941338 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a802de5-e57f-400a-afed-6d79cd6104a5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:27.941785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a802de5-e57f-400a-afed-6d79cd6104a5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:27.942517 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a802de5-e57f-400a-afed-6d79cd6104a5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:27.942971 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a802de5-e57f-400a-afed-6d79cd6104a5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:27.943397 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a802de5-e57f-400a-afed-6d79cd6104a5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:28.086148 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1a802de5-e57f-400a-afed-6d79cd6104a5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:28.093926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1a802de5-e57f-400a-afed-6d79cd6104a5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.166235 Aug 04 23:38:28.095257 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 916/1861] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:27 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:29.116832 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e4da2bd7-a65c-41a9-8be5-2cc19e8acb6f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:29.117446 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e4da2bd7-a65c-41a9-8be5-2cc19e8acb6f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:29.124095 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e4da2bd7-a65c-41a9-8be5-2cc19e8acb6f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:29.124576 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e4da2bd7-a65c-41a9-8be5-2cc19e8acb6f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:29.125025 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e4da2bd7-a65c-41a9-8be5-2cc19e8acb6f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:29.125926 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e4da2bd7-a65c-41a9-8be5-2cc19e8acb6f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:29.126872 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e4da2bd7-a65c-41a9-8be5-2cc19e8acb6f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:29.127301 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e4da2bd7-a65c-41a9-8be5-2cc19e8acb6f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:29.292254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e4da2bd7-a65c-41a9-8be5-2cc19e8acb6f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:29.301128 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e4da2bd7-a65c-41a9-8be5-2cc19e8acb6f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.188191 Aug 04 23:38:29.301743 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 946/1862] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:29 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:30.324573 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-508eb6d2-e33b-404a-b555-5520cbb33655 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:30.325382 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-508eb6d2-e33b-404a-b555-5520cbb33655 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:30.332762 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-508eb6d2-e33b-404a-b555-5520cbb33655 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:30.333280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-508eb6d2-e33b-404a-b555-5520cbb33655 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:30.333714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-508eb6d2-e33b-404a-b555-5520cbb33655 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:30.334451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-508eb6d2-e33b-404a-b555-5520cbb33655 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:30.334907 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-508eb6d2-e33b-404a-b555-5520cbb33655 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:30.335396 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-508eb6d2-e33b-404a-b555-5520cbb33655 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:30.493152 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-508eb6d2-e33b-404a-b555-5520cbb33655 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:30.502273 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-508eb6d2-e33b-404a-b555-5520cbb33655 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.182067 Aug 04 23:38:30.502884 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 917/1863] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:30 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:31.523935 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-76114a33-dac0-43cf-a58f-38fcd7bb5903 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:31.524550 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-76114a33-dac0-43cf-a58f-38fcd7bb5903 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:31.531542 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-76114a33-dac0-43cf-a58f-38fcd7bb5903 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:31.532528 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-76114a33-dac0-43cf-a58f-38fcd7bb5903 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:31.532935 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-76114a33-dac0-43cf-a58f-38fcd7bb5903 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:31.533644 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-76114a33-dac0-43cf-a58f-38fcd7bb5903 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:31.534094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-76114a33-dac0-43cf-a58f-38fcd7bb5903 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:31.534560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-76114a33-dac0-43cf-a58f-38fcd7bb5903 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:31.675010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-76114a33-dac0-43cf-a58f-38fcd7bb5903 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:31.683072 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-76114a33-dac0-43cf-a58f-38fcd7bb5903 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.163086 Aug 04 23:38:31.683642 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 947/1864] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:31 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:32.705404 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5de5c179-2840-4e44-a6f0-d5aa3a21a3ae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:32.706034 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5de5c179-2840-4e44-a6f0-d5aa3a21a3ae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:32.712642 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5de5c179-2840-4e44-a6f0-d5aa3a21a3ae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:32.713140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5de5c179-2840-4e44-a6f0-d5aa3a21a3ae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:32.713579 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5de5c179-2840-4e44-a6f0-d5aa3a21a3ae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:32.714286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5de5c179-2840-4e44-a6f0-d5aa3a21a3ae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:32.714773 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5de5c179-2840-4e44-a6f0-d5aa3a21a3ae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:32.715201 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5de5c179-2840-4e44-a6f0-d5aa3a21a3ae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:32.864861 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5de5c179-2840-4e44-a6f0-d5aa3a21a3ae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:32.872527 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5de5c179-2840-4e44-a6f0-d5aa3a21a3ae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.172001 Aug 04 23:38:32.873104 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 918/1865] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:32 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:33.894514 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f51b2482-9ec8-4ad2-8e76-70afcaa89dc1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:33.895126 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f51b2482-9ec8-4ad2-8e76-70afcaa89dc1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:33.901576 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f51b2482-9ec8-4ad2-8e76-70afcaa89dc1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:33.902053 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f51b2482-9ec8-4ad2-8e76-70afcaa89dc1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:33.902520 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f51b2482-9ec8-4ad2-8e76-70afcaa89dc1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:33.903204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f51b2482-9ec8-4ad2-8e76-70afcaa89dc1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:33.903653 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f51b2482-9ec8-4ad2-8e76-70afcaa89dc1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:33.904070 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f51b2482-9ec8-4ad2-8e76-70afcaa89dc1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:34.036733 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f51b2482-9ec8-4ad2-8e76-70afcaa89dc1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:34.044435 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f51b2482-9ec8-4ad2-8e76-70afcaa89dc1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.154665 Aug 04 23:38:34.044994 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 948/1866] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:33 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:35.065911 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ad82433f-37fc-4b6a-afaa-f742c52aa1b3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:35.066711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ad82433f-37fc-4b6a-afaa-f742c52aa1b3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:35.073026 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad82433f-37fc-4b6a-afaa-f742c52aa1b3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:35.073502 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad82433f-37fc-4b6a-afaa-f742c52aa1b3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:35.073935 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad82433f-37fc-4b6a-afaa-f742c52aa1b3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:35.074684 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad82433f-37fc-4b6a-afaa-f742c52aa1b3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:35.075142 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad82433f-37fc-4b6a-afaa-f742c52aa1b3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:35.075565 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad82433f-37fc-4b6a-afaa-f742c52aa1b3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:35.214785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ad82433f-37fc-4b6a-afaa-f742c52aa1b3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:35.222468 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ad82433f-37fc-4b6a-afaa-f742c52aa1b3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.161008 Aug 04 23:38:35.223033 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 919/1867] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:35 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:36.243024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9e92d8e3-ec87-4dea-bd5c-110501285359 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:36.243633 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9e92d8e3-ec87-4dea-bd5c-110501285359 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:36.250066 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9e92d8e3-ec87-4dea-bd5c-110501285359 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:36.251181 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9e92d8e3-ec87-4dea-bd5c-110501285359 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:36.252371 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9e92d8e3-ec87-4dea-bd5c-110501285359 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:36.253065 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9e92d8e3-ec87-4dea-bd5c-110501285359 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:36.253514 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9e92d8e3-ec87-4dea-bd5c-110501285359 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:36.253935 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9e92d8e3-ec87-4dea-bd5c-110501285359 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:36.395502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9e92d8e3-ec87-4dea-bd5c-110501285359 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:36.403470 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9e92d8e3-ec87-4dea-bd5c-110501285359 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.164317 Aug 04 23:38:36.404052 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 949/1868] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:36 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:37.426183 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f3afab07-38e8-4386-ae24-02029379889c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:37.426819 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f3afab07-38e8-4386-ae24-02029379889c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:37.433454 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f3afab07-38e8-4386-ae24-02029379889c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:37.433921 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f3afab07-38e8-4386-ae24-02029379889c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:37.434342 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f3afab07-38e8-4386-ae24-02029379889c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:37.435043 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f3afab07-38e8-4386-ae24-02029379889c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:37.435487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f3afab07-38e8-4386-ae24-02029379889c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:37.435903 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f3afab07-38e8-4386-ae24-02029379889c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:37.577592 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f3afab07-38e8-4386-ae24-02029379889c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:37.586251 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f3afab07-38e8-4386-ae24-02029379889c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.164983 Aug 04 23:38:37.586874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 920/1869] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:37 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:38.608330 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6b88fd4d-a497-4234-b8d1-67e20ef526da tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:38.608946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6b88fd4d-a497-4234-b8d1-67e20ef526da tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:38.615557 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b88fd4d-a497-4234-b8d1-67e20ef526da tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:38.616048 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b88fd4d-a497-4234-b8d1-67e20ef526da tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:38.616486 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b88fd4d-a497-4234-b8d1-67e20ef526da tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:38.617186 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b88fd4d-a497-4234-b8d1-67e20ef526da tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:38.617636 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b88fd4d-a497-4234-b8d1-67e20ef526da tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:38.618061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b88fd4d-a497-4234-b8d1-67e20ef526da tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:38.761459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6b88fd4d-a497-4234-b8d1-67e20ef526da tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:38.769215 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6b88fd4d-a497-4234-b8d1-67e20ef526da tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.164748 Aug 04 23:38:38.769771 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 950/1870] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:38 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:39.789717 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-bdca1ff9-25a3-4755-b2a3-9930f8207770 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:39.790382 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-bdca1ff9-25a3-4755-b2a3-9930f8207770 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:39.797298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdca1ff9-25a3-4755-b2a3-9930f8207770 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:39.798078 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdca1ff9-25a3-4755-b2a3-9930f8207770 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:39.798600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdca1ff9-25a3-4755-b2a3-9930f8207770 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:39.799302 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdca1ff9-25a3-4755-b2a3-9930f8207770 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:39.799748 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdca1ff9-25a3-4755-b2a3-9930f8207770 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:39.800167 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdca1ff9-25a3-4755-b2a3-9930f8207770 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:39.935223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-bdca1ff9-25a3-4755-b2a3-9930f8207770 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:39.943554 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-bdca1ff9-25a3-4755-b2a3-9930f8207770 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.157948 Aug 04 23:38:39.944118 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 921/1871] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:39 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:40.966056 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-39854f06-b382-4413-aa1a-10db538f596a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:40.966874 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-39854f06-b382-4413-aa1a-10db538f596a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:40.974084 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-39854f06-b382-4413-aa1a-10db538f596a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:40.974608 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-39854f06-b382-4413-aa1a-10db538f596a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:40.975047 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-39854f06-b382-4413-aa1a-10db538f596a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:40.975757 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-39854f06-b382-4413-aa1a-10db538f596a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:40.976213 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-39854f06-b382-4413-aa1a-10db538f596a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:40.976641 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-39854f06-b382-4413-aa1a-10db538f596a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:41.384869 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-39854f06-b382-4413-aa1a-10db538f596a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:41.393231 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-39854f06-b382-4413-aa1a-10db538f596a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.431031 Aug 04 23:38:41.393819 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 951/1872] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:40 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:42.415194 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b27b4809-b73d-47b9-8823-22d3f118adda tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:42.415795 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b27b4809-b73d-47b9-8823-22d3f118adda tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:42.422870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b27b4809-b73d-47b9-8823-22d3f118adda tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:42.423357 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b27b4809-b73d-47b9-8823-22d3f118adda tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:42.423792 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b27b4809-b73d-47b9-8823-22d3f118adda tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:42.424493 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b27b4809-b73d-47b9-8823-22d3f118adda tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:42.424946 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b27b4809-b73d-47b9-8823-22d3f118adda tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:42.425371 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b27b4809-b73d-47b9-8823-22d3f118adda tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:42.558504 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b27b4809-b73d-47b9-8823-22d3f118adda tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:42.566094 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b27b4809-b73d-47b9-8823-22d3f118adda tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.154833 Aug 04 23:38:42.566699 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 922/1873] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:42 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:43.587629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8e7abbac-031f-4454-a6fc-1fd938ab51c1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:43.588288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8e7abbac-031f-4454-a6fc-1fd938ab51c1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:43.597803 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8e7abbac-031f-4454-a6fc-1fd938ab51c1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:43.598285 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8e7abbac-031f-4454-a6fc-1fd938ab51c1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:43.598776 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8e7abbac-031f-4454-a6fc-1fd938ab51c1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:43.599473 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8e7abbac-031f-4454-a6fc-1fd938ab51c1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:43.599949 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8e7abbac-031f-4454-a6fc-1fd938ab51c1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:43.600371 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8e7abbac-031f-4454-a6fc-1fd938ab51c1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:43.734318 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8e7abbac-031f-4454-a6fc-1fd938ab51c1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:43.742779 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8e7abbac-031f-4454-a6fc-1fd938ab51c1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.158942 Aug 04 23:38:43.743350 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 952/1874] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:43 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:44.763636 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-36efbd69-a4cc-4e73-b763-2b3ed4bcb233 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:44.764303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-36efbd69-a4cc-4e73-b763-2b3ed4bcb233 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:44.770860 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-36efbd69-a4cc-4e73-b763-2b3ed4bcb233 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:44.771343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-36efbd69-a4cc-4e73-b763-2b3ed4bcb233 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:44.771778 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-36efbd69-a4cc-4e73-b763-2b3ed4bcb233 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:44.772474 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-36efbd69-a4cc-4e73-b763-2b3ed4bcb233 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:44.772928 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-36efbd69-a4cc-4e73-b763-2b3ed4bcb233 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:44.773351 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-36efbd69-a4cc-4e73-b763-2b3ed4bcb233 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:44.775952 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=78 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:38:44.905620 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-36efbd69-a4cc-4e73-b763-2b3ed4bcb233 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:44.913674 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-36efbd69-a4cc-4e73-b763-2b3ed4bcb233 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.153972 Aug 04 23:38:44.914232 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 923/1875] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:44 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:45.935590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c90099aa-0d88-462f-b539-3f3db193ec81 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:45.936207 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c90099aa-0d88-462f-b539-3f3db193ec81 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:45.943380 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c90099aa-0d88-462f-b539-3f3db193ec81 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:45.943861 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c90099aa-0d88-462f-b539-3f3db193ec81 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:45.944291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c90099aa-0d88-462f-b539-3f3db193ec81 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:45.944978 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c90099aa-0d88-462f-b539-3f3db193ec81 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:45.945428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c90099aa-0d88-462f-b539-3f3db193ec81 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:45.945847 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c90099aa-0d88-462f-b539-3f3db193ec81 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:46.080916 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c90099aa-0d88-462f-b539-3f3db193ec81 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:46.088690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c90099aa-0d88-462f-b539-3f3db193ec81 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.156956 Aug 04 23:38:46.089258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 953/1876] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:45 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:47.109992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-329561af-84fe-4a1b-9d37-32a2c4dba684 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:47.110582 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-329561af-84fe-4a1b-9d37-32a2c4dba684 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:47.116943 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-329561af-84fe-4a1b-9d37-32a2c4dba684 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:47.117416 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-329561af-84fe-4a1b-9d37-32a2c4dba684 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:47.117840 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-329561af-84fe-4a1b-9d37-32a2c4dba684 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:47.118554 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-329561af-84fe-4a1b-9d37-32a2c4dba684 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:47.119001 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-329561af-84fe-4a1b-9d37-32a2c4dba684 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:47.119413 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-329561af-84fe-4a1b-9d37-32a2c4dba684 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:47.257540 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-329561af-84fe-4a1b-9d37-32a2c4dba684 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:47.265074 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-329561af-84fe-4a1b-9d37-32a2c4dba684 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.159564 Aug 04 23:38:47.266251 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 924/1877] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:47 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:48.286974 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9285caf4-841f-4508-837b-fd4226a1ec55 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:48.287594 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9285caf4-841f-4508-837b-fd4226a1ec55 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:48.294025 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9285caf4-841f-4508-837b-fd4226a1ec55 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:48.294532 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9285caf4-841f-4508-837b-fd4226a1ec55 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:48.294967 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9285caf4-841f-4508-837b-fd4226a1ec55 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:48.295649 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9285caf4-841f-4508-837b-fd4226a1ec55 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:48.296093 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9285caf4-841f-4508-837b-fd4226a1ec55 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:48.296510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9285caf4-841f-4508-837b-fd4226a1ec55 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:48.430105 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9285caf4-841f-4508-837b-fd4226a1ec55 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:48.437606 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9285caf4-841f-4508-837b-fd4226a1ec55 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.154526 Aug 04 23:38:48.438310 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 954/1878] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:48 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:49.458681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-457dde9f-25c0-41c8-94a3-188f3e3cc328 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:49.459340 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-457dde9f-25c0-41c8-94a3-188f3e3cc328 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:49.461552 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=26 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:38:49.466894 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-457dde9f-25c0-41c8-94a3-188f3e3cc328 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:49.467373 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-457dde9f-25c0-41c8-94a3-188f3e3cc328 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:49.467808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-457dde9f-25c0-41c8-94a3-188f3e3cc328 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:49.468495 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-457dde9f-25c0-41c8-94a3-188f3e3cc328 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:49.469297 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-457dde9f-25c0-41c8-94a3-188f3e3cc328 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:49.469724 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-457dde9f-25c0-41c8-94a3-188f3e3cc328 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:49.604150 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-457dde9f-25c0-41c8-94a3-188f3e3cc328 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:49.612195 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-457dde9f-25c0-41c8-94a3-188f3e3cc328 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.157511 Aug 04 23:38:49.612751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 925/1879] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:49 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:50.633019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1f1f0d70-2d79-47eb-b4ba-c2be09f838b3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:50.633843 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1f1f0d70-2d79-47eb-b4ba-c2be09f838b3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:50.635927 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=26 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:38:50.642699 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1f1f0d70-2d79-47eb-b4ba-c2be09f838b3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:50.643174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1f1f0d70-2d79-47eb-b4ba-c2be09f838b3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:50.643626 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1f1f0d70-2d79-47eb-b4ba-c2be09f838b3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:50.644308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1f1f0d70-2d79-47eb-b4ba-c2be09f838b3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:50.644755 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1f1f0d70-2d79-47eb-b4ba-c2be09f838b3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:50.645170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1f1f0d70-2d79-47eb-b4ba-c2be09f838b3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:50.647954 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=78 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:38:50.779396 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1f1f0d70-2d79-47eb-b4ba-c2be09f838b3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:50.787048 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1f1f0d70-2d79-47eb-b4ba-c2be09f838b3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.157891 Aug 04 23:38:50.787611 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 955/1880] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:50 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:51.808832 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-84e0d4e0-5d73-4b3d-be97-8ecca2ba3238 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:51.809758 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-84e0d4e0-5d73-4b3d-be97-8ecca2ba3238 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:51.817703 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-84e0d4e0-5d73-4b3d-be97-8ecca2ba3238 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:51.818192 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-84e0d4e0-5d73-4b3d-be97-8ecca2ba3238 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:51.818651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-84e0d4e0-5d73-4b3d-be97-8ecca2ba3238 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:51.819367 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-84e0d4e0-5d73-4b3d-be97-8ecca2ba3238 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:51.819967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-84e0d4e0-5d73-4b3d-be97-8ecca2ba3238 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:51.820391 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-84e0d4e0-5d73-4b3d-be97-8ecca2ba3238 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:51.965885 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-84e0d4e0-5d73-4b3d-be97-8ecca2ba3238 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:51.975174 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-84e0d4e0-5d73-4b3d-be97-8ecca2ba3238 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.170340 Aug 04 23:38:51.975739 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 926/1881] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:51 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:52.996387 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b043a8b5-73c8-48d4-8d8c-f65cdeac799f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:52.997002 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b043a8b5-73c8-48d4-8d8c-f65cdeac799f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:53.004497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b043a8b5-73c8-48d4-8d8c-f65cdeac799f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:53.005005 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b043a8b5-73c8-48d4-8d8c-f65cdeac799f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:53.005459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b043a8b5-73c8-48d4-8d8c-f65cdeac799f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:53.006200 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b043a8b5-73c8-48d4-8d8c-f65cdeac799f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:53.006675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b043a8b5-73c8-48d4-8d8c-f65cdeac799f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:53.007127 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b043a8b5-73c8-48d4-8d8c-f65cdeac799f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:53.142716 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b043a8b5-73c8-48d4-8d8c-f65cdeac799f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:53.150297 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b043a8b5-73c8-48d4-8d8c-f65cdeac799f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.157763 Aug 04 23:38:53.150882 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 956/1882] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:52 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:54.171737 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c45b33a2-5177-4e73-8a68-ba07f3f714b2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:54.173030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c45b33a2-5177-4e73-8a68-ba07f3f714b2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:54.179826 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c45b33a2-5177-4e73-8a68-ba07f3f714b2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:54.180300 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c45b33a2-5177-4e73-8a68-ba07f3f714b2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:54.180731 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c45b33a2-5177-4e73-8a68-ba07f3f714b2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:54.181423 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c45b33a2-5177-4e73-8a68-ba07f3f714b2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:54.181872 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c45b33a2-5177-4e73-8a68-ba07f3f714b2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:54.182292 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c45b33a2-5177-4e73-8a68-ba07f3f714b2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:54.313079 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c45b33a2-5177-4e73-8a68-ba07f3f714b2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:54.320596 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c45b33a2-5177-4e73-8a68-ba07f3f714b2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.152716 Aug 04 23:38:54.321165 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 927/1883] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:54 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:55.340774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c561cd45-5f5c-479b-bf10-a713f3425d7e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:55.341410 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c561cd45-5f5c-479b-bf10-a713f3425d7e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:55.347868 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c561cd45-5f5c-479b-bf10-a713f3425d7e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:55.348344 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c561cd45-5f5c-479b-bf10-a713f3425d7e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:55.348771 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c561cd45-5f5c-479b-bf10-a713f3425d7e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:55.349458 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c561cd45-5f5c-479b-bf10-a713f3425d7e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:55.349905 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c561cd45-5f5c-479b-bf10-a713f3425d7e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:55.350322 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c561cd45-5f5c-479b-bf10-a713f3425d7e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:55.482316 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c561cd45-5f5c-479b-bf10-a713f3425d7e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:55.490741 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c561cd45-5f5c-479b-bf10-a713f3425d7e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.153822 Aug 04 23:38:55.491315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 957/1884] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:55 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:56.512000 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ffb7c310-9c65-4c45-9a7f-8052b64f52c3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:56.512644 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ffb7c310-9c65-4c45-9a7f-8052b64f52c3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:56.519515 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ffb7c310-9c65-4c45-9a7f-8052b64f52c3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:56.519998 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ffb7c310-9c65-4c45-9a7f-8052b64f52c3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:56.520434 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ffb7c310-9c65-4c45-9a7f-8052b64f52c3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:56.521127 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ffb7c310-9c65-4c45-9a7f-8052b64f52c3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:56.521579 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ffb7c310-9c65-4c45-9a7f-8052b64f52c3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:56.522007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ffb7c310-9c65-4c45-9a7f-8052b64f52c3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:56.658176 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ffb7c310-9c65-4c45-9a7f-8052b64f52c3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:56.665858 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ffb7c310-9c65-4c45-9a7f-8052b64f52c3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.157724 Aug 04 23:38:56.666441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 928/1885] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:56 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:57.688085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-83a4869c-8cd2-4ec8-8123-96bbc78cb809 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:57.688690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-83a4869c-8cd2-4ec8-8123-96bbc78cb809 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:57.695224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-83a4869c-8cd2-4ec8-8123-96bbc78cb809 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:57.695710 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-83a4869c-8cd2-4ec8-8123-96bbc78cb809 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:57.696147 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-83a4869c-8cd2-4ec8-8123-96bbc78cb809 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:57.696846 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-83a4869c-8cd2-4ec8-8123-96bbc78cb809 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:57.697297 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-83a4869c-8cd2-4ec8-8123-96bbc78cb809 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:57.697720 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-83a4869c-8cd2-4ec8-8123-96bbc78cb809 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:57.834139 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-83a4869c-8cd2-4ec8-8123-96bbc78cb809 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:57.841722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-83a4869c-8cd2-4ec8-8123-96bbc78cb809 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.158073 Aug 04 23:38:57.842290 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 958/1886] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:57 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:38:58.863092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-05990040-fae3-4c31-97ac-43ca832c22f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:38:58.863720 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-05990040-fae3-4c31-97ac-43ca832c22f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:38:58.870135 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05990040-fae3-4c31-97ac-43ca832c22f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:58.870631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05990040-fae3-4c31-97ac-43ca832c22f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:58.871060 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05990040-fae3-4c31-97ac-43ca832c22f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:58.871752 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05990040-fae3-4c31-97ac-43ca832c22f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:38:58.872197 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05990040-fae3-4c31-97ac-43ca832c22f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:38:58.872610 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05990040-fae3-4c31-97ac-43ca832c22f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:38:59.010049 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-05990040-fae3-4c31-97ac-43ca832c22f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:38:59.018608 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-05990040-fae3-4c31-97ac-43ca832c22f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.159906 Aug 04 23:38:59.019180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 929/1887] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:38:58 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:00.040320 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-19aaa5e7-6d3e-476b-a9c3-9d7ef0d63bce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:00.041010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-19aaa5e7-6d3e-476b-a9c3-9d7ef0d63bce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:00.048700 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-19aaa5e7-6d3e-476b-a9c3-9d7ef0d63bce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:00.049185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-19aaa5e7-6d3e-476b-a9c3-9d7ef0d63bce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:00.049621 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-19aaa5e7-6d3e-476b-a9c3-9d7ef0d63bce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:00.050478 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-19aaa5e7-6d3e-476b-a9c3-9d7ef0d63bce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:00.050935 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-19aaa5e7-6d3e-476b-a9c3-9d7ef0d63bce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:00.051360 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-19aaa5e7-6d3e-476b-a9c3-9d7ef0d63bce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:00.183980 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-19aaa5e7-6d3e-476b-a9c3-9d7ef0d63bce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:00.192114 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-19aaa5e7-6d3e-476b-a9c3-9d7ef0d63bce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.155943 Aug 04 23:39:00.192829 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 959/1888] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:00 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:01.212828 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d274624b-72b3-4529-a948-b0e11ac61688 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:01.213439 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d274624b-72b3-4529-a948-b0e11ac61688 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:01.220369 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d274624b-72b3-4529-a948-b0e11ac61688 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:01.220850 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d274624b-72b3-4529-a948-b0e11ac61688 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:01.221282 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d274624b-72b3-4529-a948-b0e11ac61688 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:01.221978 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d274624b-72b3-4529-a948-b0e11ac61688 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:01.222459 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d274624b-72b3-4529-a948-b0e11ac61688 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:01.222886 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d274624b-72b3-4529-a948-b0e11ac61688 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:01.357235 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d274624b-72b3-4529-a948-b0e11ac61688 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:01.365409 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d274624b-72b3-4529-a948-b0e11ac61688 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.156479 Aug 04 23:39:01.365969 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 930/1889] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:01 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:02.386796 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-10c86228-6259-4dca-903a-cc24f73e5d0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:02.387399 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-10c86228-6259-4dca-903a-cc24f73e5d0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:02.394563 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10c86228-6259-4dca-903a-cc24f73e5d0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:02.395042 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10c86228-6259-4dca-903a-cc24f73e5d0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:02.395472 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10c86228-6259-4dca-903a-cc24f73e5d0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:02.396163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10c86228-6259-4dca-903a-cc24f73e5d0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:02.396613 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10c86228-6259-4dca-903a-cc24f73e5d0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:02.397022 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10c86228-6259-4dca-903a-cc24f73e5d0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:02.533162 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-10c86228-6259-4dca-903a-cc24f73e5d0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:02.541429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-10c86228-6259-4dca-903a-cc24f73e5d0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.158481 Aug 04 23:39:02.542125 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 960/1890] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:02 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:03.562831 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-27cd9189-2e1f-42ed-b956-e00d0127a0d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:03.563563 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-27cd9189-2e1f-42ed-b956-e00d0127a0d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:03.570418 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-27cd9189-2e1f-42ed-b956-e00d0127a0d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:03.570899 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-27cd9189-2e1f-42ed-b956-e00d0127a0d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:03.571329 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-27cd9189-2e1f-42ed-b956-e00d0127a0d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:03.572024 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-27cd9189-2e1f-42ed-b956-e00d0127a0d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:03.572475 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-27cd9189-2e1f-42ed-b956-e00d0127a0d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:03.572897 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-27cd9189-2e1f-42ed-b956-e00d0127a0d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:03.712361 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-27cd9189-2e1f-42ed-b956-e00d0127a0d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:03.720613 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-27cd9189-2e1f-42ed-b956-e00d0127a0d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.162032 Aug 04 23:39:03.721393 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 931/1891] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:03 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:04.741956 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-335b1825-e9d4-41b1-a610-615b506f26bf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:04.742594 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-335b1825-e9d4-41b1-a610-615b506f26bf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:04.748982 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-335b1825-e9d4-41b1-a610-615b506f26bf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:04.749459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-335b1825-e9d4-41b1-a610-615b506f26bf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:04.749890 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-335b1825-e9d4-41b1-a610-615b506f26bf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:04.750669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-335b1825-e9d4-41b1-a610-615b506f26bf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:04.751239 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-335b1825-e9d4-41b1-a610-615b506f26bf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:04.751664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-335b1825-e9d4-41b1-a610-615b506f26bf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:04.882907 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-335b1825-e9d4-41b1-a610-615b506f26bf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:04.890547 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-335b1825-e9d4-41b1-a610-615b506f26bf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.152427 Aug 04 23:39:04.891637 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 961/1892] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:04 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:05.911452 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-644e65fe-8785-4b6c-ad85-fd0af3d374f5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:05.912069 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-644e65fe-8785-4b6c-ad85-fd0af3d374f5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:05.918016 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-644e65fe-8785-4b6c-ad85-fd0af3d374f5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:05.918533 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-644e65fe-8785-4b6c-ad85-fd0af3d374f5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:05.918969 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-644e65fe-8785-4b6c-ad85-fd0af3d374f5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:05.919664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-644e65fe-8785-4b6c-ad85-fd0af3d374f5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:05.920115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-644e65fe-8785-4b6c-ad85-fd0af3d374f5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:05.920538 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-644e65fe-8785-4b6c-ad85-fd0af3d374f5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:06.058241 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-644e65fe-8785-4b6c-ad85-fd0af3d374f5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:06.066030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-644e65fe-8785-4b6c-ad85-fd0af3d374f5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.159031 Aug 04 23:39:06.066622 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 932/1893] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:05 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:07.086678 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0821ede4-def7-4d51-af70-84491d531b01 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:07.087238 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0821ede4-def7-4d51-af70-84491d531b01 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:07.093721 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0821ede4-def7-4d51-af70-84491d531b01 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:07.094212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0821ede4-def7-4d51-af70-84491d531b01 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:07.094675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0821ede4-def7-4d51-af70-84491d531b01 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:07.095367 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0821ede4-def7-4d51-af70-84491d531b01 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:07.095819 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0821ede4-def7-4d51-af70-84491d531b01 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:07.096241 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0821ede4-def7-4d51-af70-84491d531b01 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:07.230162 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0821ede4-def7-4d51-af70-84491d531b01 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:07.238470 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0821ede4-def7-4d51-af70-84491d531b01 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.155718 Aug 04 23:39:07.239042 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 962/1894] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:07 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:08.259492 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7cc7eb5e-a7aa-4d35-b1ba-d734deb885e8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:08.260138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7cc7eb5e-a7aa-4d35-b1ba-d734deb885e8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:08.266613 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7cc7eb5e-a7aa-4d35-b1ba-d734deb885e8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:08.267098 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7cc7eb5e-a7aa-4d35-b1ba-d734deb885e8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:08.267596 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7cc7eb5e-a7aa-4d35-b1ba-d734deb885e8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:08.269187 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7cc7eb5e-a7aa-4d35-b1ba-d734deb885e8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:08.269645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7cc7eb5e-a7aa-4d35-b1ba-d734deb885e8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:08.270074 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7cc7eb5e-a7aa-4d35-b1ba-d734deb885e8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:08.404033 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7cc7eb5e-a7aa-4d35-b1ba-d734deb885e8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:08.411905 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7cc7eb5e-a7aa-4d35-b1ba-d734deb885e8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.156122 Aug 04 23:39:08.412719 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 933/1895] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:08 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:09.435134 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7ad8aada-e1bd-4a6f-86b6-8da7bfd4aaea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:09.435730 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7ad8aada-e1bd-4a6f-86b6-8da7bfd4aaea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:09.442714 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ad8aada-e1bd-4a6f-86b6-8da7bfd4aaea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:09.443579 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ad8aada-e1bd-4a6f-86b6-8da7bfd4aaea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:09.443739 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ad8aada-e1bd-4a6f-86b6-8da7bfd4aaea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:09.444296 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ad8aada-e1bd-4a6f-86b6-8da7bfd4aaea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:09.444743 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ad8aada-e1bd-4a6f-86b6-8da7bfd4aaea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:09.445158 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ad8aada-e1bd-4a6f-86b6-8da7bfd4aaea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:09.581266 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7ad8aada-e1bd-4a6f-86b6-8da7bfd4aaea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:09.588951 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7ad8aada-e1bd-4a6f-86b6-8da7bfd4aaea tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.157760 Aug 04 23:39:09.589510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 963/1896] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:09 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:10.609521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a3c6eae5-6f78-41f7-ab5b-9f4e7b8a0e2d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:10.610060 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a3c6eae5-6f78-41f7-ab5b-9f4e7b8a0e2d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:10.617286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3c6eae5-6f78-41f7-ab5b-9f4e7b8a0e2d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:10.617767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3c6eae5-6f78-41f7-ab5b-9f4e7b8a0e2d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:10.618206 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3c6eae5-6f78-41f7-ab5b-9f4e7b8a0e2d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:10.618925 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3c6eae5-6f78-41f7-ab5b-9f4e7b8a0e2d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:10.619377 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3c6eae5-6f78-41f7-ab5b-9f4e7b8a0e2d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:10.619802 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3c6eae5-6f78-41f7-ab5b-9f4e7b8a0e2d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:10.751691 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a3c6eae5-6f78-41f7-ab5b-9f4e7b8a0e2d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:10.761074 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a3c6eae5-6f78-41f7-ab5b-9f4e7b8a0e2d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.155286 Aug 04 23:39:10.762117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 934/1897] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:10 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:39:11.782651 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-94b56634-d0a9-4ecd-9a4a-e860eb90073b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:11.783265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-94b56634-d0a9-4ecd-9a4a-e860eb90073b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:11.789599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94b56634-d0a9-4ecd-9a4a-e860eb90073b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:11.790111 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94b56634-d0a9-4ecd-9a4a-e860eb90073b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:11.790584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94b56634-d0a9-4ecd-9a4a-e860eb90073b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:11.791274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94b56634-d0a9-4ecd-9a4a-e860eb90073b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:11.791723 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94b56634-d0a9-4ecd-9a4a-e860eb90073b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:11.792154 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94b56634-d0a9-4ecd-9a4a-e860eb90073b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:11.930184 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-94b56634-d0a9-4ecd-9a4a-e860eb90073b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:11.937805 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-94b56634-d0a9-4ecd-9a4a-e860eb90073b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.159168 Aug 04 23:39:11.938379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 964/1898] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:11 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:12.960209 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-79dae53f-2d51-49be-b666-f8c955e6fc0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:12.960869 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-79dae53f-2d51-49be-b666-f8c955e6fc0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:12.967578 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79dae53f-2d51-49be-b666-f8c955e6fc0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:12.968076 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79dae53f-2d51-49be-b666-f8c955e6fc0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:12.968605 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79dae53f-2d51-49be-b666-f8c955e6fc0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:12.969379 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79dae53f-2d51-49be-b666-f8c955e6fc0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:12.969874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79dae53f-2d51-49be-b666-f8c955e6fc0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:12.970331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79dae53f-2d51-49be-b666-f8c955e6fc0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:13.105590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-79dae53f-2d51-49be-b666-f8c955e6fc0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:13.114065 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-79dae53f-2d51-49be-b666-f8c955e6fc0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.158043 Aug 04 23:39:13.114653 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 935/1899] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:12 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:14.136268 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-09a663aa-ca95-45c3-807b-6bc9c710137e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:14.136866 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-09a663aa-ca95-45c3-807b-6bc9c710137e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:14.143874 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09a663aa-ca95-45c3-807b-6bc9c710137e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:14.144358 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09a663aa-ca95-45c3-807b-6bc9c710137e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:14.144870 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09a663aa-ca95-45c3-807b-6bc9c710137e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:14.145485 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09a663aa-ca95-45c3-807b-6bc9c710137e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:14.145959 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09a663aa-ca95-45c3-807b-6bc9c710137e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:14.146413 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-09a663aa-ca95-45c3-807b-6bc9c710137e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:14.279278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-09a663aa-ca95-45c3-807b-6bc9c710137e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:14.287626 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-09a663aa-ca95-45c3-807b-6bc9c710137e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.155320 Aug 04 23:39:14.288204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 965/1900] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:14 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:15.308974 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9187fc97-7a54-4184-be85-a303ae470046 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:15.309577 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9187fc97-7a54-4184-be85-a303ae470046 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:15.316819 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9187fc97-7a54-4184-be85-a303ae470046 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:15.317294 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9187fc97-7a54-4184-be85-a303ae470046 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:15.317714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9187fc97-7a54-4184-be85-a303ae470046 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:15.318417 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9187fc97-7a54-4184-be85-a303ae470046 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:15.318861 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9187fc97-7a54-4184-be85-a303ae470046 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:15.319277 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9187fc97-7a54-4184-be85-a303ae470046 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:15.321792 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=78 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:39:15.459174 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9187fc97-7a54-4184-be85-a303ae470046 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:15.466830 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9187fc97-7a54-4184-be85-a303ae470046 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.161660 Aug 04 23:39:15.467396 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 936/1901] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:15 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:16.488593 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3535e61d-8da3-4d70-86a6-1b8deec456f3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:16.489194 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3535e61d-8da3-4d70-86a6-1b8deec456f3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:16.495631 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3535e61d-8da3-4d70-86a6-1b8deec456f3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:16.496109 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3535e61d-8da3-4d70-86a6-1b8deec456f3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:16.496541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3535e61d-8da3-4d70-86a6-1b8deec456f3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:16.497227 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3535e61d-8da3-4d70-86a6-1b8deec456f3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:16.497674 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3535e61d-8da3-4d70-86a6-1b8deec456f3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:16.498093 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3535e61d-8da3-4d70-86a6-1b8deec456f3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:16.633420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3535e61d-8da3-4d70-86a6-1b8deec456f3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:16.640922 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3535e61d-8da3-4d70-86a6-1b8deec456f3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.157006 Aug 04 23:39:16.641485 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 966/1902] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:16 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:17.662302 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-96fbdb9d-6353-438b-991b-67a83e562753 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:17.663051 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-96fbdb9d-6353-438b-991b-67a83e562753 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:17.669394 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96fbdb9d-6353-438b-991b-67a83e562753 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:17.669871 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96fbdb9d-6353-438b-991b-67a83e562753 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:17.670295 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96fbdb9d-6353-438b-991b-67a83e562753 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:17.671014 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96fbdb9d-6353-438b-991b-67a83e562753 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:17.671457 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96fbdb9d-6353-438b-991b-67a83e562753 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:17.671875 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-96fbdb9d-6353-438b-991b-67a83e562753 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:17.816585 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-96fbdb9d-6353-438b-991b-67a83e562753 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:17.825238 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-96fbdb9d-6353-438b-991b-67a83e562753 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.166836 Aug 04 23:39:17.826041 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 937/1903] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:17 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:18.847620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8b77876b-9d8d-4c61-b6d2-43270a69f7c5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:18.848258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8b77876b-9d8d-4c61-b6d2-43270a69f7c5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:18.854886 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b77876b-9d8d-4c61-b6d2-43270a69f7c5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:18.855368 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b77876b-9d8d-4c61-b6d2-43270a69f7c5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:18.855845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b77876b-9d8d-4c61-b6d2-43270a69f7c5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:18.856574 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b77876b-9d8d-4c61-b6d2-43270a69f7c5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:18.857058 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b77876b-9d8d-4c61-b6d2-43270a69f7c5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:18.857484 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b77876b-9d8d-4c61-b6d2-43270a69f7c5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:18.992445 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8b77876b-9d8d-4c61-b6d2-43270a69f7c5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:19.000001 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8b77876b-9d8d-4c61-b6d2-43270a69f7c5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.157341 Aug 04 23:39:19.000558 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 967/1904] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:18 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:20.021618 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-597ed9e7-231a-425b-b3aa-265413e61145 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:20.022228 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-597ed9e7-231a-425b-b3aa-265413e61145 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:20.024516 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=26 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:39:20.029732 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-597ed9e7-231a-425b-b3aa-265413e61145 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:20.030204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-597ed9e7-231a-425b-b3aa-265413e61145 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:20.030652 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-597ed9e7-231a-425b-b3aa-265413e61145 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:20.031339 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-597ed9e7-231a-425b-b3aa-265413e61145 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:20.031783 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-597ed9e7-231a-425b-b3aa-265413e61145 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:20.032200 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-597ed9e7-231a-425b-b3aa-265413e61145 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:20.170536 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-597ed9e7-231a-425b-b3aa-265413e61145 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:20.178927 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-597ed9e7-231a-425b-b3aa-265413e61145 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.162089 Aug 04 23:39:20.179488 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 938/1905] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:20 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:39:21.200371 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-db54eff1-36ea-4c99-af7e-89b080d9606e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:21.200983 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-db54eff1-36ea-4c99-af7e-89b080d9606e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:21.203427 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=26 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:39:21.208467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-db54eff1-36ea-4c99-af7e-89b080d9606e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:21.209009 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-db54eff1-36ea-4c99-af7e-89b080d9606e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:21.209472 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-db54eff1-36ea-4c99-af7e-89b080d9606e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:21.210188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-db54eff1-36ea-4c99-af7e-89b080d9606e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:21.210674 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-db54eff1-36ea-4c99-af7e-89b080d9606e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:21.211105 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-db54eff1-36ea-4c99-af7e-89b080d9606e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:21.214315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=78 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:39:21.350570 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-db54eff1-36ea-4c99-af7e-89b080d9606e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:21.358072 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-db54eff1-36ea-4c99-af7e-89b080d9606e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.161568 Aug 04 23:39:21.358656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 968/1906] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:21 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:22.379181 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c49b8ad8-909e-4dd4-bd23-a8e8affd9307 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:22.379815 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c49b8ad8-909e-4dd4-bd23-a8e8affd9307 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:22.385931 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c49b8ad8-909e-4dd4-bd23-a8e8affd9307 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:22.386425 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c49b8ad8-909e-4dd4-bd23-a8e8affd9307 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:22.386854 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c49b8ad8-909e-4dd4-bd23-a8e8affd9307 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:22.387544 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c49b8ad8-909e-4dd4-bd23-a8e8affd9307 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:22.387987 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c49b8ad8-909e-4dd4-bd23-a8e8affd9307 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:22.388407 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c49b8ad8-909e-4dd4-bd23-a8e8affd9307 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:22.522681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c49b8ad8-909e-4dd4-bd23-a8e8affd9307 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:22.530144 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c49b8ad8-909e-4dd4-bd23-a8e8affd9307 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.155185 Aug 04 23:39:22.530739 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 939/1907] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:22 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:23.551230 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d26d1350-0349-4266-9668-4ca4560583a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:23.551871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d26d1350-0349-4266-9668-4ca4560583a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:23.558549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d26d1350-0349-4266-9668-4ca4560583a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:23.559025 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d26d1350-0349-4266-9668-4ca4560583a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:23.559453 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d26d1350-0349-4266-9668-4ca4560583a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:23.560131 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d26d1350-0349-4266-9668-4ca4560583a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:23.560580 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d26d1350-0349-4266-9668-4ca4560583a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:23.561000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d26d1350-0349-4266-9668-4ca4560583a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:23.701190 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d26d1350-0349-4266-9668-4ca4560583a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:23.709382 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d26d1350-0349-4266-9668-4ca4560583a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.162400 Aug 04 23:39:23.709944 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 969/1908] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:23 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:24.730834 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a3c275c8-10a6-468d-a6db-4e5f6e86ac91 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:24.731447 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a3c275c8-10a6-468d-a6db-4e5f6e86ac91 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:24.738660 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3c275c8-10a6-468d-a6db-4e5f6e86ac91 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:24.739145 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3c275c8-10a6-468d-a6db-4e5f6e86ac91 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:24.739580 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3c275c8-10a6-468d-a6db-4e5f6e86ac91 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:24.740287 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3c275c8-10a6-468d-a6db-4e5f6e86ac91 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:24.740740 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3c275c8-10a6-468d-a6db-4e5f6e86ac91 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:24.741192 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3c275c8-10a6-468d-a6db-4e5f6e86ac91 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:24.875871 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a3c275c8-10a6-468d-a6db-4e5f6e86ac91 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:24.885507 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a3c275c8-10a6-468d-a6db-4e5f6e86ac91 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.158219 Aug 04 23:39:24.886550 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 940/1909] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:24 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:25.907952 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1aa3fad6-1242-4c6f-b2f7-80cafd523b48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:25.908645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1aa3fad6-1242-4c6f-b2f7-80cafd523b48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:25.914844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1aa3fad6-1242-4c6f-b2f7-80cafd523b48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:25.915324 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1aa3fad6-1242-4c6f-b2f7-80cafd523b48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:25.915812 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1aa3fad6-1242-4c6f-b2f7-80cafd523b48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:25.916503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1aa3fad6-1242-4c6f-b2f7-80cafd523b48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:25.916954 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1aa3fad6-1242-4c6f-b2f7-80cafd523b48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:25.917382 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1aa3fad6-1242-4c6f-b2f7-80cafd523b48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:26.059395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1aa3fad6-1242-4c6f-b2f7-80cafd523b48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:26.067255 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1aa3fad6-1242-4c6f-b2f7-80cafd523b48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.163238 Aug 04 23:39:26.067818 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 970/1910] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:25 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:27.088600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f42c5b7d-d97a-43bf-a36e-77c2fcf33f8e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:27.089148 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f42c5b7d-d97a-43bf-a36e-77c2fcf33f8e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:27.096179 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f42c5b7d-d97a-43bf-a36e-77c2fcf33f8e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:27.097020 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f42c5b7d-d97a-43bf-a36e-77c2fcf33f8e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:27.097457 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f42c5b7d-d97a-43bf-a36e-77c2fcf33f8e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:27.098137 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f42c5b7d-d97a-43bf-a36e-77c2fcf33f8e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:27.098600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f42c5b7d-d97a-43bf-a36e-77c2fcf33f8e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:27.099016 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f42c5b7d-d97a-43bf-a36e-77c2fcf33f8e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:27.229732 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f42c5b7d-d97a-43bf-a36e-77c2fcf33f8e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:27.237873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f42c5b7d-d97a-43bf-a36e-77c2fcf33f8e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.153191 Aug 04 23:39:27.238455 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 941/1911] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:27 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:28.259207 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-de717e5b-2f7b-4215-b41a-b246ec0f3235 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:28.259821 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-de717e5b-2f7b-4215-b41a-b246ec0f3235 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:28.266233 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de717e5b-2f7b-4215-b41a-b246ec0f3235 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:28.266742 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de717e5b-2f7b-4215-b41a-b246ec0f3235 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:28.267176 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de717e5b-2f7b-4215-b41a-b246ec0f3235 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:28.268770 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de717e5b-2f7b-4215-b41a-b246ec0f3235 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:28.269238 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de717e5b-2f7b-4215-b41a-b246ec0f3235 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:28.269692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de717e5b-2f7b-4215-b41a-b246ec0f3235 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:28.399924 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-de717e5b-2f7b-4215-b41a-b246ec0f3235 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:28.407427 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-de717e5b-2f7b-4215-b41a-b246ec0f3235 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.152081 Aug 04 23:39:28.408060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 971/1912] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:28 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:29.428880 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9b421820-bcba-4cb0-9f5e-422b96d91d0c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:29.429544 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9b421820-bcba-4cb0-9f5e-422b96d91d0c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:29.435847 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9b421820-bcba-4cb0-9f5e-422b96d91d0c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:29.436322 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9b421820-bcba-4cb0-9f5e-422b96d91d0c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:29.436746 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9b421820-bcba-4cb0-9f5e-422b96d91d0c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:29.437425 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9b421820-bcba-4cb0-9f5e-422b96d91d0c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:29.437868 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9b421820-bcba-4cb0-9f5e-422b96d91d0c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:29.438280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9b421820-bcba-4cb0-9f5e-422b96d91d0c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:29.573593 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9b421820-bcba-4cb0-9f5e-422b96d91d0c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:29.582418 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9b421820-bcba-4cb0-9f5e-422b96d91d0c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.158262 Aug 04 23:39:29.582986 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 942/1913] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:29 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:30.603103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-08618551-797a-4c36-865c-e7782ff72b10 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:30.603718 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-08618551-797a-4c36-865c-e7782ff72b10 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:30.610188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-08618551-797a-4c36-865c-e7782ff72b10 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:30.610703 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-08618551-797a-4c36-865c-e7782ff72b10 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:30.611844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-08618551-797a-4c36-865c-e7782ff72b10 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:30.612618 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-08618551-797a-4c36-865c-e7782ff72b10 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:30.613075 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-08618551-797a-4c36-865c-e7782ff72b10 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:30.613501 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-08618551-797a-4c36-865c-e7782ff72b10 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:30.746077 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-08618551-797a-4c36-865c-e7782ff72b10 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:30.754250 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-08618551-797a-4c36-865c-e7782ff72b10 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.155010 Aug 04 23:39:30.754842 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 972/1914] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:30 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:31.774884 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f7c2ecdd-07e7-456e-8306-060d303b3642 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:31.775505 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f7c2ecdd-07e7-456e-8306-060d303b3642 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:31.781908 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7c2ecdd-07e7-456e-8306-060d303b3642 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:31.782400 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7c2ecdd-07e7-456e-8306-060d303b3642 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:31.783522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7c2ecdd-07e7-456e-8306-060d303b3642 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:31.784243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7c2ecdd-07e7-456e-8306-060d303b3642 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:31.784694 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7c2ecdd-07e7-456e-8306-060d303b3642 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:31.785114 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7c2ecdd-07e7-456e-8306-060d303b3642 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:31.919943 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f7c2ecdd-07e7-456e-8306-060d303b3642 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:31.927918 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f7c2ecdd-07e7-456e-8306-060d303b3642 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.156921 Aug 04 23:39:31.928481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 943/1915] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:31 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:32.947896 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1eade166-ac2d-49b0-886c-85b355fcd8db tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:32.948500 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1eade166-ac2d-49b0-886c-85b355fcd8db tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:32.955684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1eade166-ac2d-49b0-886c-85b355fcd8db tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:32.956161 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1eade166-ac2d-49b0-886c-85b355fcd8db tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:32.956595 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1eade166-ac2d-49b0-886c-85b355fcd8db tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:32.957279 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1eade166-ac2d-49b0-886c-85b355fcd8db tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:32.957732 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1eade166-ac2d-49b0-886c-85b355fcd8db tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:32.958144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1eade166-ac2d-49b0-886c-85b355fcd8db tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:33.091360 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1eade166-ac2d-49b0-886c-85b355fcd8db tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:33.099556 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1eade166-ac2d-49b0-886c-85b355fcd8db tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.155501 Aug 04 23:39:33.100125 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 973/1916] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:32 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:34.120337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9889e523-f816-4582-ab83-45170a30004d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:34.120933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9889e523-f816-4582-ab83-45170a30004d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:34.128388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9889e523-f816-4582-ab83-45170a30004d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:34.128862 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9889e523-f816-4582-ab83-45170a30004d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:34.129293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9889e523-f816-4582-ab83-45170a30004d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:34.129983 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9889e523-f816-4582-ab83-45170a30004d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:34.130461 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9889e523-f816-4582-ab83-45170a30004d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:34.130916 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9889e523-f816-4582-ab83-45170a30004d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:34.262036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9889e523-f816-4582-ab83-45170a30004d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:34.269967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9889e523-f816-4582-ab83-45170a30004d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.153541 Aug 04 23:39:34.270555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 944/1917] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:34 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:35.290338 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c3d790f0-ff28-49e4-ad14-50549778f02e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:35.290965 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c3d790f0-ff28-49e4-ad14-50549778f02e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:35.297648 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3d790f0-ff28-49e4-ad14-50549778f02e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:35.298129 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3d790f0-ff28-49e4-ad14-50549778f02e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:35.299225 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3d790f0-ff28-49e4-ad14-50549778f02e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:35.299884 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3d790f0-ff28-49e4-ad14-50549778f02e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:35.300341 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3d790f0-ff28-49e4-ad14-50549778f02e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:35.300768 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3d790f0-ff28-49e4-ad14-50549778f02e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:35.441793 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c3d790f0-ff28-49e4-ad14-50549778f02e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:35.449390 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c3d790f0-ff28-49e4-ad14-50549778f02e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.162931 Aug 04 23:39:35.449982 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 974/1918] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:35 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:36.471048 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3e41981f-2f8b-41d6-b4c4-c0f19479fbbf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:36.471776 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3e41981f-2f8b-41d6-b4c4-c0f19479fbbf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:36.478427 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e41981f-2f8b-41d6-b4c4-c0f19479fbbf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:36.478990 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e41981f-2f8b-41d6-b4c4-c0f19479fbbf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:36.479352 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e41981f-2f8b-41d6-b4c4-c0f19479fbbf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:36.480051 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e41981f-2f8b-41d6-b4c4-c0f19479fbbf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:36.480503 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e41981f-2f8b-41d6-b4c4-c0f19479fbbf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:36.480926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e41981f-2f8b-41d6-b4c4-c0f19479fbbf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:36.616416 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3e41981f-2f8b-41d6-b4c4-c0f19479fbbf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:36.623864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3e41981f-2f8b-41d6-b4c4-c0f19479fbbf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.157470 Aug 04 23:39:36.624414 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 945/1919] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:36 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:37.644559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-07a4813c-d27a-45f6-93dc-338051860f0a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:37.645172 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-07a4813c-d27a-45f6-93dc-338051860f0a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:37.651751 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-07a4813c-d27a-45f6-93dc-338051860f0a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:37.652235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-07a4813c-d27a-45f6-93dc-338051860f0a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:37.652674 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-07a4813c-d27a-45f6-93dc-338051860f0a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:37.653376 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-07a4813c-d27a-45f6-93dc-338051860f0a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:37.653846 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-07a4813c-d27a-45f6-93dc-338051860f0a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:37.654274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-07a4813c-d27a-45f6-93dc-338051860f0a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:37.794729 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-07a4813c-d27a-45f6-93dc-338051860f0a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:37.802756 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-07a4813c-d27a-45f6-93dc-338051860f0a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.162028 Aug 04 23:39:37.803320 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 975/1920] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:37 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:38.823932 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7694a682-7a7c-49fd-9a9f-c2eba2d24012 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:38.824545 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7694a682-7a7c-49fd-9a9f-c2eba2d24012 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:38.832339 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7694a682-7a7c-49fd-9a9f-c2eba2d24012 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:38.832819 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7694a682-7a7c-49fd-9a9f-c2eba2d24012 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:38.833246 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7694a682-7a7c-49fd-9a9f-c2eba2d24012 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:38.833944 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7694a682-7a7c-49fd-9a9f-c2eba2d24012 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:38.834414 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7694a682-7a7c-49fd-9a9f-c2eba2d24012 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:38.834835 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7694a682-7a7c-49fd-9a9f-c2eba2d24012 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:38.968207 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7694a682-7a7c-49fd-9a9f-c2eba2d24012 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:38.975902 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7694a682-7a7c-49fd-9a9f-c2eba2d24012 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.155794 Aug 04 23:39:38.976476 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 946/1921] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:38 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:39.996951 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3351e871-b943-42d6-9675-5477fedfd096 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:39.997502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3351e871-b943-42d6-9675-5477fedfd096 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:40.004039 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3351e871-b943-42d6-9675-5477fedfd096 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:40.004525 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3351e871-b943-42d6-9675-5477fedfd096 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:40.004958 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3351e871-b943-42d6-9675-5477fedfd096 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:40.005664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3351e871-b943-42d6-9675-5477fedfd096 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:40.006113 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3351e871-b943-42d6-9675-5477fedfd096 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:40.006571 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3351e871-b943-42d6-9675-5477fedfd096 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:40.143713 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3351e871-b943-42d6-9675-5477fedfd096 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:40.151359 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3351e871-b943-42d6-9675-5477fedfd096 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.158357 Aug 04 23:39:40.151926 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 976/1922] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:39 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:41.172739 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1428c53c-dec1-4ad2-b9b8-cbe02540082b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:41.173863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1428c53c-dec1-4ad2-b9b8-cbe02540082b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:41.180483 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1428c53c-dec1-4ad2-b9b8-cbe02540082b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:41.180955 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1428c53c-dec1-4ad2-b9b8-cbe02540082b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:41.181377 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1428c53c-dec1-4ad2-b9b8-cbe02540082b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:41.182058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1428c53c-dec1-4ad2-b9b8-cbe02540082b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:41.182528 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1428c53c-dec1-4ad2-b9b8-cbe02540082b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:41.182940 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1428c53c-dec1-4ad2-b9b8-cbe02540082b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:41.320543 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1428c53c-dec1-4ad2-b9b8-cbe02540082b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:41.328066 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1428c53c-dec1-4ad2-b9b8-cbe02540082b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.159178 Aug 04 23:39:41.328626 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 947/1923] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:41 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:42.349769 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ac43e1a7-0976-4ed2-afd3-6a5e1b929c15 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:42.350461 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ac43e1a7-0976-4ed2-afd3-6a5e1b929c15 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:42.357584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac43e1a7-0976-4ed2-afd3-6a5e1b929c15 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:42.358078 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac43e1a7-0976-4ed2-afd3-6a5e1b929c15 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:42.358577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac43e1a7-0976-4ed2-afd3-6a5e1b929c15 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:42.359616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac43e1a7-0976-4ed2-afd3-6a5e1b929c15 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:42.360080 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac43e1a7-0976-4ed2-afd3-6a5e1b929c15 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:42.361006 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac43e1a7-0976-4ed2-afd3-6a5e1b929c15 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:42.504954 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ac43e1a7-0976-4ed2-afd3-6a5e1b929c15 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:42.513064 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ac43e1a7-0976-4ed2-afd3-6a5e1b929c15 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.167577 Aug 04 23:39:42.513648 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 977/1924] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:42 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:43.534962 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4dd8473f-7ea8-4e4b-8bbf-f7e4586cb34f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:43.535559 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4dd8473f-7ea8-4e4b-8bbf-f7e4586cb34f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:43.541937 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dd8473f-7ea8-4e4b-8bbf-f7e4586cb34f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:43.542437 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dd8473f-7ea8-4e4b-8bbf-f7e4586cb34f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:43.542871 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dd8473f-7ea8-4e4b-8bbf-f7e4586cb34f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:43.543560 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dd8473f-7ea8-4e4b-8bbf-f7e4586cb34f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:43.544029 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dd8473f-7ea8-4e4b-8bbf-f7e4586cb34f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:43.544427 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dd8473f-7ea8-4e4b-8bbf-f7e4586cb34f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:43.615960 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:39:43.616455 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:39:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:39:43.684830 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4dd8473f-7ea8-4e4b-8bbf-f7e4586cb34f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:43.692482 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4dd8473f-7ea8-4e4b-8bbf-f7e4586cb34f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.161436 Aug 04 23:39:43.693038 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 948/1925] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:43 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:44.713200 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1c93b6f8-edc9-4104-8305-30236ad139f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:44.713798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1c93b6f8-edc9-4104-8305-30236ad139f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:44.720956 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c93b6f8-edc9-4104-8305-30236ad139f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:44.721448 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c93b6f8-edc9-4104-8305-30236ad139f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:44.721888 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c93b6f8-edc9-4104-8305-30236ad139f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:44.722623 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c93b6f8-edc9-4104-8305-30236ad139f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:44.723073 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c93b6f8-edc9-4104-8305-30236ad139f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:44.723498 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c93b6f8-edc9-4104-8305-30236ad139f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:44.854820 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1c93b6f8-edc9-4104-8305-30236ad139f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:44.863347 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1c93b6f8-edc9-4104-8305-30236ad139f6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.154102 Aug 04 23:39:44.863904 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 978/1926] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:44 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:45.884586 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-de9beb4b-1bdc-4402-a9dd-4df5e489c67a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:45.885144 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-de9beb4b-1bdc-4402-a9dd-4df5e489c67a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:45.891574 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de9beb4b-1bdc-4402-a9dd-4df5e489c67a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:45.892067 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de9beb4b-1bdc-4402-a9dd-4df5e489c67a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:45.892498 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de9beb4b-1bdc-4402-a9dd-4df5e489c67a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:45.893183 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de9beb4b-1bdc-4402-a9dd-4df5e489c67a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:45.893631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de9beb4b-1bdc-4402-a9dd-4df5e489c67a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:45.894058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de9beb4b-1bdc-4402-a9dd-4df5e489c67a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:45.896609 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=78 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:39:46.030812 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-de9beb4b-1bdc-4402-a9dd-4df5e489c67a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:46.039746 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-de9beb4b-1bdc-4402-a9dd-4df5e489c67a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.159093 Aug 04 23:39:46.040316 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 949/1927] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:45 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:47.061431 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4f585a65-df0a-4cf4-92c8-7bf2e7c9cb75 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:47.062066 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4f585a65-df0a-4cf4-92c8-7bf2e7c9cb75 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:47.069219 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f585a65-df0a-4cf4-92c8-7bf2e7c9cb75 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:47.069710 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f585a65-df0a-4cf4-92c8-7bf2e7c9cb75 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:47.070150 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f585a65-df0a-4cf4-92c8-7bf2e7c9cb75 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:47.070876 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f585a65-df0a-4cf4-92c8-7bf2e7c9cb75 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:47.071333 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f585a65-df0a-4cf4-92c8-7bf2e7c9cb75 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:47.071760 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f585a65-df0a-4cf4-92c8-7bf2e7c9cb75 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:47.203237 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4f585a65-df0a-4cf4-92c8-7bf2e7c9cb75 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:47.211702 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4f585a65-df0a-4cf4-92c8-7bf2e7c9cb75 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.154130 Aug 04 23:39:47.212274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 979/1928] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:47 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:48.232789 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2698f9c5-7a24-484e-aa99-f310a8284fae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:48.233406 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2698f9c5-7a24-484e-aa99-f310a8284fae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:48.240195 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2698f9c5-7a24-484e-aa99-f310a8284fae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:48.240679 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2698f9c5-7a24-484e-aa99-f310a8284fae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:48.241118 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2698f9c5-7a24-484e-aa99-f310a8284fae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:48.241833 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2698f9c5-7a24-484e-aa99-f310a8284fae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:48.242271 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2698f9c5-7a24-484e-aa99-f310a8284fae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:48.242732 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2698f9c5-7a24-484e-aa99-f310a8284fae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:48.373729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2698f9c5-7a24-484e-aa99-f310a8284fae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:48.381788 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2698f9c5-7a24-484e-aa99-f310a8284fae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.153085 Aug 04 23:39:48.382414 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 950/1929] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:48 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:49.402154 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-822f9ada-222f-4a72-a376-fb627b3eed38 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:49.402796 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-822f9ada-222f-4a72-a376-fb627b3eed38 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:49.409389 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-822f9ada-222f-4a72-a376-fb627b3eed38 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:49.409873 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-822f9ada-222f-4a72-a376-fb627b3eed38 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:49.410315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-822f9ada-222f-4a72-a376-fb627b3eed38 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:49.411033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-822f9ada-222f-4a72-a376-fb627b3eed38 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:49.411487 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-822f9ada-222f-4a72-a376-fb627b3eed38 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:49.411910 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-822f9ada-222f-4a72-a376-fb627b3eed38 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:49.546116 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-822f9ada-222f-4a72-a376-fb627b3eed38 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:49.554683 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-822f9ada-222f-4a72-a376-fb627b3eed38 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.156349 Aug 04 23:39:49.555253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 980/1930] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:49 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:50.576300 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9e83196c-413f-47f2-a515-e7ad7ce07142 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:50.576927 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9e83196c-413f-47f2-a515-e7ad7ce07142 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:50.580000 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=26 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:39:50.585886 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e83196c-413f-47f2-a515-e7ad7ce07142 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:50.586379 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e83196c-413f-47f2-a515-e7ad7ce07142 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:50.586813 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e83196c-413f-47f2-a515-e7ad7ce07142 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:50.587499 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e83196c-413f-47f2-a515-e7ad7ce07142 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:50.587939 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e83196c-413f-47f2-a515-e7ad7ce07142 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:50.588353 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e83196c-413f-47f2-a515-e7ad7ce07142 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:50.722905 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9e83196c-413f-47f2-a515-e7ad7ce07142 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:50.730470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9e83196c-413f-47f2-a515-e7ad7ce07142 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.157975 Aug 04 23:39:50.731030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 951/1931] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:50 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:51.751861 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-57b53e83-d310-42e7-8b58-416f609e5118 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:51.752488 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-57b53e83-d310-42e7-8b58-416f609e5118 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:51.755074 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=26 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:39:51.760256 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57b53e83-d310-42e7-8b58-416f609e5118 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:51.760729 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57b53e83-d310-42e7-8b58-416f609e5118 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:51.761154 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57b53e83-d310-42e7-8b58-416f609e5118 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:51.761838 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57b53e83-d310-42e7-8b58-416f609e5118 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:51.762282 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57b53e83-d310-42e7-8b58-416f609e5118 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:51.762722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-57b53e83-d310-42e7-8b58-416f609e5118 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:51.765646 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=78 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:39:51.903948 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-57b53e83-d310-42e7-8b58-416f609e5118 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:51.911806 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-57b53e83-d310-42e7-8b58-416f609e5118 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.163918 Aug 04 23:39:51.912377 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 981/1932] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:51 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:52.934465 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ad5394b0-bee9-4d2c-9faa-716bcba41f49 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:52.935098 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ad5394b0-bee9-4d2c-9faa-716bcba41f49 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:52.943375 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad5394b0-bee9-4d2c-9faa-716bcba41f49 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:52.943851 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad5394b0-bee9-4d2c-9faa-716bcba41f49 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:52.944280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad5394b0-bee9-4d2c-9faa-716bcba41f49 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:52.945296 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad5394b0-bee9-4d2c-9faa-716bcba41f49 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:52.945766 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad5394b0-bee9-4d2c-9faa-716bcba41f49 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:52.946211 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad5394b0-bee9-4d2c-9faa-716bcba41f49 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:53.109526 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ad5394b0-bee9-4d2c-9faa-716bcba41f49 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:53.121452 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ad5394b0-bee9-4d2c-9faa-716bcba41f49 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.191124 Aug 04 23:39:53.126896 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 952/1933] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:52 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:54.148281 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5e672a98-87db-4db5-b1f6-88b10dab2d36 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:54.148869 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5e672a98-87db-4db5-b1f6-88b10dab2d36 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:54.155950 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e672a98-87db-4db5-b1f6-88b10dab2d36 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:54.156439 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e672a98-87db-4db5-b1f6-88b10dab2d36 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:54.157090 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e672a98-87db-4db5-b1f6-88b10dab2d36 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:54.158021 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e672a98-87db-4db5-b1f6-88b10dab2d36 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:54.158502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e672a98-87db-4db5-b1f6-88b10dab2d36 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:54.158925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5e672a98-87db-4db5-b1f6-88b10dab2d36 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:54.293491 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5e672a98-87db-4db5-b1f6-88b10dab2d36 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:54.301032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5e672a98-87db-4db5-b1f6-88b10dab2d36 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.157088 Aug 04 23:39:54.301881 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 982/1934] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:54 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:55.322184 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5b8efe0a-631a-46e8-b8cb-f160a99b6ffb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:55.322834 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5b8efe0a-631a-46e8-b8cb-f160a99b6ffb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:55.329942 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b8efe0a-631a-46e8-b8cb-f160a99b6ffb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:55.330447 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b8efe0a-631a-46e8-b8cb-f160a99b6ffb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:55.330883 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b8efe0a-631a-46e8-b8cb-f160a99b6ffb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:55.331572 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b8efe0a-631a-46e8-b8cb-f160a99b6ffb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:55.332023 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b8efe0a-631a-46e8-b8cb-f160a99b6ffb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:55.332446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5b8efe0a-631a-46e8-b8cb-f160a99b6ffb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:55.463712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5b8efe0a-631a-46e8-b8cb-f160a99b6ffb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:55.471467 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5b8efe0a-631a-46e8-b8cb-f160a99b6ffb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.153142 Aug 04 23:39:55.472035 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 953/1935] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:55 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:56.492396 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-bcb52eec-e0b3-4864-be2e-e42e22974375 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:56.493014 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-bcb52eec-e0b3-4864-be2e-e42e22974375 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:56.499567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bcb52eec-e0b3-4864-be2e-e42e22974375 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:56.500028 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bcb52eec-e0b3-4864-be2e-e42e22974375 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:56.501376 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bcb52eec-e0b3-4864-be2e-e42e22974375 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:56.502311 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bcb52eec-e0b3-4864-be2e-e42e22974375 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:56.502792 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bcb52eec-e0b3-4864-be2e-e42e22974375 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:56.503213 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bcb52eec-e0b3-4864-be2e-e42e22974375 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:56.636265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-bcb52eec-e0b3-4864-be2e-e42e22974375 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:56.643991 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-bcb52eec-e0b3-4864-be2e-e42e22974375 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.155396 Aug 04 23:39:56.644567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 983/1936] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:56 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:57.665464 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5d3839e4-d021-4771-95b7-7907da3b413d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:57.666092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5d3839e4-d021-4771-95b7-7907da3b413d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:57.672908 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5d3839e4-d021-4771-95b7-7907da3b413d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:57.673084 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5d3839e4-d021-4771-95b7-7907da3b413d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:57.673497 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5d3839e4-d021-4771-95b7-7907da3b413d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:57.674186 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5d3839e4-d021-4771-95b7-7907da3b413d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:57.674657 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5d3839e4-d021-4771-95b7-7907da3b413d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:57.675079 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5d3839e4-d021-4771-95b7-7907da3b413d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:57.815252 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5d3839e4-d021-4771-95b7-7907da3b413d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:57.822845 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5d3839e4-d021-4771-95b7-7907da3b413d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.161268 Aug 04 23:39:57.823399 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 954/1937] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:57 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:39:58.844716 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-330624dd-c068-4cd3-9b6b-cbcd874de3a8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:39:58.845545 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-330624dd-c068-4cd3-9b6b-cbcd874de3a8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:39:58.852174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-330624dd-c068-4cd3-9b6b-cbcd874de3a8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:58.852656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-330624dd-c068-4cd3-9b6b-cbcd874de3a8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:58.853094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-330624dd-c068-4cd3-9b6b-cbcd874de3a8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:58.853789 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-330624dd-c068-4cd3-9b6b-cbcd874de3a8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:39:58.854242 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-330624dd-c068-4cd3-9b6b-cbcd874de3a8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:39:58.854692 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-330624dd-c068-4cd3-9b6b-cbcd874de3a8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:39:58.986910 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-330624dd-c068-4cd3-9b6b-cbcd874de3a8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:39:58.994485 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-330624dd-c068-4cd3-9b6b-cbcd874de3a8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.154196 Aug 04 23:39:58.995064 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 984/1938] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:39:58 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:00.018533 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d0e058d4-23bd-4d44-a360-8f89728b32d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:00.019267 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d0e058d4-23bd-4d44-a360-8f89728b32d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:00.025712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d0e058d4-23bd-4d44-a360-8f89728b32d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:00.026189 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d0e058d4-23bd-4d44-a360-8f89728b32d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:00.026657 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d0e058d4-23bd-4d44-a360-8f89728b32d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:00.027386 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d0e058d4-23bd-4d44-a360-8f89728b32d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:00.027838 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d0e058d4-23bd-4d44-a360-8f89728b32d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:00.028254 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d0e058d4-23bd-4d44-a360-8f89728b32d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:00.165841 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d0e058d4-23bd-4d44-a360-8f89728b32d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:00.174760 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d0e058d4-23bd-4d44-a360-8f89728b32d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.160591 Aug 04 23:40:00.175573 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 955/1939] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:00 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:01.196427 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9f2b7328-bfef-451b-b10d-33210107bfee tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:01.197069 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9f2b7328-bfef-451b-b10d-33210107bfee tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:01.203444 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9f2b7328-bfef-451b-b10d-33210107bfee tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:01.203923 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9f2b7328-bfef-451b-b10d-33210107bfee tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:01.204353 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9f2b7328-bfef-451b-b10d-33210107bfee tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:01.205041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9f2b7328-bfef-451b-b10d-33210107bfee tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:01.205485 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9f2b7328-bfef-451b-b10d-33210107bfee tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:01.205910 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9f2b7328-bfef-451b-b10d-33210107bfee tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:01.337785 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9f2b7328-bfef-451b-b10d-33210107bfee tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:01.346099 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9f2b7328-bfef-451b-b10d-33210107bfee tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.153531 Aug 04 23:40:01.346765 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 985/1940] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:01 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:02.366951 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-72dba7ff-a45c-4aa2-9812-ac3d4659f5e1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:02.367563 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-72dba7ff-a45c-4aa2-9812-ac3d4659f5e1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:02.374083 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-72dba7ff-a45c-4aa2-9812-ac3d4659f5e1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:02.374589 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-72dba7ff-a45c-4aa2-9812-ac3d4659f5e1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:02.375078 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-72dba7ff-a45c-4aa2-9812-ac3d4659f5e1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:02.376425 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-72dba7ff-a45c-4aa2-9812-ac3d4659f5e1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:02.376873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-72dba7ff-a45c-4aa2-9812-ac3d4659f5e1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:02.377333 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-72dba7ff-a45c-4aa2-9812-ac3d4659f5e1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:02.508605 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-72dba7ff-a45c-4aa2-9812-ac3d4659f5e1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:02.516019 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-72dba7ff-a45c-4aa2-9812-ac3d4659f5e1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1450 microversion: 2.1 time: 0.153025 Aug 04 23:40:02.516574 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 956/1941] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:02 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:03.536994 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-87381e0d-97b1-479f-81c4-9800c590a332 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:03.537688 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-87381e0d-97b1-479f-81c4-9800c590a332 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:03.546904 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87381e0d-97b1-479f-81c4-9800c590a332 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:03.548408 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87381e0d-97b1-479f-81c4-9800c590a332 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:03.548864 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87381e0d-97b1-479f-81c4-9800c590a332 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:03.555472 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-5e047a0e-bd3c-4942-88b0-e44bbaf9c5b3 req-30b5fe12-f900-4a19-bba4-a2852ae57038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a0c9ea5-2710-4533-b166-010d46ab0027", "name": "network-vif-deleted", "tag": "288e902d-3b66-41d9-a3c5-5e1bbfb5e18b"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:40:03.560813 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87381e0d-97b1-479f-81c4-9800c590a332 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:03.561792 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87381e0d-97b1-479f-81c4-9800c590a332 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:03.562250 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87381e0d-97b1-479f-81c4-9800c590a332 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:03.579048 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-5e047a0e-bd3c-4942-88b0-e44bbaf9c5b3 req-30b5fe12-f900-4a19-bba4-a2852ae57038 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:03.579698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-5e047a0e-bd3c-4942-88b0-e44bbaf9c5b3 req-30b5fe12-f900-4a19-bba4-a2852ae57038 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:03.580426 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-5e047a0e-bd3c-4942-88b0-e44bbaf9c5b3 req-30b5fe12-f900-4a19-bba4-a2852ae57038 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:03.594912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-5e047a0e-bd3c-4942-88b0-e44bbaf9c5b3 req-30b5fe12-f900-4a19-bba4-a2852ae57038 service nova] Creating event network-vif-deleted:288e902d-3b66-41d9-a3c5-5e1bbfb5e18b for instance 7a0c9ea5-2710-4533-b166-010d46ab0027 on hv-cinder-85221 Aug 04 23:40:03.602076 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-5e047a0e-bd3c-4942-88b0-e44bbaf9c5b3 req-30b5fe12-f900-4a19-bba4-a2852ae57038 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050369 Aug 04 23:40:03.603115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 957/1942] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:40:03.659946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-87381e0d-97b1-479f-81c4-9800c590a332 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:03.668290 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-87381e0d-97b1-479f-81c4-9800c590a332 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1377 microversion: 2.1 time: 0.135164 Aug 04 23:40:03.668931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 986/1943] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:03 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1377 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:04.691006 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6bab3091-37a5-42dc-90a5-bd144dfe6bb8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:04.691709 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6bab3091-37a5-42dc-90a5-bd144dfe6bb8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:04.697833 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6bab3091-37a5-42dc-90a5-bd144dfe6bb8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:04.698306 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6bab3091-37a5-42dc-90a5-bd144dfe6bb8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:04.698768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6bab3091-37a5-42dc-90a5-bd144dfe6bb8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:04.699448 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6bab3091-37a5-42dc-90a5-bd144dfe6bb8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:04.699897 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6bab3091-37a5-42dc-90a5-bd144dfe6bb8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:04.700319 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6bab3091-37a5-42dc-90a5-bd144dfe6bb8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:04.763254 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6bab3091-37a5-42dc-90a5-bd144dfe6bb8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:04.771260 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6bab3091-37a5-42dc-90a5-bd144dfe6bb8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084971 Aug 04 23:40:04.771813 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 958/1944] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:04 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:05.792577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e6cf7987-57ef-4f77-adb7-2c2df55bf95a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:05.793382 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e6cf7987-57ef-4f77-adb7-2c2df55bf95a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:05.801017 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6cf7987-57ef-4f77-adb7-2c2df55bf95a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:05.801502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6cf7987-57ef-4f77-adb7-2c2df55bf95a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:05.801938 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6cf7987-57ef-4f77-adb7-2c2df55bf95a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:05.802691 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6cf7987-57ef-4f77-adb7-2c2df55bf95a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:05.803144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6cf7987-57ef-4f77-adb7-2c2df55bf95a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:05.803565 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e6cf7987-57ef-4f77-adb7-2c2df55bf95a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:05.868167 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e6cf7987-57ef-4f77-adb7-2c2df55bf95a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:05.876015 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e6cf7987-57ef-4f77-adb7-2c2df55bf95a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.087269 Aug 04 23:40:05.876586 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 987/1945] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:05 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:06.897615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0a4f9470-b1a4-4c91-8f00-b6c532831432 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:06.898241 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0a4f9470-b1a4-4c91-8f00-b6c532831432 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:06.904684 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0a4f9470-b1a4-4c91-8f00-b6c532831432 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:06.905158 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0a4f9470-b1a4-4c91-8f00-b6c532831432 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:06.905614 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0a4f9470-b1a4-4c91-8f00-b6c532831432 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:06.907563 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0a4f9470-b1a4-4c91-8f00-b6c532831432 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:06.908013 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0a4f9470-b1a4-4c91-8f00-b6c532831432 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:06.908438 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0a4f9470-b1a4-4c91-8f00-b6c532831432 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:06.973720 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0a4f9470-b1a4-4c91-8f00-b6c532831432 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:06.981351 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0a4f9470-b1a4-4c91-8f00-b6c532831432 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.087525 Aug 04 23:40:06.981914 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 959/1946] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:06 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:08.002503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6e28e51f-c0f5-44dc-9cfa-bcdbe67c1330 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:08.003113 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6e28e51f-c0f5-44dc-9cfa-bcdbe67c1330 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:08.009683 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e28e51f-c0f5-44dc-9cfa-bcdbe67c1330 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:08.010156 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e28e51f-c0f5-44dc-9cfa-bcdbe67c1330 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:08.010614 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e28e51f-c0f5-44dc-9cfa-bcdbe67c1330 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:08.011301 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e28e51f-c0f5-44dc-9cfa-bcdbe67c1330 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:08.011745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e28e51f-c0f5-44dc-9cfa-bcdbe67c1330 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:08.012159 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6e28e51f-c0f5-44dc-9cfa-bcdbe67c1330 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:08.077665 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6e28e51f-c0f5-44dc-9cfa-bcdbe67c1330 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:08.086450 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6e28e51f-c0f5-44dc-9cfa-bcdbe67c1330 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.088563 Aug 04 23:40:08.087013 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 988/1947] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:07 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:09.106863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6bf767f7-663a-4915-abad-46bb0a9fb06f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:09.107448 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6bf767f7-663a-4915-abad-46bb0a9fb06f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:09.114431 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6bf767f7-663a-4915-abad-46bb0a9fb06f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:09.114908 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6bf767f7-663a-4915-abad-46bb0a9fb06f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:09.115331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6bf767f7-663a-4915-abad-46bb0a9fb06f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:09.116010 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6bf767f7-663a-4915-abad-46bb0a9fb06f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:09.116455 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6bf767f7-663a-4915-abad-46bb0a9fb06f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:09.116870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6bf767f7-663a-4915-abad-46bb0a9fb06f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:09.179729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6bf767f7-663a-4915-abad-46bb0a9fb06f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:09.187281 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6bf767f7-663a-4915-abad-46bb0a9fb06f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084250 Aug 04 23:40:09.188411 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 960/1948] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:09 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:10.208926 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f2dc81f3-a810-4592-b2be-8d29b68e2d93 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:10.209545 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f2dc81f3-a810-4592-b2be-8d29b68e2d93 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:10.216063 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f2dc81f3-a810-4592-b2be-8d29b68e2d93 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:10.216548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f2dc81f3-a810-4592-b2be-8d29b68e2d93 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:10.216984 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f2dc81f3-a810-4592-b2be-8d29b68e2d93 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:10.217683 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f2dc81f3-a810-4592-b2be-8d29b68e2d93 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:10.218121 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f2dc81f3-a810-4592-b2be-8d29b68e2d93 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:10.218599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f2dc81f3-a810-4592-b2be-8d29b68e2d93 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:10.282068 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f2dc81f3-a810-4592-b2be-8d29b68e2d93 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:10.290400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f2dc81f3-a810-4592-b2be-8d29b68e2d93 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.085321 Aug 04 23:40:10.290977 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 989/1949] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:10 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:11.312134 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6cb6ab6f-722a-4aae-9cd5-d285445cd266 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:11.312758 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6cb6ab6f-722a-4aae-9cd5-d285445cd266 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:11.320000 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6cb6ab6f-722a-4aae-9cd5-d285445cd266 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:11.320482 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6cb6ab6f-722a-4aae-9cd5-d285445cd266 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:11.320919 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6cb6ab6f-722a-4aae-9cd5-d285445cd266 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:11.321616 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6cb6ab6f-722a-4aae-9cd5-d285445cd266 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:11.322068 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6cb6ab6f-722a-4aae-9cd5-d285445cd266 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:11.322533 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6cb6ab6f-722a-4aae-9cd5-d285445cd266 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:11.384798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6cb6ab6f-722a-4aae-9cd5-d285445cd266 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:11.398713 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6cb6ab6f-722a-4aae-9cd5-d285445cd266 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.090098 Aug 04 23:40:11.399725 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 961/1950] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:11 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:12.419231 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-24172976-a1e1-45f1-9fdb-fdae729765f5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:12.419841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-24172976-a1e1-45f1-9fdb-fdae729765f5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:12.426582 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24172976-a1e1-45f1-9fdb-fdae729765f5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:12.427055 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24172976-a1e1-45f1-9fdb-fdae729765f5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:12.427483 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24172976-a1e1-45f1-9fdb-fdae729765f5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:12.428167 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24172976-a1e1-45f1-9fdb-fdae729765f5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:12.428610 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24172976-a1e1-45f1-9fdb-fdae729765f5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:12.429025 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24172976-a1e1-45f1-9fdb-fdae729765f5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:12.494446 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-24172976-a1e1-45f1-9fdb-fdae729765f5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:12.503017 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-24172976-a1e1-45f1-9fdb-fdae729765f5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.087561 Aug 04 23:40:12.503704 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 990/1951] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:12 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:13.523942 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4cbe068b-4b1e-4798-83d8-f1a8b9cb4ecd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:13.524541 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4cbe068b-4b1e-4798-83d8-f1a8b9cb4ecd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:13.531144 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4cbe068b-4b1e-4798-83d8-f1a8b9cb4ecd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:13.531626 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4cbe068b-4b1e-4798-83d8-f1a8b9cb4ecd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:13.532062 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4cbe068b-4b1e-4798-83d8-f1a8b9cb4ecd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:13.533334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4cbe068b-4b1e-4798-83d8-f1a8b9cb4ecd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:13.533785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4cbe068b-4b1e-4798-83d8-f1a8b9cb4ecd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:13.534212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4cbe068b-4b1e-4798-83d8-f1a8b9cb4ecd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:13.597953 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4cbe068b-4b1e-4798-83d8-f1a8b9cb4ecd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:13.605568 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4cbe068b-4b1e-4798-83d8-f1a8b9cb4ecd tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.085523 Aug 04 23:40:13.606120 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 962/1952] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:13 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:14.626245 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e720e739-f98c-44a2-b509-a800c5ed9bae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:14.627075 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e720e739-f98c-44a2-b509-a800c5ed9bae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:14.634028 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e720e739-f98c-44a2-b509-a800c5ed9bae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:14.634553 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e720e739-f98c-44a2-b509-a800c5ed9bae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:14.634996 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e720e739-f98c-44a2-b509-a800c5ed9bae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:14.635696 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e720e739-f98c-44a2-b509-a800c5ed9bae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:14.636148 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e720e739-f98c-44a2-b509-a800c5ed9bae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:14.636575 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e720e739-f98c-44a2-b509-a800c5ed9bae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:14.698328 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e720e739-f98c-44a2-b509-a800c5ed9bae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:14.706546 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e720e739-f98c-44a2-b509-a800c5ed9bae tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084271 Aug 04 23:40:14.707108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 991/1953] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:14 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:15.726906 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4dddfdc4-84f2-4ad3-b582-9b25ec9f776c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:15.727578 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4dddfdc4-84f2-4ad3-b582-9b25ec9f776c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:15.734091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dddfdc4-84f2-4ad3-b582-9b25ec9f776c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:15.734615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dddfdc4-84f2-4ad3-b582-9b25ec9f776c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:15.735057 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dddfdc4-84f2-4ad3-b582-9b25ec9f776c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:15.736654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dddfdc4-84f2-4ad3-b582-9b25ec9f776c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:15.736881 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dddfdc4-84f2-4ad3-b582-9b25ec9f776c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:15.737295 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4dddfdc4-84f2-4ad3-b582-9b25ec9f776c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:15.799068 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4dddfdc4-84f2-4ad3-b582-9b25ec9f776c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:15.806938 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4dddfdc4-84f2-4ad3-b582-9b25ec9f776c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.083899 Aug 04 23:40:15.807515 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 963/1954] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:15 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:16.828038 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-280f5353-ca93-46db-99b7-dd1957d9ca48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:16.828658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-280f5353-ca93-46db-99b7-dd1957d9ca48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:16.836626 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-280f5353-ca93-46db-99b7-dd1957d9ca48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:16.836626 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-280f5353-ca93-46db-99b7-dd1957d9ca48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:16.837062 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-280f5353-ca93-46db-99b7-dd1957d9ca48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:16.837764 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-280f5353-ca93-46db-99b7-dd1957d9ca48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:16.838217 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-280f5353-ca93-46db-99b7-dd1957d9ca48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:16.838676 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-280f5353-ca93-46db-99b7-dd1957d9ca48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:16.904794 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-280f5353-ca93-46db-99b7-dd1957d9ca48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:16.912731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-280f5353-ca93-46db-99b7-dd1957d9ca48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.088533 Aug 04 23:40:16.913301 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 992/1955] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:16 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:17.934089 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e4bd2d8a-e91b-4aa0-b7d2-1c61c56a227e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:17.934761 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e4bd2d8a-e91b-4aa0-b7d2-1c61c56a227e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:17.941566 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4bd2d8a-e91b-4aa0-b7d2-1c61c56a227e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:17.942045 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4bd2d8a-e91b-4aa0-b7d2-1c61c56a227e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:17.942529 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4bd2d8a-e91b-4aa0-b7d2-1c61c56a227e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:17.943213 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4bd2d8a-e91b-4aa0-b7d2-1c61c56a227e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:17.943667 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4bd2d8a-e91b-4aa0-b7d2-1c61c56a227e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:17.944090 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4bd2d8a-e91b-4aa0-b7d2-1c61c56a227e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:17.946779 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=86 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:40:18.007606 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e4bd2d8a-e91b-4aa0-b7d2-1c61c56a227e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:18.015194 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e4bd2d8a-e91b-4aa0-b7d2-1c61c56a227e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.085038 Aug 04 23:40:18.015753 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 964/1956] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:17 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:19.036986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c670e956-8a80-4eb5-8d55-9b8c048481e2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:19.037632 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c670e956-8a80-4eb5-8d55-9b8c048481e2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:19.044502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c670e956-8a80-4eb5-8d55-9b8c048481e2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:19.044985 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c670e956-8a80-4eb5-8d55-9b8c048481e2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:19.045425 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c670e956-8a80-4eb5-8d55-9b8c048481e2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:19.046116 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c670e956-8a80-4eb5-8d55-9b8c048481e2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:19.046613 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c670e956-8a80-4eb5-8d55-9b8c048481e2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:19.047040 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c670e956-8a80-4eb5-8d55-9b8c048481e2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:19.111764 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c670e956-8a80-4eb5-8d55-9b8c048481e2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:19.119294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c670e956-8a80-4eb5-8d55-9b8c048481e2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.086230 Aug 04 23:40:19.119874 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 993/1957] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:19 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:20.140833 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-210a3a57-0c21-4660-a036-9124161c4553 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:20.141395 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-210a3a57-0c21-4660-a036-9124161c4553 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:20.148566 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-210a3a57-0c21-4660-a036-9124161c4553 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:20.149045 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-210a3a57-0c21-4660-a036-9124161c4553 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:20.149474 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-210a3a57-0c21-4660-a036-9124161c4553 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:20.150161 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-210a3a57-0c21-4660-a036-9124161c4553 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:20.150635 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-210a3a57-0c21-4660-a036-9124161c4553 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:20.151055 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-210a3a57-0c21-4660-a036-9124161c4553 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:20.212987 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-210a3a57-0c21-4660-a036-9124161c4553 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:20.221164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-210a3a57-0c21-4660-a036-9124161c4553 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084315 Aug 04 23:40:20.221723 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 965/1958] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:20 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:21.241618 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-08436405-3130-4b4f-be6a-fdfd2a42607b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:21.242258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-08436405-3130-4b4f-be6a-fdfd2a42607b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:21.248670 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-08436405-3130-4b4f-be6a-fdfd2a42607b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:21.249152 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-08436405-3130-4b4f-be6a-fdfd2a42607b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:21.249587 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-08436405-3130-4b4f-be6a-fdfd2a42607b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:21.250284 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-08436405-3130-4b4f-be6a-fdfd2a42607b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:21.250764 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-08436405-3130-4b4f-be6a-fdfd2a42607b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:21.252013 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-08436405-3130-4b4f-be6a-fdfd2a42607b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:21.320600 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-08436405-3130-4b4f-be6a-fdfd2a42607b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:21.328463 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-08436405-3130-4b4f-be6a-fdfd2a42607b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.090769 Aug 04 23:40:21.329021 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 994/1959] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:21 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:22.349652 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-20886bf4-1157-4a33-9ba3-3eb7e88f9321 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:22.350252 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-20886bf4-1157-4a33-9ba3-3eb7e88f9321 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:22.352274 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=30 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:40:22.357560 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20886bf4-1157-4a33-9ba3-3eb7e88f9321 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:22.358034 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20886bf4-1157-4a33-9ba3-3eb7e88f9321 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:22.358486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20886bf4-1157-4a33-9ba3-3eb7e88f9321 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:22.359171 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20886bf4-1157-4a33-9ba3-3eb7e88f9321 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:22.359613 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20886bf4-1157-4a33-9ba3-3eb7e88f9321 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:22.360028 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20886bf4-1157-4a33-9ba3-3eb7e88f9321 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:22.425716 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-20886bf4-1157-4a33-9ba3-3eb7e88f9321 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:22.433312 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-20886bf4-1157-4a33-9ba3-3eb7e88f9321 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.087574 Aug 04 23:40:22.433882 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 966/1960] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:22 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:23.453433 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1478f0ea-0139-440c-ba51-cc7d36fab4a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:23.454073 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1478f0ea-0139-440c-ba51-cc7d36fab4a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:23.456541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=28 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:40:23.462019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1478f0ea-0139-440c-ba51-cc7d36fab4a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:23.462554 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1478f0ea-0139-440c-ba51-cc7d36fab4a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:23.462975 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1478f0ea-0139-440c-ba51-cc7d36fab4a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:23.463660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1478f0ea-0139-440c-ba51-cc7d36fab4a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:23.464105 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1478f0ea-0139-440c-ba51-cc7d36fab4a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:23.464518 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1478f0ea-0139-440c-ba51-cc7d36fab4a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:23.467148 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=84 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:40:23.525858 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1478f0ea-0139-440c-ba51-cc7d36fab4a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:23.533712 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1478f0ea-0139-440c-ba51-cc7d36fab4a3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084059 Aug 04 23:40:23.534264 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 995/1961] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:23 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:24.554401 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-21113f05-0c6f-4ea3-88e2-2dd221d7ca7d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:24.555079 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-21113f05-0c6f-4ea3-88e2-2dd221d7ca7d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:24.561427 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21113f05-0c6f-4ea3-88e2-2dd221d7ca7d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:24.561895 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21113f05-0c6f-4ea3-88e2-2dd221d7ca7d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:24.562321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21113f05-0c6f-4ea3-88e2-2dd221d7ca7d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:24.563019 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21113f05-0c6f-4ea3-88e2-2dd221d7ca7d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:24.564336 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21113f05-0c6f-4ea3-88e2-2dd221d7ca7d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:24.564888 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21113f05-0c6f-4ea3-88e2-2dd221d7ca7d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:24.627163 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-21113f05-0c6f-4ea3-88e2-2dd221d7ca7d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:24.634785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-21113f05-0c6f-4ea3-88e2-2dd221d7ca7d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084196 Aug 04 23:40:24.635348 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 967/1962] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:24 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:40:25.655507 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-631d18c3-e3a3-4614-9a6a-fa53d59fd675 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:25.656119 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-631d18c3-e3a3-4614-9a6a-fa53d59fd675 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:25.663012 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-631d18c3-e3a3-4614-9a6a-fa53d59fd675 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:25.663502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-631d18c3-e3a3-4614-9a6a-fa53d59fd675 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:25.663944 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-631d18c3-e3a3-4614-9a6a-fa53d59fd675 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:25.664729 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-631d18c3-e3a3-4614-9a6a-fa53d59fd675 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:25.665121 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-631d18c3-e3a3-4614-9a6a-fa53d59fd675 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:25.665544 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-631d18c3-e3a3-4614-9a6a-fa53d59fd675 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:25.730094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-631d18c3-e3a3-4614-9a6a-fa53d59fd675 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:25.738596 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-631d18c3-e3a3-4614-9a6a-fa53d59fd675 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.086958 Aug 04 23:40:25.739101 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 996/1963] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:25 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:40:26.759138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7e786148-ae20-49bc-93e5-c91e239e0cd9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:26.759766 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7e786148-ae20-49bc-93e5-c91e239e0cd9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:26.766122 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e786148-ae20-49bc-93e5-c91e239e0cd9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:26.767549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e786148-ae20-49bc-93e5-c91e239e0cd9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:26.768275 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e786148-ae20-49bc-93e5-c91e239e0cd9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:26.768965 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e786148-ae20-49bc-93e5-c91e239e0cd9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:26.769414 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e786148-ae20-49bc-93e5-c91e239e0cd9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:26.769829 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7e786148-ae20-49bc-93e5-c91e239e0cd9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:26.832870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7e786148-ae20-49bc-93e5-c91e239e0cd9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:26.841504 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7e786148-ae20-49bc-93e5-c91e239e0cd9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.086111 Aug 04 23:40:26.842076 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 968/1964] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:26 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:27.862341 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-188e0b8f-5cb2-4ae2-974e-4fbf3a7db66f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:27.862992 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-188e0b8f-5cb2-4ae2-974e-4fbf3a7db66f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:27.869543 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-188e0b8f-5cb2-4ae2-974e-4fbf3a7db66f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:27.870027 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-188e0b8f-5cb2-4ae2-974e-4fbf3a7db66f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:27.870498 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-188e0b8f-5cb2-4ae2-974e-4fbf3a7db66f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:27.871192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-188e0b8f-5cb2-4ae2-974e-4fbf3a7db66f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:27.871653 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-188e0b8f-5cb2-4ae2-974e-4fbf3a7db66f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:27.872082 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-188e0b8f-5cb2-4ae2-974e-4fbf3a7db66f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:27.935035 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-188e0b8f-5cb2-4ae2-974e-4fbf3a7db66f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:27.942626 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-188e0b8f-5cb2-4ae2-974e-4fbf3a7db66f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084266 Aug 04 23:40:27.943191 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 997/1965] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:27 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:28.963900 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4e2ed8f4-3500-4c68-b7a2-8bbc1018f854 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:28.964498 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4e2ed8f4-3500-4c68-b7a2-8bbc1018f854 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:28.971361 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4e2ed8f4-3500-4c68-b7a2-8bbc1018f854 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:28.971832 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4e2ed8f4-3500-4c68-b7a2-8bbc1018f854 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:28.972669 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4e2ed8f4-3500-4c68-b7a2-8bbc1018f854 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:28.972946 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4e2ed8f4-3500-4c68-b7a2-8bbc1018f854 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:28.973388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4e2ed8f4-3500-4c68-b7a2-8bbc1018f854 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:28.973875 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4e2ed8f4-3500-4c68-b7a2-8bbc1018f854 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:29.036237 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4e2ed8f4-3500-4c68-b7a2-8bbc1018f854 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:29.043727 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4e2ed8f4-3500-4c68-b7a2-8bbc1018f854 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.083678 Aug 04 23:40:29.044276 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 969/1966] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:28 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:29.531469 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:40:29.531707 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:40:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:40:30.065900 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ed75a220-ab5a-4e04-82a0-84d4a541eba4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:30.066529 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ed75a220-ab5a-4e04-82a0-84d4a541eba4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:30.073428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed75a220-ab5a-4e04-82a0-84d4a541eba4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:30.073896 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed75a220-ab5a-4e04-82a0-84d4a541eba4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:30.074324 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed75a220-ab5a-4e04-82a0-84d4a541eba4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:30.075028 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed75a220-ab5a-4e04-82a0-84d4a541eba4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:30.075473 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed75a220-ab5a-4e04-82a0-84d4a541eba4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:30.075890 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed75a220-ab5a-4e04-82a0-84d4a541eba4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:30.143987 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ed75a220-ab5a-4e04-82a0-84d4a541eba4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:30.151698 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ed75a220-ab5a-4e04-82a0-84d4a541eba4 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.090414 Aug 04 23:40:30.152260 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 998/1967] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:30 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:31.172159 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-952a3c72-6a23-44c5-9e19-00c71247c544 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:31.172818 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-952a3c72-6a23-44c5-9e19-00c71247c544 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:31.179669 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-952a3c72-6a23-44c5-9e19-00c71247c544 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:31.180147 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-952a3c72-6a23-44c5-9e19-00c71247c544 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:31.180576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-952a3c72-6a23-44c5-9e19-00c71247c544 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:31.181264 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-952a3c72-6a23-44c5-9e19-00c71247c544 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:31.181712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-952a3c72-6a23-44c5-9e19-00c71247c544 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:31.182130 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-952a3c72-6a23-44c5-9e19-00c71247c544 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:31.244673 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-952a3c72-6a23-44c5-9e19-00c71247c544 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:31.253001 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-952a3c72-6a23-44c5-9e19-00c71247c544 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084687 Aug 04 23:40:31.253569 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 970/1968] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:31 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:32.273119 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1d68679d-affe-4ece-af6a-792a44e23c1d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:32.273733 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1d68679d-affe-4ece-af6a-792a44e23c1d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:32.280438 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1d68679d-affe-4ece-af6a-792a44e23c1d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:32.280927 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1d68679d-affe-4ece-af6a-792a44e23c1d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:32.281363 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1d68679d-affe-4ece-af6a-792a44e23c1d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:32.282089 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1d68679d-affe-4ece-af6a-792a44e23c1d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:32.282649 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1d68679d-affe-4ece-af6a-792a44e23c1d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:32.283122 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1d68679d-affe-4ece-af6a-792a44e23c1d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:32.346166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1d68679d-affe-4ece-af6a-792a44e23c1d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:32.353783 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1d68679d-affe-4ece-af6a-792a44e23c1d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084553 Aug 04 23:40:32.354345 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 999/1969] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:32 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:33.375062 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5f341e12-38ef-4ecc-b38f-126c1fa843d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:33.375660 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5f341e12-38ef-4ecc-b38f-126c1fa843d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:33.382531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5f341e12-38ef-4ecc-b38f-126c1fa843d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:33.383007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5f341e12-38ef-4ecc-b38f-126c1fa843d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:33.383438 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5f341e12-38ef-4ecc-b38f-126c1fa843d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:33.384126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5f341e12-38ef-4ecc-b38f-126c1fa843d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:33.384573 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5f341e12-38ef-4ecc-b38f-126c1fa843d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:33.384996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5f341e12-38ef-4ecc-b38f-126c1fa843d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:33.448175 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5f341e12-38ef-4ecc-b38f-126c1fa843d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:33.455629 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5f341e12-38ef-4ecc-b38f-126c1fa843d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084418 Aug 04 23:40:33.456185 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 971/1970] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:33 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:34.476920 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0e5fdedd-72bb-44e3-a41d-f3ced6d43837 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:34.477534 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0e5fdedd-72bb-44e3-a41d-f3ced6d43837 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:34.483892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0e5fdedd-72bb-44e3-a41d-f3ced6d43837 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:34.484362 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0e5fdedd-72bb-44e3-a41d-f3ced6d43837 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:34.484789 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0e5fdedd-72bb-44e3-a41d-f3ced6d43837 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:34.485724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0e5fdedd-72bb-44e3-a41d-f3ced6d43837 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:34.486519 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0e5fdedd-72bb-44e3-a41d-f3ced6d43837 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:34.487160 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0e5fdedd-72bb-44e3-a41d-f3ced6d43837 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:34.552659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0e5fdedd-72bb-44e3-a41d-f3ced6d43837 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:34.560217 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0e5fdedd-72bb-44e3-a41d-f3ced6d43837 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.087169 Aug 04 23:40:34.560776 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1000/1971] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:34 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:35.580971 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-eafc8eea-ae60-4f62-836e-3b76b6dc276d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:35.581571 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-eafc8eea-ae60-4f62-836e-3b76b6dc276d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:35.588777 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eafc8eea-ae60-4f62-836e-3b76b6dc276d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:35.589256 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eafc8eea-ae60-4f62-836e-3b76b6dc276d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:35.589686 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eafc8eea-ae60-4f62-836e-3b76b6dc276d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:35.590397 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eafc8eea-ae60-4f62-836e-3b76b6dc276d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:35.590850 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eafc8eea-ae60-4f62-836e-3b76b6dc276d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:35.591269 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eafc8eea-ae60-4f62-836e-3b76b6dc276d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:35.655503 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-eafc8eea-ae60-4f62-836e-3b76b6dc276d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:35.663607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-eafc8eea-ae60-4f62-836e-3b76b6dc276d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.086760 Aug 04 23:40:35.664163 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 972/1972] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:35 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:36.685385 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a92166b0-3873-457f-b651-0346ffc00441 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:36.686010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a92166b0-3873-457f-b651-0346ffc00441 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:36.693289 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a92166b0-3873-457f-b651-0346ffc00441 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:36.693774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a92166b0-3873-457f-b651-0346ffc00441 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:36.694214 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a92166b0-3873-457f-b651-0346ffc00441 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:36.694953 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a92166b0-3873-457f-b651-0346ffc00441 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:36.695410 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a92166b0-3873-457f-b651-0346ffc00441 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:36.695834 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a92166b0-3873-457f-b651-0346ffc00441 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:36.766731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a92166b0-3873-457f-b651-0346ffc00441 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:36.774477 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a92166b0-3873-457f-b651-0346ffc00441 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.093030 Aug 04 23:40:36.775044 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1001/1973] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:36 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:37.794029 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-21f59029-f2cb-428d-87e3-59150c9343e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:37.794657 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-21f59029-f2cb-428d-87e3-59150c9343e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:37.801716 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21f59029-f2cb-428d-87e3-59150c9343e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:37.802192 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21f59029-f2cb-428d-87e3-59150c9343e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:37.802649 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21f59029-f2cb-428d-87e3-59150c9343e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:37.803337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21f59029-f2cb-428d-87e3-59150c9343e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:37.803786 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21f59029-f2cb-428d-87e3-59150c9343e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:37.804203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-21f59029-f2cb-428d-87e3-59150c9343e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:37.866482 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-21f59029-f2cb-428d-87e3-59150c9343e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:37.874212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-21f59029-f2cb-428d-87e3-59150c9343e7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084029 Aug 04 23:40:37.874806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 973/1974] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:37 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:38.895358 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2c98d1ac-75ac-46a3-8ead-991a2937ad54 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:38.895943 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2c98d1ac-75ac-46a3-8ead-991a2937ad54 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:38.902531 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c98d1ac-75ac-46a3-8ead-991a2937ad54 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:38.903010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c98d1ac-75ac-46a3-8ead-991a2937ad54 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:38.903442 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c98d1ac-75ac-46a3-8ead-991a2937ad54 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:38.904129 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c98d1ac-75ac-46a3-8ead-991a2937ad54 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:38.904577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c98d1ac-75ac-46a3-8ead-991a2937ad54 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:38.904996 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c98d1ac-75ac-46a3-8ead-991a2937ad54 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:38.969255 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2c98d1ac-75ac-46a3-8ead-991a2937ad54 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:38.977561 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2c98d1ac-75ac-46a3-8ead-991a2937ad54 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.086142 Aug 04 23:40:38.978127 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1002/1975] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:38 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:39.998755 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f5b50042-0c6e-40b3-99b7-e6797253c8fc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:39.999347 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f5b50042-0c6e-40b3-99b7-e6797253c8fc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:40.006306 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f5b50042-0c6e-40b3-99b7-e6797253c8fc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:40.006820 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f5b50042-0c6e-40b3-99b7-e6797253c8fc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:40.007280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f5b50042-0c6e-40b3-99b7-e6797253c8fc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:40.007984 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f5b50042-0c6e-40b3-99b7-e6797253c8fc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:40.008429 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f5b50042-0c6e-40b3-99b7-e6797253c8fc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:40.008848 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f5b50042-0c6e-40b3-99b7-e6797253c8fc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:40.081028 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f5b50042-0c6e-40b3-99b7-e6797253c8fc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:40.095163 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f5b50042-0c6e-40b3-99b7-e6797253c8fc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.100403 Aug 04 23:40:40.095731 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 974/1976] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:39 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:41.117199 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-81d05a67-44bc-4070-869d-a731fcf8c7db tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:41.117799 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-81d05a67-44bc-4070-869d-a731fcf8c7db tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:41.124379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81d05a67-44bc-4070-869d-a731fcf8c7db tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:41.124862 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81d05a67-44bc-4070-869d-a731fcf8c7db tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:41.125294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81d05a67-44bc-4070-869d-a731fcf8c7db tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:41.126031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81d05a67-44bc-4070-869d-a731fcf8c7db tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:41.126601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81d05a67-44bc-4070-869d-a731fcf8c7db tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:41.127031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-81d05a67-44bc-4070-869d-a731fcf8c7db tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:41.191350 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-81d05a67-44bc-4070-869d-a731fcf8c7db tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:41.198939 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-81d05a67-44bc-4070-869d-a731fcf8c7db tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.085764 Aug 04 23:40:41.199511 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1003/1977] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:41 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:42.220623 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b74bb1c2-fdc9-4d03-b19c-248cc1fb6916 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:42.221223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b74bb1c2-fdc9-4d03-b19c-248cc1fb6916 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:42.227723 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b74bb1c2-fdc9-4d03-b19c-248cc1fb6916 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:42.228204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b74bb1c2-fdc9-4d03-b19c-248cc1fb6916 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:42.228639 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b74bb1c2-fdc9-4d03-b19c-248cc1fb6916 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:42.229335 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b74bb1c2-fdc9-4d03-b19c-248cc1fb6916 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:42.229790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b74bb1c2-fdc9-4d03-b19c-248cc1fb6916 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:42.230217 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b74bb1c2-fdc9-4d03-b19c-248cc1fb6916 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:42.296967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b74bb1c2-fdc9-4d03-b19c-248cc1fb6916 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:42.306272 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b74bb1c2-fdc9-4d03-b19c-248cc1fb6916 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.089657 Aug 04 23:40:42.306876 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 975/1978] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:42 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:43.326994 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-462ca0b6-c9fb-4c5d-9052-042d4d914a09 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:43.327660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-462ca0b6-c9fb-4c5d-9052-042d4d914a09 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:43.334245 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-462ca0b6-c9fb-4c5d-9052-042d4d914a09 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:43.334764 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-462ca0b6-c9fb-4c5d-9052-042d4d914a09 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:43.335195 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-462ca0b6-c9fb-4c5d-9052-042d4d914a09 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:43.335894 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-462ca0b6-c9fb-4c5d-9052-042d4d914a09 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:43.336344 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-462ca0b6-c9fb-4c5d-9052-042d4d914a09 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:43.336767 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-462ca0b6-c9fb-4c5d-9052-042d4d914a09 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:43.402013 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-462ca0b6-c9fb-4c5d-9052-042d4d914a09 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:43.409650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-462ca0b6-c9fb-4c5d-9052-042d4d914a09 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.086856 Aug 04 23:40:43.410219 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1004/1979] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:43 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:44.431007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-be7a9a9b-4180-4166-a050-847fbc06b2ba tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:44.431608 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-be7a9a9b-4180-4166-a050-847fbc06b2ba tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:44.438818 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be7a9a9b-4180-4166-a050-847fbc06b2ba tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:44.439403 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be7a9a9b-4180-4166-a050-847fbc06b2ba tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:44.440697 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be7a9a9b-4180-4166-a050-847fbc06b2ba tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:44.450353 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be7a9a9b-4180-4166-a050-847fbc06b2ba tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:44.450353 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be7a9a9b-4180-4166-a050-847fbc06b2ba tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:44.450353 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be7a9a9b-4180-4166-a050-847fbc06b2ba tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:44.505948 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-be7a9a9b-4180-4166-a050-847fbc06b2ba tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:44.513431 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-be7a9a9b-4180-4166-a050-847fbc06b2ba tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.086440 Aug 04 23:40:44.513990 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 976/1980] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:44 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:45.535512 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ef313290-e666-4e38-8f25-9994e4337d1e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:45.536049 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ef313290-e666-4e38-8f25-9994e4337d1e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:45.542521 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef313290-e666-4e38-8f25-9994e4337d1e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:45.542997 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef313290-e666-4e38-8f25-9994e4337d1e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:45.543430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef313290-e666-4e38-8f25-9994e4337d1e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:45.544116 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef313290-e666-4e38-8f25-9994e4337d1e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:45.544563 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef313290-e666-4e38-8f25-9994e4337d1e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:45.544980 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ef313290-e666-4e38-8f25-9994e4337d1e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:45.607235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ef313290-e666-4e38-8f25-9994e4337d1e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:45.615683 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ef313290-e666-4e38-8f25-9994e4337d1e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.085056 Aug 04 23:40:45.616246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1005/1981] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:45 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:46.640766 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3a827b8b-f3a1-4a0c-ad41-9fbb5aa87441 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:46.642406 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3a827b8b-f3a1-4a0c-ad41-9fbb5aa87441 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:46.650440 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3a827b8b-f3a1-4a0c-ad41-9fbb5aa87441 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:46.650930 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3a827b8b-f3a1-4a0c-ad41-9fbb5aa87441 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:46.651369 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3a827b8b-f3a1-4a0c-ad41-9fbb5aa87441 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:46.652076 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3a827b8b-f3a1-4a0c-ad41-9fbb5aa87441 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:46.652526 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3a827b8b-f3a1-4a0c-ad41-9fbb5aa87441 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:46.652957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3a827b8b-f3a1-4a0c-ad41-9fbb5aa87441 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:46.723097 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3a827b8b-f3a1-4a0c-ad41-9fbb5aa87441 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:46.730807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3a827b8b-f3a1-4a0c-ad41-9fbb5aa87441 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.097477 Aug 04 23:40:46.731374 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 977/1982] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:46 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:47.751860 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2bb0a519-e602-4845-aa16-215e9c15564b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:47.752475 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2bb0a519-e602-4845-aa16-215e9c15564b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:47.759015 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2bb0a519-e602-4845-aa16-215e9c15564b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:47.759498 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2bb0a519-e602-4845-aa16-215e9c15564b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:47.759956 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2bb0a519-e602-4845-aa16-215e9c15564b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:47.760647 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2bb0a519-e602-4845-aa16-215e9c15564b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:47.761129 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2bb0a519-e602-4845-aa16-215e9c15564b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:47.761554 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2bb0a519-e602-4845-aa16-215e9c15564b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:47.838436 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2bb0a519-e602-4845-aa16-215e9c15564b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:47.846888 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2bb0a519-e602-4845-aa16-215e9c15564b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.098979 Aug 04 23:40:47.847443 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1006/1983] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:47 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:48.867288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1d95f455-f20a-4f2d-bf03-54cdf6b1f7eb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:48.867964 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1d95f455-f20a-4f2d-bf03-54cdf6b1f7eb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:48.875476 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1d95f455-f20a-4f2d-bf03-54cdf6b1f7eb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:48.875899 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1d95f455-f20a-4f2d-bf03-54cdf6b1f7eb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:48.876574 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1d95f455-f20a-4f2d-bf03-54cdf6b1f7eb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:48.877465 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1d95f455-f20a-4f2d-bf03-54cdf6b1f7eb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:48.877917 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1d95f455-f20a-4f2d-bf03-54cdf6b1f7eb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:48.878341 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1d95f455-f20a-4f2d-bf03-54cdf6b1f7eb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:48.881246 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=84 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:40:48.947928 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1d95f455-f20a-4f2d-bf03-54cdf6b1f7eb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:48.957369 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1d95f455-f20a-4f2d-bf03-54cdf6b1f7eb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.093868 Aug 04 23:40:48.957941 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 978/1984] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:48 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:49.979726 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-37888eb1-e02a-4219-84de-307aeb6f6aeb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:49.980362 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-37888eb1-e02a-4219-84de-307aeb6f6aeb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:49.987686 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-37888eb1-e02a-4219-84de-307aeb6f6aeb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:49.988169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-37888eb1-e02a-4219-84de-307aeb6f6aeb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:49.988602 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-37888eb1-e02a-4219-84de-307aeb6f6aeb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:49.989304 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-37888eb1-e02a-4219-84de-307aeb6f6aeb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:49.989757 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-37888eb1-e02a-4219-84de-307aeb6f6aeb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:49.990183 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-37888eb1-e02a-4219-84de-307aeb6f6aeb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:50.061564 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-37888eb1-e02a-4219-84de-307aeb6f6aeb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:50.069760 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-37888eb1-e02a-4219-84de-307aeb6f6aeb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.093877 Aug 04 23:40:50.070327 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1007/1985] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:49 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:51.092579 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fd6cbee8-8e5b-410d-a298-f913d633137c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:51.093184 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-fd6cbee8-8e5b-410d-a298-f913d633137c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:51.100582 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fd6cbee8-8e5b-410d-a298-f913d633137c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:51.101067 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fd6cbee8-8e5b-410d-a298-f913d633137c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:51.101508 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fd6cbee8-8e5b-410d-a298-f913d633137c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:51.102210 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fd6cbee8-8e5b-410d-a298-f913d633137c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:51.102696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fd6cbee8-8e5b-410d-a298-f913d633137c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:51.103123 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fd6cbee8-8e5b-410d-a298-f913d633137c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:51.179069 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fd6cbee8-8e5b-410d-a298-f913d633137c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:51.187521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-fd6cbee8-8e5b-410d-a298-f913d633137c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.099000 Aug 04 23:40:51.188095 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 979/1986] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:51 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:52.211394 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c0d5c113-6f67-45d7-b0fe-444ed0a447d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:52.212233 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c0d5c113-6f67-45d7-b0fe-444ed0a447d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:52.219191 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0d5c113-6f67-45d7-b0fe-444ed0a447d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:52.220513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0d5c113-6f67-45d7-b0fe-444ed0a447d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:52.220723 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0d5c113-6f67-45d7-b0fe-444ed0a447d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:52.221402 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0d5c113-6f67-45d7-b0fe-444ed0a447d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:52.221861 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0d5c113-6f67-45d7-b0fe-444ed0a447d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:52.222285 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0d5c113-6f67-45d7-b0fe-444ed0a447d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:52.290652 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c0d5c113-6f67-45d7-b0fe-444ed0a447d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:52.299652 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c0d5c113-6f67-45d7-b0fe-444ed0a447d9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.092076 Aug 04 23:40:52.300249 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1008/1987] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:52 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:40:53.321413 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ed5d4c73-0e03-45a8-b4ea-b18b1d0607f1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:53.324247 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ed5d4c73-0e03-45a8-b4ea-b18b1d0607f1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:53.326686 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=28 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:40:53.332250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ed5d4c73-0e03-45a8-b4ea-b18b1d0607f1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:53.332725 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ed5d4c73-0e03-45a8-b4ea-b18b1d0607f1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:53.333154 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ed5d4c73-0e03-45a8-b4ea-b18b1d0607f1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:53.333857 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ed5d4c73-0e03-45a8-b4ea-b18b1d0607f1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:53.334294 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ed5d4c73-0e03-45a8-b4ea-b18b1d0607f1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:53.335044 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ed5d4c73-0e03-45a8-b4ea-b18b1d0607f1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:53.410523 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ed5d4c73-0e03-45a8-b4ea-b18b1d0607f1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:53.425033 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ed5d4c73-0e03-45a8-b4ea-b18b1d0607f1 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.107950 Aug 04 23:40:53.425706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 980/1988] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:53 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:54.445528 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-50dbaff5-dfb2-4c50-87fc-bcbc59de96a9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:54.446204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-50dbaff5-dfb2-4c50-87fc-bcbc59de96a9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:54.448199 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=28 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:40:54.453676 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-50dbaff5-dfb2-4c50-87fc-bcbc59de96a9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:54.454199 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-50dbaff5-dfb2-4c50-87fc-bcbc59de96a9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:54.454676 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-50dbaff5-dfb2-4c50-87fc-bcbc59de96a9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:54.455381 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-50dbaff5-dfb2-4c50-87fc-bcbc59de96a9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:54.455826 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-50dbaff5-dfb2-4c50-87fc-bcbc59de96a9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:54.456243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-50dbaff5-dfb2-4c50-87fc-bcbc59de96a9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:54.459518 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=84 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:40:54.523523 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-50dbaff5-dfb2-4c50-87fc-bcbc59de96a9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:54.531436 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-50dbaff5-dfb2-4c50-87fc-bcbc59de96a9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.089675 Aug 04 23:40:54.532139 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1009/1989] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:54 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:55.553755 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-522274bd-bfa7-4eca-860b-db37fdbe2233 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:55.554379 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-522274bd-bfa7-4eca-860b-db37fdbe2233 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:55.562144 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-522274bd-bfa7-4eca-860b-db37fdbe2233 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:55.562665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-522274bd-bfa7-4eca-860b-db37fdbe2233 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:55.563094 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-522274bd-bfa7-4eca-860b-db37fdbe2233 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:55.564721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-522274bd-bfa7-4eca-860b-db37fdbe2233 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:55.565204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-522274bd-bfa7-4eca-860b-db37fdbe2233 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:55.565626 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-522274bd-bfa7-4eca-860b-db37fdbe2233 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:55.632569 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-522274bd-bfa7-4eca-860b-db37fdbe2233 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:55.640463 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-522274bd-bfa7-4eca-860b-db37fdbe2233 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.090528 Aug 04 23:40:55.641049 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 981/1990] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:55 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:56.662035 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0a344a46-1ef1-423a-8016-3816625663cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:56.662690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0a344a46-1ef1-423a-8016-3816625663cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:56.669920 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0a344a46-1ef1-423a-8016-3816625663cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:56.670455 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0a344a46-1ef1-423a-8016-3816625663cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:56.670892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0a344a46-1ef1-423a-8016-3816625663cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:56.671598 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0a344a46-1ef1-423a-8016-3816625663cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:56.672047 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0a344a46-1ef1-423a-8016-3816625663cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:56.672473 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0a344a46-1ef1-423a-8016-3816625663cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:56.741103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0a344a46-1ef1-423a-8016-3816625663cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:56.749189 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0a344a46-1ef1-423a-8016-3816625663cc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.091095 Aug 04 23:40:56.749766 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1010/1991] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:56 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:57.771220 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-dc0a4c8f-3e0e-4fa8-a5e2-9034803b672d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:57.771892 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-dc0a4c8f-3e0e-4fa8-a5e2-9034803b672d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:57.778689 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dc0a4c8f-3e0e-4fa8-a5e2-9034803b672d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:57.779187 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dc0a4c8f-3e0e-4fa8-a5e2-9034803b672d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:57.779687 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dc0a4c8f-3e0e-4fa8-a5e2-9034803b672d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:57.780397 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dc0a4c8f-3e0e-4fa8-a5e2-9034803b672d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:57.780845 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dc0a4c8f-3e0e-4fa8-a5e2-9034803b672d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:57.781255 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dc0a4c8f-3e0e-4fa8-a5e2-9034803b672d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:57.848616 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-dc0a4c8f-3e0e-4fa8-a5e2-9034803b672d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:57.856979 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-dc0a4c8f-3e0e-4fa8-a5e2-9034803b672d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.089443 Aug 04 23:40:57.857298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 982/1992] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:57 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:40:58.881628 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c850e302-d4fd-43ee-bc82-1c123d5c5c0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:58.882282 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c850e302-d4fd-43ee-bc82-1c123d5c5c0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:58.888809 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c850e302-d4fd-43ee-bc82-1c123d5c5c0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:58.889297 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c850e302-d4fd-43ee-bc82-1c123d5c5c0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:58.889732 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c850e302-d4fd-43ee-bc82-1c123d5c5c0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:58.890464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c850e302-d4fd-43ee-bc82-1c123d5c5c0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:58.890920 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c850e302-d4fd-43ee-bc82-1c123d5c5c0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:58.892031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c850e302-d4fd-43ee-bc82-1c123d5c5c0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:58.954968 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c850e302-d4fd-43ee-bc82-1c123d5c5c0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:40:58.962503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c850e302-d4fd-43ee-bc82-1c123d5c5c0e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084739 Aug 04 23:40:58.963070 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1011/1993] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:58 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:40:59.982049 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f2953d50-6ba0-4282-8e39-bbc7e4ab57e9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:40:59.982721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f2953d50-6ba0-4282-8e39-bbc7e4ab57e9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:40:59.989992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f2953d50-6ba0-4282-8e39-bbc7e4ab57e9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:59.990523 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f2953d50-6ba0-4282-8e39-bbc7e4ab57e9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:59.990955 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f2953d50-6ba0-4282-8e39-bbc7e4ab57e9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:40:59.991648 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f2953d50-6ba0-4282-8e39-bbc7e4ab57e9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:40:59.992099 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f2953d50-6ba0-4282-8e39-bbc7e4ab57e9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:40:59.992522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f2953d50-6ba0-4282-8e39-bbc7e4ab57e9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:00.053841 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f2953d50-6ba0-4282-8e39-bbc7e4ab57e9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:00.062512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f2953d50-6ba0-4282-8e39-bbc7e4ab57e9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084081 Aug 04 23:41:00.063817 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 983/1994] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:40:59 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:01.084607 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-895bbea3-dcfe-4d73-8a56-1ed3f4b7c241 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:01.085163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-895bbea3-dcfe-4d73-8a56-1ed3f4b7c241 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:01.091592 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-895bbea3-dcfe-4d73-8a56-1ed3f4b7c241 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:01.092070 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-895bbea3-dcfe-4d73-8a56-1ed3f4b7c241 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:01.092500 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-895bbea3-dcfe-4d73-8a56-1ed3f4b7c241 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:01.093188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-895bbea3-dcfe-4d73-8a56-1ed3f4b7c241 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:01.093638 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-895bbea3-dcfe-4d73-8a56-1ed3f4b7c241 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:01.094085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-895bbea3-dcfe-4d73-8a56-1ed3f4b7c241 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:01.156903 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-895bbea3-dcfe-4d73-8a56-1ed3f4b7c241 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:01.164777 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-895bbea3-dcfe-4d73-8a56-1ed3f4b7c241 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084102 Aug 04 23:41:01.165336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1012/1995] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:01 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:02.239087 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-daae1ca4-ed4c-4c42-b832-23c3a9bc6046 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:02.239697 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-daae1ca4-ed4c-4c42-b832-23c3a9bc6046 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:02.245717 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-daae1ca4-ed4c-4c42-b832-23c3a9bc6046 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:02.246196 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-daae1ca4-ed4c-4c42-b832-23c3a9bc6046 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:02.246660 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-daae1ca4-ed4c-4c42-b832-23c3a9bc6046 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:02.247359 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-daae1ca4-ed4c-4c42-b832-23c3a9bc6046 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:02.247809 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-daae1ca4-ed4c-4c42-b832-23c3a9bc6046 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:02.248230 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-daae1ca4-ed4c-4c42-b832-23c3a9bc6046 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:02.312153 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-daae1ca4-ed4c-4c42-b832-23c3a9bc6046 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:02.322354 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-daae1ca4-ed4c-4c42-b832-23c3a9bc6046 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.140970 Aug 04 23:41:02.322957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 984/1996] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:02 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:03.342958 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8dbd9ac9-1741-4e76-9f0a-c1b32968d422 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:03.343599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8dbd9ac9-1741-4e76-9f0a-c1b32968d422 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:03.351327 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8dbd9ac9-1741-4e76-9f0a-c1b32968d422 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:03.351807 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8dbd9ac9-1741-4e76-9f0a-c1b32968d422 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:03.352249 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8dbd9ac9-1741-4e76-9f0a-c1b32968d422 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:03.352960 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8dbd9ac9-1741-4e76-9f0a-c1b32968d422 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:03.353406 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8dbd9ac9-1741-4e76-9f0a-c1b32968d422 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:03.353860 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8dbd9ac9-1741-4e76-9f0a-c1b32968d422 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:03.417254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8dbd9ac9-1741-4e76-9f0a-c1b32968d422 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:03.425896 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8dbd9ac9-1741-4e76-9f0a-c1b32968d422 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.086728 Aug 04 23:41:03.426568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1013/1997] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:03 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:04.446740 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3862c65a-d334-4b8c-97ff-95fab051640a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:04.447348 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3862c65a-d334-4b8c-97ff-95fab051640a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:04.454055 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3862c65a-d334-4b8c-97ff-95fab051640a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:04.454588 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3862c65a-d334-4b8c-97ff-95fab051640a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:04.455022 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3862c65a-d334-4b8c-97ff-95fab051640a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:04.455721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3862c65a-d334-4b8c-97ff-95fab051640a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:04.456168 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3862c65a-d334-4b8c-97ff-95fab051640a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:04.456590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3862c65a-d334-4b8c-97ff-95fab051640a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:04.520220 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3862c65a-d334-4b8c-97ff-95fab051640a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:04.528858 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3862c65a-d334-4b8c-97ff-95fab051640a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.085918 Aug 04 23:41:04.529433 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 985/1998] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:04 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:05.550255 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-34b8dcd9-cfa0-412f-9dfe-99d48d45db29 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:05.550962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-34b8dcd9-cfa0-412f-9dfe-99d48d45db29 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:05.557433 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34b8dcd9-cfa0-412f-9dfe-99d48d45db29 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:05.557936 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34b8dcd9-cfa0-412f-9dfe-99d48d45db29 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:05.558379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34b8dcd9-cfa0-412f-9dfe-99d48d45db29 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:05.559074 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34b8dcd9-cfa0-412f-9dfe-99d48d45db29 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:05.559563 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34b8dcd9-cfa0-412f-9dfe-99d48d45db29 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:05.559980 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-34b8dcd9-cfa0-412f-9dfe-99d48d45db29 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:05.627798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-34b8dcd9-cfa0-412f-9dfe-99d48d45db29 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:05.635762 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-34b8dcd9-cfa0-412f-9dfe-99d48d45db29 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.090141 Aug 04 23:41:05.636348 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1014/1999] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:05 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:06.658784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5e024e53-35be-4641-a2dc-aca3292d15b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:06.659693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5e024e53-35be-4641-a2dc-aca3292d15b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:06.666414 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5e024e53-35be-4641-a2dc-aca3292d15b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:06.666901 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5e024e53-35be-4641-a2dc-aca3292d15b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:06.667332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5e024e53-35be-4641-a2dc-aca3292d15b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:06.668037 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5e024e53-35be-4641-a2dc-aca3292d15b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:06.668617 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5e024e53-35be-4641-a2dc-aca3292d15b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:06.668905 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5e024e53-35be-4641-a2dc-aca3292d15b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:06.737643 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5e024e53-35be-4641-a2dc-aca3292d15b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:06.746131 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5e024e53-35be-4641-a2dc-aca3292d15b5 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.092786 Aug 04 23:41:06.746776 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 986/2000] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:06 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:07.768562 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-377dd5ac-d8eb-441d-a5e3-c3a3e55d01ac tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:07.769198 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-377dd5ac-d8eb-441d-a5e3-c3a3e55d01ac tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:07.775950 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-377dd5ac-d8eb-441d-a5e3-c3a3e55d01ac tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:07.776430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-377dd5ac-d8eb-441d-a5e3-c3a3e55d01ac tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:07.776857 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-377dd5ac-d8eb-441d-a5e3-c3a3e55d01ac tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:07.777563 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-377dd5ac-d8eb-441d-a5e3-c3a3e55d01ac tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:07.778006 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-377dd5ac-d8eb-441d-a5e3-c3a3e55d01ac tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:07.778525 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-377dd5ac-d8eb-441d-a5e3-c3a3e55d01ac tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:07.848526 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-377dd5ac-d8eb-441d-a5e3-c3a3e55d01ac tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:07.856670 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-377dd5ac-d8eb-441d-a5e3-c3a3e55d01ac tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.092751 Aug 04 23:41:07.857247 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1015/2001] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:07 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:08.878744 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a9ada843-9723-4109-a58c-744ebbc36d1f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:08.879345 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a9ada843-9723-4109-a58c-744ebbc36d1f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:08.886124 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a9ada843-9723-4109-a58c-744ebbc36d1f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:08.886632 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a9ada843-9723-4109-a58c-744ebbc36d1f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:08.887066 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a9ada843-9723-4109-a58c-744ebbc36d1f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:08.887759 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a9ada843-9723-4109-a58c-744ebbc36d1f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:08.888202 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a9ada843-9723-4109-a58c-744ebbc36d1f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:08.888616 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a9ada843-9723-4109-a58c-744ebbc36d1f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:08.953979 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a9ada843-9723-4109-a58c-744ebbc36d1f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:08.962794 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a9ada843-9723-4109-a58c-744ebbc36d1f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.087606 Aug 04 23:41:08.963451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 987/2002] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:08 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:09.988340 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9a4363e1-b9a6-404e-9fce-29f175a032ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:09.989482 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9a4363e1-b9a6-404e-9fce-29f175a032ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:10.001690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a4363e1-b9a6-404e-9fce-29f175a032ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:10.002549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a4363e1-b9a6-404e-9fce-29f175a032ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:10.003269 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a4363e1-b9a6-404e-9fce-29f175a032ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:10.004181 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a4363e1-b9a6-404e-9fce-29f175a032ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:10.004642 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a4363e1-b9a6-404e-9fce-29f175a032ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:10.005081 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a4363e1-b9a6-404e-9fce-29f175a032ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:10.073403 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9a4363e1-b9a6-404e-9fce-29f175a032ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:10.081665 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9a4363e1-b9a6-404e-9fce-29f175a032ab tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.100944 Aug 04 23:41:10.082246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1016/2003] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:09 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:10.520857 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:41:10.521204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:41:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:41:11.103455 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e65b4891-3e28-4e5e-b11c-4a0833da3719 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:11.104105 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e65b4891-3e28-4e5e-b11c-4a0833da3719 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:11.111426 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e65b4891-3e28-4e5e-b11c-4a0833da3719 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:11.111908 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e65b4891-3e28-4e5e-b11c-4a0833da3719 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:11.112345 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e65b4891-3e28-4e5e-b11c-4a0833da3719 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:11.113045 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e65b4891-3e28-4e5e-b11c-4a0833da3719 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:11.113494 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e65b4891-3e28-4e5e-b11c-4a0833da3719 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:11.113910 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e65b4891-3e28-4e5e-b11c-4a0833da3719 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:11.180037 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e65b4891-3e28-4e5e-b11c-4a0833da3719 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:11.188999 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e65b4891-3e28-4e5e-b11c-4a0833da3719 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.089450 Aug 04 23:41:11.189860 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 988/2004] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:11 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:12.209599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c3a2ef9d-23ca-41de-b228-499d82334fe2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:12.210226 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c3a2ef9d-23ca-41de-b228-499d82334fe2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:12.216829 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3a2ef9d-23ca-41de-b228-499d82334fe2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:12.217311 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3a2ef9d-23ca-41de-b228-499d82334fe2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:12.217744 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3a2ef9d-23ca-41de-b228-499d82334fe2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:12.218513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3a2ef9d-23ca-41de-b228-499d82334fe2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:12.218983 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3a2ef9d-23ca-41de-b228-499d82334fe2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:12.219410 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3a2ef9d-23ca-41de-b228-499d82334fe2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:12.285473 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c3a2ef9d-23ca-41de-b228-499d82334fe2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:12.293230 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c3a2ef9d-23ca-41de-b228-499d82334fe2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.087523 Aug 04 23:41:12.293786 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1017/2005] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:12 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:41:13.316250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-533f3a84-8ff8-4d54-ae3e-f1e3a29f04f7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:13.316810 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-533f3a84-8ff8-4d54-ae3e-f1e3a29f04f7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:13.323314 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-533f3a84-8ff8-4d54-ae3e-f1e3a29f04f7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:13.323797 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-533f3a84-8ff8-4d54-ae3e-f1e3a29f04f7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:13.324231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-533f3a84-8ff8-4d54-ae3e-f1e3a29f04f7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:13.324933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-533f3a84-8ff8-4d54-ae3e-f1e3a29f04f7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:13.325390 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-533f3a84-8ff8-4d54-ae3e-f1e3a29f04f7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:13.325807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-533f3a84-8ff8-4d54-ae3e-f1e3a29f04f7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:13.388422 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-533f3a84-8ff8-4d54-ae3e-f1e3a29f04f7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:13.396506 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-533f3a84-8ff8-4d54-ae3e-f1e3a29f04f7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084849 Aug 04 23:41:13.397091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 989/2006] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:13 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:41:14.417226 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4851c576-2b02-49ff-aae4-2b807ead5323 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:14.417820 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4851c576-2b02-49ff-aae4-2b807ead5323 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:14.425098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4851c576-2b02-49ff-aae4-2b807ead5323 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:14.425575 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4851c576-2b02-49ff-aae4-2b807ead5323 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:14.426008 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4851c576-2b02-49ff-aae4-2b807ead5323 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:14.426722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4851c576-2b02-49ff-aae4-2b807ead5323 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:14.427176 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4851c576-2b02-49ff-aae4-2b807ead5323 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:14.427599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4851c576-2b02-49ff-aae4-2b807ead5323 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:14.494949 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4851c576-2b02-49ff-aae4-2b807ead5323 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:14.504124 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4851c576-2b02-49ff-aae4-2b807ead5323 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.090709 Aug 04 23:41:14.504987 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1018/2007] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:14 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:15.524529 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f9c3ee63-b270-4248-8d90-1d27f5d08ed7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:15.525125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f9c3ee63-b270-4248-8d90-1d27f5d08ed7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:15.531428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f9c3ee63-b270-4248-8d90-1d27f5d08ed7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:15.531898 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f9c3ee63-b270-4248-8d90-1d27f5d08ed7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:15.532319 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f9c3ee63-b270-4248-8d90-1d27f5d08ed7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:15.533162 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f9c3ee63-b270-4248-8d90-1d27f5d08ed7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:15.533603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f9c3ee63-b270-4248-8d90-1d27f5d08ed7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:15.534018 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f9c3ee63-b270-4248-8d90-1d27f5d08ed7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:15.595713 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f9c3ee63-b270-4248-8d90-1d27f5d08ed7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:15.603191 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f9c3ee63-b270-4248-8d90-1d27f5d08ed7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.082634 Aug 04 23:41:15.603745 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 990/2008] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:15 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:16.624613 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9da3adae-b37a-4955-b0a1-29b89eae8f2e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:16.625241 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9da3adae-b37a-4955-b0a1-29b89eae8f2e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:16.632036 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9da3adae-b37a-4955-b0a1-29b89eae8f2e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:16.632525 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9da3adae-b37a-4955-b0a1-29b89eae8f2e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:16.632967 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9da3adae-b37a-4955-b0a1-29b89eae8f2e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:16.633670 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9da3adae-b37a-4955-b0a1-29b89eae8f2e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:16.634125 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9da3adae-b37a-4955-b0a1-29b89eae8f2e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:16.634594 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9da3adae-b37a-4955-b0a1-29b89eae8f2e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:16.696910 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9da3adae-b37a-4955-b0a1-29b89eae8f2e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:16.704996 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9da3adae-b37a-4955-b0a1-29b89eae8f2e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084101 Aug 04 23:41:16.705798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1019/2009] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:16 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:17.725757 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f6a67103-8875-41f3-afbf-6ca34c411a1f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:17.726384 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f6a67103-8875-41f3-afbf-6ca34c411a1f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:17.734350 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f6a67103-8875-41f3-afbf-6ca34c411a1f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:17.735099 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f6a67103-8875-41f3-afbf-6ca34c411a1f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:17.735751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f6a67103-8875-41f3-afbf-6ca34c411a1f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:17.736806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f6a67103-8875-41f3-afbf-6ca34c411a1f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:17.737907 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f6a67103-8875-41f3-afbf-6ca34c411a1f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:17.738383 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f6a67103-8875-41f3-afbf-6ca34c411a1f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:17.798985 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f6a67103-8875-41f3-afbf-6ca34c411a1f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:17.807461 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f6a67103-8875-41f3-afbf-6ca34c411a1f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.085616 Aug 04 23:41:17.808037 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 991/2010] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:17 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:18.828987 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8e42a747-c18b-4cd7-a8ed-01efea047749 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:18.829732 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8e42a747-c18b-4cd7-a8ed-01efea047749 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:18.836474 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8e42a747-c18b-4cd7-a8ed-01efea047749 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:18.836948 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8e42a747-c18b-4cd7-a8ed-01efea047749 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:18.837389 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8e42a747-c18b-4cd7-a8ed-01efea047749 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:18.838095 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8e42a747-c18b-4cd7-a8ed-01efea047749 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:18.838589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8e42a747-c18b-4cd7-a8ed-01efea047749 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:18.839020 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8e42a747-c18b-4cd7-a8ed-01efea047749 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:18.904638 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8e42a747-c18b-4cd7-a8ed-01efea047749 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:18.913060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8e42a747-c18b-4cd7-a8ed-01efea047749 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.088394 Aug 04 23:41:18.913626 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1020/2011] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:18 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:19.934866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e1b19afa-3853-4c80-9bf3-e53880be7512 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:19.935512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e1b19afa-3853-4c80-9bf3-e53880be7512 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:19.942957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1b19afa-3853-4c80-9bf3-e53880be7512 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:19.943425 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1b19afa-3853-4c80-9bf3-e53880be7512 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:19.943864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1b19afa-3853-4c80-9bf3-e53880be7512 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:19.944568 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1b19afa-3853-4c80-9bf3-e53880be7512 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:19.945023 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1b19afa-3853-4c80-9bf3-e53880be7512 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:19.945447 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1b19afa-3853-4c80-9bf3-e53880be7512 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:19.948266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=84 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:41:20.013810 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e1b19afa-3853-4c80-9bf3-e53880be7512 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:20.022066 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e1b19afa-3853-4c80-9bf3-e53880be7512 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.091132 Aug 04 23:41:20.022656 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 992/2012] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:19 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:21.042269 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a9392add-d1ed-423c-8c45-54c78043ab37 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:21.042892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a9392add-d1ed-423c-8c45-54c78043ab37 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:21.049485 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9392add-d1ed-423c-8c45-54c78043ab37 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:21.049959 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9392add-d1ed-423c-8c45-54c78043ab37 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:21.050408 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9392add-d1ed-423c-8c45-54c78043ab37 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:21.051589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9392add-d1ed-423c-8c45-54c78043ab37 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:21.052028 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9392add-d1ed-423c-8c45-54c78043ab37 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:21.052445 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9392add-d1ed-423c-8c45-54c78043ab37 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:21.115978 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a9392add-d1ed-423c-8c45-54c78043ab37 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:21.123404 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a9392add-d1ed-423c-8c45-54c78043ab37 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084988 Aug 04 23:41:21.123962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1021/2013] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:21 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:22.148733 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f7627368-07d5-40ef-8558-e68b4738b40e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:22.149780 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f7627368-07d5-40ef-8558-e68b4738b40e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:22.161574 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7627368-07d5-40ef-8558-e68b4738b40e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:22.162469 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7627368-07d5-40ef-8558-e68b4738b40e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:22.163233 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7627368-07d5-40ef-8558-e68b4738b40e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:22.164430 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7627368-07d5-40ef-8558-e68b4738b40e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:22.165242 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7627368-07d5-40ef-8558-e68b4738b40e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:22.166041 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7627368-07d5-40ef-8558-e68b4738b40e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:22.249959 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f7627368-07d5-40ef-8558-e68b4738b40e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:22.257979 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f7627368-07d5-40ef-8558-e68b4738b40e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.116717 Aug 04 23:41:22.258576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 993/2014] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:22 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:23.281973 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e1e923c8-2b1b-48ca-94ad-0044bfc330b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:23.282616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e1e923c8-2b1b-48ca-94ad-0044bfc330b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:23.289723 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e1e923c8-2b1b-48ca-94ad-0044bfc330b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:23.290214 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e1e923c8-2b1b-48ca-94ad-0044bfc330b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:23.290684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e1e923c8-2b1b-48ca-94ad-0044bfc330b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:23.291415 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e1e923c8-2b1b-48ca-94ad-0044bfc330b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:23.291868 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e1e923c8-2b1b-48ca-94ad-0044bfc330b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:23.292288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e1e923c8-2b1b-48ca-94ad-0044bfc330b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:23.366930 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e1e923c8-2b1b-48ca-94ad-0044bfc330b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:23.374753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e1e923c8-2b1b-48ca-94ad-0044bfc330b9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.097126 Aug 04 23:41:23.375327 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1022/2015] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:23 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:23.436308 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:41:23.436800 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:41:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:41:24.395246 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c89b6acc-9164-49df-b1b9-8ab90bbb119b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:24.395852 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c89b6acc-9164-49df-b1b9-8ab90bbb119b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:24.397865 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=28 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:41:24.403360 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c89b6acc-9164-49df-b1b9-8ab90bbb119b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:24.403841 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c89b6acc-9164-49df-b1b9-8ab90bbb119b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:24.404275 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c89b6acc-9164-49df-b1b9-8ab90bbb119b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:24.404965 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c89b6acc-9164-49df-b1b9-8ab90bbb119b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:24.405417 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c89b6acc-9164-49df-b1b9-8ab90bbb119b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:24.405836 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c89b6acc-9164-49df-b1b9-8ab90bbb119b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:24.469232 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c89b6acc-9164-49df-b1b9-8ab90bbb119b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:24.477743 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c89b6acc-9164-49df-b1b9-8ab90bbb119b tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.086412 Aug 04 23:41:24.478307 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 994/2016] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:24 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:25.499283 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-540898f1-3f85-40b2-aa1e-2676b30724fc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:25.499893 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-540898f1-3f85-40b2-aa1e-2676b30724fc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:25.501991 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=28 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:41:25.507915 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-540898f1-3f85-40b2-aa1e-2676b30724fc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:25.508401 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-540898f1-3f85-40b2-aa1e-2676b30724fc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:25.508841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-540898f1-3f85-40b2-aa1e-2676b30724fc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:25.509536 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-540898f1-3f85-40b2-aa1e-2676b30724fc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:25.509985 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-540898f1-3f85-40b2-aa1e-2676b30724fc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:25.510441 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-540898f1-3f85-40b2-aa1e-2676b30724fc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:25.513194 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=84 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:41:25.572238 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-540898f1-3f85-40b2-aa1e-2676b30724fc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:25.579705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-540898f1-3f85-40b2-aa1e-2676b30724fc tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084293 Aug 04 23:41:25.580259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1023/2017] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:25 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:26.600859 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-57bb81ed-ad90-4719-b821-47db3be2f21f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:26.601470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-57bb81ed-ad90-4719-b821-47db3be2f21f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:26.607886 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-57bb81ed-ad90-4719-b821-47db3be2f21f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:26.608379 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-57bb81ed-ad90-4719-b821-47db3be2f21f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:26.608819 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-57bb81ed-ad90-4719-b821-47db3be2f21f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:26.609521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-57bb81ed-ad90-4719-b821-47db3be2f21f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:26.609981 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-57bb81ed-ad90-4719-b821-47db3be2f21f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:26.610428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-57bb81ed-ad90-4719-b821-47db3be2f21f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:26.673464 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-57bb81ed-ad90-4719-b821-47db3be2f21f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:26.681247 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-57bb81ed-ad90-4719-b821-47db3be2f21f tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084266 Aug 04 23:41:26.681816 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 995/2018] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:26 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:27.702736 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ba268fe7-4add-405e-ab14-561dc58605f9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:27.703398 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ba268fe7-4add-405e-ab14-561dc58605f9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:27.711204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba268fe7-4add-405e-ab14-561dc58605f9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:27.711688 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba268fe7-4add-405e-ab14-561dc58605f9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:27.712125 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba268fe7-4add-405e-ab14-561dc58605f9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:27.712819 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba268fe7-4add-405e-ab14-561dc58605f9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:27.713270 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba268fe7-4add-405e-ab14-561dc58605f9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:27.713696 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba268fe7-4add-405e-ab14-561dc58605f9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:27.777941 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ba268fe7-4add-405e-ab14-561dc58605f9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:27.786128 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ba268fe7-4add-405e-ab14-561dc58605f9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.087498 Aug 04 23:41:27.786731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1024/2019] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:27 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:28.807662 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-71d3dd41-0b01-49d2-8e2f-3f50ecff3b06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:28.808257 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-71d3dd41-0b01-49d2-8e2f-3f50ecff3b06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:28.814746 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-71d3dd41-0b01-49d2-8e2f-3f50ecff3b06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:28.815224 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-71d3dd41-0b01-49d2-8e2f-3f50ecff3b06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:28.815653 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-71d3dd41-0b01-49d2-8e2f-3f50ecff3b06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:28.816552 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-71d3dd41-0b01-49d2-8e2f-3f50ecff3b06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:28.817212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-71d3dd41-0b01-49d2-8e2f-3f50ecff3b06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:28.817680 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-71d3dd41-0b01-49d2-8e2f-3f50ecff3b06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:28.880316 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-71d3dd41-0b01-49d2-8e2f-3f50ecff3b06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:28.888682 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-71d3dd41-0b01-49d2-8e2f-3f50ecff3b06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084628 Aug 04 23:41:28.889245 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 996/2020] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:28 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:29.909012 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0b0665a5-715a-440a-8468-bd868e44ef04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:29.910272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0b0665a5-715a-440a-8468-bd868e44ef04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:29.916842 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0b0665a5-715a-440a-8468-bd868e44ef04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:29.917321 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0b0665a5-715a-440a-8468-bd868e44ef04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:29.917748 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0b0665a5-715a-440a-8468-bd868e44ef04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:29.918464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0b0665a5-715a-440a-8468-bd868e44ef04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:29.918914 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0b0665a5-715a-440a-8468-bd868e44ef04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:29.919335 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0b0665a5-715a-440a-8468-bd868e44ef04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:29.981642 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0b0665a5-715a-440a-8468-bd868e44ef04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:29.989313 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0b0665a5-715a-440a-8468-bd868e44ef04 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084114 Aug 04 23:41:29.989870 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1025/2021] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:29 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:31.009196 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-71eb13b4-27fa-4c14-a744-2cb83a3439a0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:31.009820 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-71eb13b4-27fa-4c14-a744-2cb83a3439a0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:31.016353 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-71eb13b4-27fa-4c14-a744-2cb83a3439a0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:31.016822 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-71eb13b4-27fa-4c14-a744-2cb83a3439a0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:31.017250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-71eb13b4-27fa-4c14-a744-2cb83a3439a0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:31.017926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-71eb13b4-27fa-4c14-a744-2cb83a3439a0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:31.018388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-71eb13b4-27fa-4c14-a744-2cb83a3439a0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:31.018812 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-71eb13b4-27fa-4c14-a744-2cb83a3439a0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:31.080469 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-71eb13b4-27fa-4c14-a744-2cb83a3439a0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:31.089036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-71eb13b4-27fa-4c14-a744-2cb83a3439a0 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.083586 Aug 04 23:41:31.089530 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 997/2022] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:31 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:32.109299 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f39de3d0-8a4b-40a8-bfbd-b6f5733ef8a8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:32.109859 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f39de3d0-8a4b-40a8-bfbd-b6f5733ef8a8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:32.116612 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f39de3d0-8a4b-40a8-bfbd-b6f5733ef8a8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:32.117085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f39de3d0-8a4b-40a8-bfbd-b6f5733ef8a8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:32.117513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f39de3d0-8a4b-40a8-bfbd-b6f5733ef8a8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:32.118198 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f39de3d0-8a4b-40a8-bfbd-b6f5733ef8a8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:32.118670 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f39de3d0-8a4b-40a8-bfbd-b6f5733ef8a8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:32.119091 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f39de3d0-8a4b-40a8-bfbd-b6f5733ef8a8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:32.185736 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f39de3d0-8a4b-40a8-bfbd-b6f5733ef8a8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:32.193544 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f39de3d0-8a4b-40a8-bfbd-b6f5733ef8a8 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.088187 Aug 04 23:41:32.194097 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1026/2023] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:32 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:33.213200 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f97b55b7-a964-4ff9-81d9-2997816391a6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:33.213803 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f97b55b7-a964-4ff9-81d9-2997816391a6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:33.220260 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f97b55b7-a964-4ff9-81d9-2997816391a6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:33.220731 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f97b55b7-a964-4ff9-81d9-2997816391a6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:33.221185 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f97b55b7-a964-4ff9-81d9-2997816391a6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:33.221876 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f97b55b7-a964-4ff9-81d9-2997816391a6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:33.223400 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f97b55b7-a964-4ff9-81d9-2997816391a6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:33.223849 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f97b55b7-a964-4ff9-81d9-2997816391a6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:33.285812 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f97b55b7-a964-4ff9-81d9-2997816391a6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:33.293274 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f97b55b7-a964-4ff9-81d9-2997816391a6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084059 Aug 04 23:41:33.293823 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 998/2024] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:33 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:34.315215 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d96d6909-9c1e-4ee1-a2d0-85a3e99333cb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:34.315816 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d96d6909-9c1e-4ee1-a2d0-85a3e99333cb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:34.323229 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d96d6909-9c1e-4ee1-a2d0-85a3e99333cb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:34.323722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d96d6909-9c1e-4ee1-a2d0-85a3e99333cb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:34.324159 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d96d6909-9c1e-4ee1-a2d0-85a3e99333cb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:34.324860 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d96d6909-9c1e-4ee1-a2d0-85a3e99333cb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:34.325319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d96d6909-9c1e-4ee1-a2d0-85a3e99333cb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:34.325744 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d96d6909-9c1e-4ee1-a2d0-85a3e99333cb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:34.387005 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d96d6909-9c1e-4ee1-a2d0-85a3e99333cb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:34.394566 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d96d6909-9c1e-4ee1-a2d0-85a3e99333cb tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.083199 Aug 04 23:41:34.395148 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1027/2025] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:34 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:35.416095 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a1f8c2d0-2b45-4b90-a823-3e43d8803a06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:35.416794 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a1f8c2d0-2b45-4b90-a823-3e43d8803a06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:35.423376 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a1f8c2d0-2b45-4b90-a823-3e43d8803a06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:35.423855 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a1f8c2d0-2b45-4b90-a823-3e43d8803a06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:35.424288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a1f8c2d0-2b45-4b90-a823-3e43d8803a06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:35.424973 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a1f8c2d0-2b45-4b90-a823-3e43d8803a06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:35.425425 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a1f8c2d0-2b45-4b90-a823-3e43d8803a06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:35.425839 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a1f8c2d0-2b45-4b90-a823-3e43d8803a06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:35.488299 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a1f8c2d0-2b45-4b90-a823-3e43d8803a06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:35.495797 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a1f8c2d0-2b45-4b90-a823-3e43d8803a06 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.083525 Aug 04 23:41:35.496351 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 999/2026] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:35 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:36.516852 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-fbdf3d08-347b-4a18-9227-0b88d57de5d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:36.517481 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-fbdf3d08-347b-4a18-9227-0b88d57de5d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:36.524450 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbdf3d08-347b-4a18-9227-0b88d57de5d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:36.524924 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbdf3d08-347b-4a18-9227-0b88d57de5d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:36.525353 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbdf3d08-347b-4a18-9227-0b88d57de5d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:36.526040 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbdf3d08-347b-4a18-9227-0b88d57de5d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:36.526518 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbdf3d08-347b-4a18-9227-0b88d57de5d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:36.526938 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fbdf3d08-347b-4a18-9227-0b88d57de5d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:36.593777 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-fbdf3d08-347b-4a18-9227-0b88d57de5d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:36.602039 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-fbdf3d08-347b-4a18-9227-0b88d57de5d6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.089009 Aug 04 23:41:36.602656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1028/2027] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:36 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:37.623909 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e34eb121-85c2-4366-956c-44e74cf61740 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:37.624567 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e34eb121-85c2-4366-956c-44e74cf61740 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:37.631448 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e34eb121-85c2-4366-956c-44e74cf61740 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:37.631945 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e34eb121-85c2-4366-956c-44e74cf61740 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:37.632383 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e34eb121-85c2-4366-956c-44e74cf61740 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:37.633096 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e34eb121-85c2-4366-956c-44e74cf61740 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:37.633683 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e34eb121-85c2-4366-956c-44e74cf61740 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:37.633983 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e34eb121-85c2-4366-956c-44e74cf61740 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:37.697247 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e34eb121-85c2-4366-956c-44e74cf61740 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:37.704940 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e34eb121-85c2-4366-956c-44e74cf61740 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.085535 Aug 04 23:41:37.705514 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1000/2028] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:37 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:38.725934 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-aa260fe0-c193-4fb1-a3eb-d90c82726325 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:38.726592 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-aa260fe0-c193-4fb1-a3eb-d90c82726325 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:38.733335 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa260fe0-c193-4fb1-a3eb-d90c82726325 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:38.733825 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa260fe0-c193-4fb1-a3eb-d90c82726325 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:38.734347 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa260fe0-c193-4fb1-a3eb-d90c82726325 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:38.735073 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa260fe0-c193-4fb1-a3eb-d90c82726325 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:38.735549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa260fe0-c193-4fb1-a3eb-d90c82726325 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:38.735974 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-aa260fe0-c193-4fb1-a3eb-d90c82726325 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:38.797531 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-aa260fe0-c193-4fb1-a3eb-d90c82726325 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:38.805604 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-aa260fe0-c193-4fb1-a3eb-d90c82726325 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.083590 Aug 04 23:41:38.806165 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1029/2029] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:38 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:39.827204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-936ca7f9-0671-4977-ad53-76d61d45354e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:39.827802 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-936ca7f9-0671-4977-ad53-76d61d45354e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:39.834954 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-936ca7f9-0671-4977-ad53-76d61d45354e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:39.835746 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-936ca7f9-0671-4977-ad53-76d61d45354e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:39.835867 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-936ca7f9-0671-4977-ad53-76d61d45354e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:39.836554 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-936ca7f9-0671-4977-ad53-76d61d45354e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:39.837003 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-936ca7f9-0671-4977-ad53-76d61d45354e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:39.837423 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-936ca7f9-0671-4977-ad53-76d61d45354e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:39.899917 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-936ca7f9-0671-4977-ad53-76d61d45354e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:39.907406 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-936ca7f9-0671-4977-ad53-76d61d45354e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084053 Aug 04 23:41:39.907956 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1001/2030] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:39 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:40.929413 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8dbb29c6-5c75-48fa-9497-3fe6c3d634f7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:40.930031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8dbb29c6-5c75-48fa-9497-3fe6c3d634f7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:40.936494 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8dbb29c6-5c75-48fa-9497-3fe6c3d634f7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:40.936971 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8dbb29c6-5c75-48fa-9497-3fe6c3d634f7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:40.937404 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8dbb29c6-5c75-48fa-9497-3fe6c3d634f7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:40.938092 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8dbb29c6-5c75-48fa-9497-3fe6c3d634f7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:40.938570 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8dbb29c6-5c75-48fa-9497-3fe6c3d634f7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:40.938994 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8dbb29c6-5c75-48fa-9497-3fe6c3d634f7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:41.005534 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8dbb29c6-5c75-48fa-9497-3fe6c3d634f7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:41.013241 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8dbb29c6-5c75-48fa-9497-3fe6c3d634f7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.088386 Aug 04 23:41:41.013803 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1030/2031] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:40 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:41.079242 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:41:41.079457 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:41:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:41:42.035349 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4b8c4fde-f707-4c07-b8d5-dab8b088f51c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:42.036053 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4b8c4fde-f707-4c07-b8d5-dab8b088f51c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:42.042881 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4b8c4fde-f707-4c07-b8d5-dab8b088f51c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:42.043366 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4b8c4fde-f707-4c07-b8d5-dab8b088f51c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:42.043799 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4b8c4fde-f707-4c07-b8d5-dab8b088f51c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:42.044502 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4b8c4fde-f707-4c07-b8d5-dab8b088f51c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:42.044951 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4b8c4fde-f707-4c07-b8d5-dab8b088f51c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:42.045375 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4b8c4fde-f707-4c07-b8d5-dab8b088f51c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:42.108385 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4b8c4fde-f707-4c07-b8d5-dab8b088f51c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:42.116563 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4b8c4fde-f707-4c07-b8d5-dab8b088f51c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.085874 Aug 04 23:41:42.117232 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1002/2032] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:42 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:43.136477 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ab04af8f-0f03-4bd3-aeef-869c8c50ca5e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:43.137031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ab04af8f-0f03-4bd3-aeef-869c8c50ca5e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:43.144590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab04af8f-0f03-4bd3-aeef-869c8c50ca5e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:43.145080 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab04af8f-0f03-4bd3-aeef-869c8c50ca5e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:43.145517 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab04af8f-0f03-4bd3-aeef-869c8c50ca5e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:43.146226 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab04af8f-0f03-4bd3-aeef-869c8c50ca5e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:43.146704 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab04af8f-0f03-4bd3-aeef-869c8c50ca5e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:43.147131 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab04af8f-0f03-4bd3-aeef-869c8c50ca5e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:43.210468 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ab04af8f-0f03-4bd3-aeef-869c8c50ca5e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:43.218057 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ab04af8f-0f03-4bd3-aeef-869c8c50ca5e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.085532 Aug 04 23:41:43.218659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1031/2033] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:43 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:44.239516 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6a8df796-cd2c-408d-b9e0-ae64954cc6e3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:44.240184 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6a8df796-cd2c-408d-b9e0-ae64954cc6e3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:44.246882 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6a8df796-cd2c-408d-b9e0-ae64954cc6e3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:44.247367 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6a8df796-cd2c-408d-b9e0-ae64954cc6e3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:44.247808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6a8df796-cd2c-408d-b9e0-ae64954cc6e3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:44.248525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6a8df796-cd2c-408d-b9e0-ae64954cc6e3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:44.248977 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6a8df796-cd2c-408d-b9e0-ae64954cc6e3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:44.249399 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6a8df796-cd2c-408d-b9e0-ae64954cc6e3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:44.325826 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6a8df796-cd2c-408d-b9e0-ae64954cc6e3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:44.334797 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6a8df796-cd2c-408d-b9e0-ae64954cc6e3 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.099223 Aug 04 23:41:44.335364 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1003/2034] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:44 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:45.355817 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-309db732-82ae-4d6b-9f98-da7d767bedc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:45.356421 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-309db732-82ae-4d6b-9f98-da7d767bedc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:45.363370 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-309db732-82ae-4d6b-9f98-da7d767bedc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:45.363857 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-309db732-82ae-4d6b-9f98-da7d767bedc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:45.364407 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-309db732-82ae-4d6b-9f98-da7d767bedc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:45.365215 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-309db732-82ae-4d6b-9f98-da7d767bedc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:45.365565 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-309db732-82ae-4d6b-9f98-da7d767bedc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:45.365983 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-309db732-82ae-4d6b-9f98-da7d767bedc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:45.432693 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-309db732-82ae-4d6b-9f98-da7d767bedc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:45.440192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-309db732-82ae-4d6b-9f98-da7d767bedc9 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.088236 Aug 04 23:41:45.441342 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1032/2035] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:45 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:46.462423 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fa0c4a42-16be-4bed-834b-663899338a48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:46.463061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-fa0c4a42-16be-4bed-834b-663899338a48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:46.469578 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fa0c4a42-16be-4bed-834b-663899338a48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:46.470061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fa0c4a42-16be-4bed-834b-663899338a48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:46.470529 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fa0c4a42-16be-4bed-834b-663899338a48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:46.471227 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fa0c4a42-16be-4bed-834b-663899338a48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:46.471683 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fa0c4a42-16be-4bed-834b-663899338a48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:46.472106 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fa0c4a42-16be-4bed-834b-663899338a48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:46.535903 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fa0c4a42-16be-4bed-834b-663899338a48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:46.543563 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-fa0c4a42-16be-4bed-834b-663899338a48 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.085229 Aug 04 23:41:46.544131 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1004/2036] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:46 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:47.564259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ca9c68c8-a8bd-4dea-a70e-3e8fce3ec34c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:47.564859 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ca9c68c8-a8bd-4dea-a70e-3e8fce3ec34c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:47.571559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca9c68c8-a8bd-4dea-a70e-3e8fce3ec34c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:47.572035 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca9c68c8-a8bd-4dea-a70e-3e8fce3ec34c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:47.572467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca9c68c8-a8bd-4dea-a70e-3e8fce3ec34c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:47.573410 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca9c68c8-a8bd-4dea-a70e-3e8fce3ec34c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:47.573868 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca9c68c8-a8bd-4dea-a70e-3e8fce3ec34c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:47.574280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ca9c68c8-a8bd-4dea-a70e-3e8fce3ec34c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:47.638202 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ca9c68c8-a8bd-4dea-a70e-3e8fce3ec34c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:47.645977 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ca9c68c8-a8bd-4dea-a70e-3e8fce3ec34c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.085517 Aug 04 23:41:47.646573 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1033/2037] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:47 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:48.666996 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f7d62dea-fc82-44b8-8fba-9b846cc32334 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:48.667665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f7d62dea-fc82-44b8-8fba-9b846cc32334 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:48.674329 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7d62dea-fc82-44b8-8fba-9b846cc32334 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:48.674827 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7d62dea-fc82-44b8-8fba-9b846cc32334 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:48.675253 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7d62dea-fc82-44b8-8fba-9b846cc32334 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:48.676846 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7d62dea-fc82-44b8-8fba-9b846cc32334 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:48.677290 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7d62dea-fc82-44b8-8fba-9b846cc32334 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:48.677734 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7d62dea-fc82-44b8-8fba-9b846cc32334 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:48.742747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f7d62dea-fc82-44b8-8fba-9b846cc32334 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:48.750302 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f7d62dea-fc82-44b8-8fba-9b846cc32334 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.087183 Aug 04 23:41:48.750887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1005/2038] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:48 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:49.772118 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f7849f0d-7f8f-453d-ab56-49480bf59ce6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:49.772733 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f7849f0d-7f8f-453d-ab56-49480bf59ce6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:49.779182 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f7849f0d-7f8f-453d-ab56-49480bf59ce6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:49.779663 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f7849f0d-7f8f-453d-ab56-49480bf59ce6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:49.780100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f7849f0d-7f8f-453d-ab56-49480bf59ce6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:49.780800 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f7849f0d-7f8f-453d-ab56-49480bf59ce6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:49.781249 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f7849f0d-7f8f-453d-ab56-49480bf59ce6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:49.781677 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f7849f0d-7f8f-453d-ab56-49480bf59ce6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:49.845743 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f7849f0d-7f8f-453d-ab56-49480bf59ce6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:49.853532 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f7849f0d-7f8f-453d-ab56-49480bf59ce6 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.086029 Aug 04 23:41:49.854102 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1034/2039] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:49 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:41:50.873770 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-12f65b61-613b-4532-981a-04eb3a9b9a7d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:50.874402 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-12f65b61-613b-4532-981a-04eb3a9b9a7d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:50.880909 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-12f65b61-613b-4532-981a-04eb3a9b9a7d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:50.881394 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-12f65b61-613b-4532-981a-04eb3a9b9a7d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:50.881831 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-12f65b61-613b-4532-981a-04eb3a9b9a7d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:50.882546 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-12f65b61-613b-4532-981a-04eb3a9b9a7d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:50.883000 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-12f65b61-613b-4532-981a-04eb3a9b9a7d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:50.883421 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-12f65b61-613b-4532-981a-04eb3a9b9a7d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:50.886005 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=84 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:41:50.945702 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-12f65b61-613b-4532-981a-04eb3a9b9a7d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:50.953302 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-12f65b61-613b-4532-981a-04eb3a9b9a7d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.083408 Aug 04 23:41:50.953857 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1006/2040] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:50 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:51.974016 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-77ba917c-2984-4418-9c2e-bd8fae9c246e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:51.975669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-77ba917c-2984-4418-9c2e-bd8fae9c246e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:51.982916 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77ba917c-2984-4418-9c2e-bd8fae9c246e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:51.983459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77ba917c-2984-4418-9c2e-bd8fae9c246e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:51.983884 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77ba917c-2984-4418-9c2e-bd8fae9c246e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:51.984680 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77ba917c-2984-4418-9c2e-bd8fae9c246e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:51.985187 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77ba917c-2984-4418-9c2e-bd8fae9c246e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:51.985615 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-77ba917c-2984-4418-9c2e-bd8fae9c246e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:52.051124 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-77ba917c-2984-4418-9c2e-bd8fae9c246e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:52.058635 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-77ba917c-2984-4418-9c2e-bd8fae9c246e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.088511 Aug 04 23:41:52.059196 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1035/2041] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:51 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:53.080055 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-05119e72-7b2a-4485-90db-95fd3bf7eee2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:53.080644 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-05119e72-7b2a-4485-90db-95fd3bf7eee2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:53.087428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05119e72-7b2a-4485-90db-95fd3bf7eee2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:53.087838 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05119e72-7b2a-4485-90db-95fd3bf7eee2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:53.088288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05119e72-7b2a-4485-90db-95fd3bf7eee2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:53.088968 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05119e72-7b2a-4485-90db-95fd3bf7eee2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:53.089554 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05119e72-7b2a-4485-90db-95fd3bf7eee2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:53.090092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05119e72-7b2a-4485-90db-95fd3bf7eee2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:53.151879 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-05119e72-7b2a-4485-90db-95fd3bf7eee2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:53.159490 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-05119e72-7b2a-4485-90db-95fd3bf7eee2 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.083485 Aug 04 23:41:53.160323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1007/2042] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:53 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:54.181273 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-55548ecb-881f-4c68-acdd-2af5ae4845ce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:54.181856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-55548ecb-881f-4c68-acdd-2af5ae4845ce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:54.187865 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55548ecb-881f-4c68-acdd-2af5ae4845ce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:54.188334 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55548ecb-881f-4c68-acdd-2af5ae4845ce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:54.188760 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55548ecb-881f-4c68-acdd-2af5ae4845ce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:54.189439 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55548ecb-881f-4c68-acdd-2af5ae4845ce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:54.189960 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55548ecb-881f-4c68-acdd-2af5ae4845ce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:54.190420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55548ecb-881f-4c68-acdd-2af5ae4845ce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:54.254050 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-55548ecb-881f-4c68-acdd-2af5ae4845ce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:54.261537 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-55548ecb-881f-4c68-acdd-2af5ae4845ce tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084248 Aug 04 23:41:54.262093 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1036/2043] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:54 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:41:55.281730 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1aa3bdea-aada-4608-97ad-c78072fd238d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:55.282416 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1aa3bdea-aada-4608-97ad-c78072fd238d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:55.285201 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=28 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:41:55.290579 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1aa3bdea-aada-4608-97ad-c78072fd238d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:55.291062 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1aa3bdea-aada-4608-97ad-c78072fd238d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:55.291498 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1aa3bdea-aada-4608-97ad-c78072fd238d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:55.292189 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1aa3bdea-aada-4608-97ad-c78072fd238d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:55.292639 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1aa3bdea-aada-4608-97ad-c78072fd238d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:55.293064 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1aa3bdea-aada-4608-97ad-c78072fd238d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:55.354961 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1aa3bdea-aada-4608-97ad-c78072fd238d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:55.362689 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1aa3bdea-aada-4608-97ad-c78072fd238d tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084742 Aug 04 23:41:55.363299 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1008/2044] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:55 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:56.383506 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4cdfb210-b55e-4729-bb0c-db986847eb97 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:56.384073 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4cdfb210-b55e-4729-bb0c-db986847eb97 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:56.386406 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=28 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:41:56.391724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cdfb210-b55e-4729-bb0c-db986847eb97 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:56.392208 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cdfb210-b55e-4729-bb0c-db986847eb97 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:56.392644 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cdfb210-b55e-4729-bb0c-db986847eb97 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:56.393347 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cdfb210-b55e-4729-bb0c-db986847eb97 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:56.393843 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cdfb210-b55e-4729-bb0c-db986847eb97 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:56.394228 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4cdfb210-b55e-4729-bb0c-db986847eb97 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:56.397177 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=84 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:41:56.456843 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4cdfb210-b55e-4729-bb0c-db986847eb97 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:56.464740 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4cdfb210-b55e-4729-bb0c-db986847eb97 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.085117 Aug 04 23:41:56.465320 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1037/2045] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:56 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:57.486326 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a8612934-a4a1-4a46-889f-32976816a05c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:57.487005 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a8612934-a4a1-4a46-889f-32976816a05c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:57.494105 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8612934-a4a1-4a46-889f-32976816a05c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:57.494619 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8612934-a4a1-4a46-889f-32976816a05c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:57.495054 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8612934-a4a1-4a46-889f-32976816a05c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:57.495744 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8612934-a4a1-4a46-889f-32976816a05c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:57.496195 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8612934-a4a1-4a46-889f-32976816a05c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:57.496618 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8612934-a4a1-4a46-889f-32976816a05c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:57.559264 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a8612934-a4a1-4a46-889f-32976816a05c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:57.567494 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a8612934-a4a1-4a46-889f-32976816a05c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084439 Aug 04 23:41:57.568106 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1009/2046] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:57 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:58.587923 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2743e2b5-d5ad-4b4f-b50d-0d3b9961eca7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:58.588555 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2743e2b5-d5ad-4b4f-b50d-0d3b9961eca7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:58.595380 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2743e2b5-d5ad-4b4f-b50d-0d3b9961eca7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:58.595853 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2743e2b5-d5ad-4b4f-b50d-0d3b9961eca7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:58.596302 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2743e2b5-d5ad-4b4f-b50d-0d3b9961eca7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:58.596985 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2743e2b5-d5ad-4b4f-b50d-0d3b9961eca7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:58.597433 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2743e2b5-d5ad-4b4f-b50d-0d3b9961eca7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:58.597853 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2743e2b5-d5ad-4b4f-b50d-0d3b9961eca7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:58.661595 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2743e2b5-d5ad-4b4f-b50d-0d3b9961eca7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:58.669127 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2743e2b5-d5ad-4b4f-b50d-0d3b9961eca7 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084970 Aug 04 23:41:58.669693 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1038/2047] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:58 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:41:59.690613 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-638f5c67-5a83-4cf3-bf50-05a8e60ea408 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:41:59.691254 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-638f5c67-5a83-4cf3-bf50-05a8e60ea408 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:41:59.697933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-638f5c67-5a83-4cf3-bf50-05a8e60ea408 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:59.698443 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-638f5c67-5a83-4cf3-bf50-05a8e60ea408 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:59.698880 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-638f5c67-5a83-4cf3-bf50-05a8e60ea408 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:59.699585 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-638f5c67-5a83-4cf3-bf50-05a8e60ea408 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:41:59.700034 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-638f5c67-5a83-4cf3-bf50-05a8e60ea408 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:41:59.700460 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-638f5c67-5a83-4cf3-bf50-05a8e60ea408 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:41:59.763484 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-638f5c67-5a83-4cf3-bf50-05a8e60ea408 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:41:59.771766 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-638f5c67-5a83-4cf3-bf50-05a8e60ea408 tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.084986 Aug 04 23:41:59.772342 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1010/2048] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:41:59 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:42:00.793076 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a8b36da7-0dfa-45df-aaff-f363c199c94c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:42:00.793678 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a8b36da7-0dfa-45df-aaff-f363c199c94c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:42:00.800435 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8b36da7-0dfa-45df-aaff-f363c199c94c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:42:00.800917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8b36da7-0dfa-45df-aaff-f363c199c94c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:42:00.801397 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8b36da7-0dfa-45df-aaff-f363c199c94c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:42:00.802295 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8b36da7-0dfa-45df-aaff-f363c199c94c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:42:00.802772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8b36da7-0dfa-45df-aaff-f363c199c94c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:42:00.803203 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a8b36da7-0dfa-45df-aaff-f363c199c94c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:42:00.867664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a8b36da7-0dfa-45df-aaff-f363c199c94c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:42:00.875450 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a8b36da7-0dfa-45df-aaff-f363c199c94c tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.086224 Aug 04 23:42:00.876019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1039/2049] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:42:00 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:42:01.896827 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d674ed19-5e1b-42b3-8984-00dff14ce6ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:42:01.897445 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d674ed19-5e1b-42b3-8984-00dff14ce6ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:42:01.903905 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d674ed19-5e1b-42b3-8984-00dff14ce6ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:42:01.904365 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d674ed19-5e1b-42b3-8984-00dff14ce6ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:42:01.904796 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d674ed19-5e1b-42b3-8984-00dff14ce6ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:42:01.905476 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d674ed19-5e1b-42b3-8984-00dff14ce6ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:42:01.905926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d674ed19-5e1b-42b3-8984-00dff14ce6ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:42:01.906347 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d674ed19-5e1b-42b3-8984-00dff14ce6ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:42:01.968311 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d674ed19-5e1b-42b3-8984-00dff14ce6ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:42:01.976475 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d674ed19-5e1b-42b3-8984-00dff14ce6ff tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.083691 Aug 04 23:42:01.977277 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1011/2050] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:42:01 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:42:02.999212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2d64a942-581f-4798-bda8-5a3adfc7877a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:42:02.999835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2d64a942-581f-4798-bda8-5a3adfc7877a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:42:03.007179 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2d64a942-581f-4798-bda8-5a3adfc7877a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:42:03.007660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2d64a942-581f-4798-bda8-5a3adfc7877a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:42:03.008098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2d64a942-581f-4798-bda8-5a3adfc7877a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:42:03.008795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2d64a942-581f-4798-bda8-5a3adfc7877a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:42:03.009253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2d64a942-581f-4798-bda8-5a3adfc7877a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:42:03.009678 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2d64a942-581f-4798-bda8-5a3adfc7877a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:42:03.075422 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2d64a942-581f-4798-bda8-5a3adfc7877a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:42:03.083718 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2d64a942-581f-4798-bda8-5a3adfc7877a tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.088289 Aug 04 23:42:03.084513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1040/2051] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:42:02 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:42:04.104206 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d1645861-c6be-43c1-b5aa-323efada1cbf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:42:04.104893 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d1645861-c6be-43c1-b5aa-323efada1cbf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] [instance: 7a0c9ea5-2710-4533-b166-010d46ab0027] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:42:04.111707 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1645861-c6be-43c1-b5aa-323efada1cbf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:42:04.112186 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1645861-c6be-43c1-b5aa-323efada1cbf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:42:04.112615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1645861-c6be-43c1-b5aa-323efada1cbf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:42:04.113300 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1645861-c6be-43c1-b5aa-323efada1cbf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:42:04.113757 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1645861-c6be-43c1-b5aa-323efada1cbf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:42:04.114753 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1645861-c6be-43c1-b5aa-323efada1cbf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:42:04.179042 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d1645861-c6be-43c1-b5aa-323efada1cbf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83876d8ed0af480d9b531193eeced051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6ec5e686904fe69e4891c68fcd8cb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:42:04.186707 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d1645861-c6be-43c1-b5aa-323efada1cbf tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027" status: 200 len: 1213 microversion: 2.1 time: 0.086331 Aug 04 23:42:04.187275 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1012/2052] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:42:04 2022] GET /compute/v2.1/servers/7a0c9ea5-2710-4533-b166-010d46ab0027 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:42:04.360431 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ef015e5e-7c13-4cd6-b918-eb6bb835737e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] Calling method '.version_select at 0x7f6d25dd4160>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:42:04.386421 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ef015e5e-7c13-4cd6-b918-eb6bb835737e tempest-TestShelveInstance-1978078083 tempest-TestShelveInstance-1978078083-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1675453597" status: 202 len: 0 microversion: 2.1 time: 0.029837 Aug 04 23:42:04.387235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1041/2053] 10.222.0.33 () {58 vars in 1254 bytes} [Thu Aug 4 23:42:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1675453597 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:43:03.625875 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:43:03.626657 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:43:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:43:18.751681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=9 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:43:18.752571 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=41 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:43:18.756643 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8cfca19d-5e60-477d-bd96-8dc03137f758 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:18.757167 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8cfca19d-5e60-477d-bd96-8dc03137f758 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: e5609e6d-20ca-45b4-8edf-9b0eff540469] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:18.764265 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8cfca19d-5e60-477d-bd96-8dc03137f758 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:18.764612 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8cfca19d-5e60-477d-bd96-8dc03137f758 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:18.765050 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8cfca19d-5e60-477d-bd96-8dc03137f758 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:18.765753 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8cfca19d-5e60-477d-bd96-8dc03137f758 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:18.766202 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8cfca19d-5e60-477d-bd96-8dc03137f758 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:18.766660 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8cfca19d-5e60-477d-bd96-8dc03137f758 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:18.780892 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-8cfca19d-5e60-477d-bd96-8dc03137f758 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] HTTP exception thrown: Instance e5609e6d-20ca-45b4-8edf-9b0eff540469 could not be found. Aug 04 23:43:18.782590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8cfca19d-5e60-477d-bd96-8dc03137f758 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Request method failure captured: Aug 04 23:43:18.782590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: DELETE /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469 HTTP/1.1 Aug 04 23:43:18.782590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:43:18.782590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:43:18.782590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:43:18.782590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 0 Aug 04 23:43:18.782590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:43:18.782590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:43:18.782590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:43:18.782590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:43:18.782590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FRJZMt_ovgBvylQQkOcY773MPZMsH8E61Dm1eLB6D0DgOOyRBI6G0yizu_QS-puIt--Wzz0jIf7la2DtjZkT40s5ZQw8pt2ehw_CTLUmEDuF9PwY_Sam_5zdViqLq68DjmONE54QtGf94GQ2KGKeOyXIby2fSy9S1J2kzxo2Jyuz1g Aug 04 23:43:18.782590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:43:18.782590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:43:18.782590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:43:18.782590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:43:18.782590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:43:18.782590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:43:18.782590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: c5dd21e824d843aea197d84ef1ab1319 Aug 04 23:43:18.782590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-AttachVolumeTestJSON-2132667042 Aug 04 23:43:18.782590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:43:18.782590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:43:18.784280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c5dd21e824d843aea197d84ef1ab1319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c5dd21e824d843aea197d84ef1ab1319"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c5dd21e824d843aea197d84ef1ab1319"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c5dd21e824d843aea197d84ef1ab1319"}]}] Aug 04 23:43:18.784280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-AttachVolumeTestJSON-2132667042 Aug 04 23:43:18.784280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: c5dd21e824d843aea197d84ef1ab1319 Aug 04 23:43:18.784280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2132667042 Aug 04 23:43:18.784280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-AttachVolumeTestJSON-2132667042-project Aug 04 23:43:18.784280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:43:18.784280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:43:18.784280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: 3a00aba057b548b1bc81e68acffea150 Aug 04 23:43:18.784280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-AttachVolumeTestJSON-2132667042-project Aug 04 23:43:18.784280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: > Aug 04 23:43:18.784280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Instance e5609e6d-20ca-45b4-8edf-9b0eff540469 could not be found. Aug 04 23:43:18.784280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'id': 'e5609e6d-20ca-45b4-8edf-9b0eff540469'} Aug 04 23:43:18.785231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:43:18.785231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:43:18.785231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:43:18.785231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:43:18.785231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:43:18.785231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:43:18.785231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:43:18.785231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:43:18.785231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:43:18.785231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:43:18.785231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5609e6d-20ca-45b4-8edf-9b0eff540469 could not be found. Aug 04 23:43:18.785231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:43:18.785231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:43:18.785231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:43:18.785231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:43:18.785231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:43:18.785231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:43:18.785231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:43:18.785231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:43:18.785231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:43:18.787266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:43:18.787266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 23:43:18.787266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 23:43:18.787266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 23:43:18.787266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 23:43:18.787266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:43:18.787266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:43:18.787266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:43:18.787266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:43:18.787266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5609e6d-20ca-45b4-8edf-9b0eff540469 could not be found. Aug 04 23:43:18.787266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:43:18.787266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:43:18.787266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:43:18.787266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:43:18.787266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:43:18.787266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:43:18.787266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:43:18.787266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:43:18.787266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5609e6d-20ca-45b4-8edf-9b0eff540469 could not be found. Aug 04 23:43:18.787266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:43:18.790967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8cfca19d-5e60-477d-bd96-8dc03137f758 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Returning 404 to user: Instance e5609e6d-20ca-45b4-8edf-9b0eff540469 could not be found. {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:43:18.790967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8cfca19d-5e60-477d-bd96-8dc03137f758 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469" status: 404 len: 111 microversion: 2.1 time: 0.034386 Aug 04 23:43:18.790967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1013/2054] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:43:18 2022] DELETE /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:43:18.793465 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=23 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:43:18.794950 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:43:18.802127 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ed4ae2b1-56a8-42a1-aeee-dfb215908eda tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:18.802659 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ed4ae2b1-56a8-42a1-aeee-dfb215908eda tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:18.809112 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-eb0dfa9b-2200-4cfc-9385-a878cb228f85 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:18.809112 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-eb0dfa9b-2200-4cfc-9385-a878cb228f85 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: e5609e6d-20ca-45b4-8edf-9b0eff540469] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:18.820492 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb0dfa9b-2200-4cfc-9385-a878cb228f85 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:18.820848 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ed4ae2b1-56a8-42a1-aeee-dfb215908eda tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:18.821297 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb0dfa9b-2200-4cfc-9385-a878cb228f85 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:18.821454 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ed4ae2b1-56a8-42a1-aeee-dfb215908eda tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:18.821715 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb0dfa9b-2200-4cfc-9385-a878cb228f85 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:18.821871 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ed4ae2b1-56a8-42a1-aeee-dfb215908eda tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:18.822484 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ed4ae2b1-56a8-42a1-aeee-dfb215908eda tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:18.822672 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb0dfa9b-2200-4cfc-9385-a878cb228f85 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:18.822941 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ed4ae2b1-56a8-42a1-aeee-dfb215908eda tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:18.823066 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb0dfa9b-2200-4cfc-9385-a878cb228f85 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:18.823374 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ed4ae2b1-56a8-42a1-aeee-dfb215908eda tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:18.823532 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb0dfa9b-2200-4cfc-9385-a878cb228f85 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:18.840672 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-eb0dfa9b-2200-4cfc-9385-a878cb228f85 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] HTTP exception thrown: Instance e5609e6d-20ca-45b4-8edf-9b0eff540469 could not be found. Aug 04 23:43:18.842278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-eb0dfa9b-2200-4cfc-9385-a878cb228f85 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Request method failure captured: Aug 04 23:43:18.842278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469 HTTP/1.1 Aug 04 23:43:18.842278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:43:18.842278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:43:18.842278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:43:18.842278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:43:18.842278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:43:18.842278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:43:18.842278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:43:18.842278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:43:18.842278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FRJZMt_ovgBvylQQkOcY773MPZMsH8E61Dm1eLB6D0DgOOyRBI6G0yizu_QS-puIt--Wzz0jIf7la2DtjZkT40s5ZQw8pt2ehw_CTLUmEDuF9PwY_Sam_5zdViqLq68DjmONE54QtGf94GQ2KGKeOyXIby2fSy9S1J2kzxo2Jyuz1g Aug 04 23:43:18.842278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:43:18.842278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:43:18.842278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:43:18.842278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:43:18.842278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:43:18.842278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:43:18.842278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: c5dd21e824d843aea197d84ef1ab1319 Aug 04 23:43:18.842278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-AttachVolumeTestJSON-2132667042 Aug 04 23:43:18.842278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:43:18.842278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:43:18.844201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c5dd21e824d843aea197d84ef1ab1319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c5dd21e824d843aea197d84ef1ab1319"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c5dd21e824d843aea197d84ef1ab1319"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c5dd21e824d843aea197d84ef1ab1319"}]}] Aug 04 23:43:18.844201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-AttachVolumeTestJSON-2132667042 Aug 04 23:43:18.844201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: c5dd21e824d843aea197d84ef1ab1319 Aug 04 23:43:18.844201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2132667042 Aug 04 23:43:18.844201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-AttachVolumeTestJSON-2132667042-project Aug 04 23:43:18.844201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:43:18.844201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:43:18.844201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: 3a00aba057b548b1bc81e68acffea150 Aug 04 23:43:18.844201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-AttachVolumeTestJSON-2132667042-project Aug 04 23:43:18.844201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:43:18.844201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Instance e5609e6d-20ca-45b4-8edf-9b0eff540469 could not be found. Aug 04 23:43:18.844201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': 'e5609e6d-20ca-45b4-8edf-9b0eff540469'} Aug 04 23:43:18.845086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:43:18.845086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:43:18.845086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:43:18.845086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:43:18.845086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:43:18.845086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:43:18.845086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:43:18.845086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:43:18.845086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:43:18.845086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:43:18.845086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5609e6d-20ca-45b4-8edf-9b0eff540469 could not be found. Aug 04 23:43:18.845086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:43:18.845086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:43:18.845086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:43:18.845086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:43:18.845086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:43:18.845086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:43:18.845086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:43:18.845086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:43:18.845086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:43:18.846464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:43:18.846464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:43:18.846464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:43:18.846464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:43:18.846464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:43:18.846464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:43:18.846464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:43:18.846464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5609e6d-20ca-45b4-8edf-9b0eff540469 could not be found. Aug 04 23:43:18.846464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:43:18.846464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:43:18.846464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:43:18.846464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:43:18.846464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:43:18.846464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:43:18.846464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:43:18.846464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:43:18.846464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5609e6d-20ca-45b4-8edf-9b0eff540469 could not be found. Aug 04 23:43:18.846464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:43:18.847712 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-eb0dfa9b-2200-4cfc-9385-a878cb228f85 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Returning 404 to user: Instance e5609e6d-20ca-45b4-8edf-9b0eff540469 could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:43:18.847712 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-eb0dfa9b-2200-4cfc-9385-a878cb228f85 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469" status: 404 len: 111 microversion: 2.1 time: 0.053813 Aug 04 23:43:18.847712 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1042/2055] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:18 2022] GET /compute/v2.1/servers/e5609e6d-20ca-45b4-8edf-9b0eff540469 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:43:18.854008 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ed4ae2b1-56a8-42a1-aeee-dfb215908eda tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Going to try to terminate instance {{(pid=129791) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 23:43:18.938863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ed4ae2b1-56a8-42a1-aeee-dfb215908eda tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 204 len: 0 microversion: 2.1 time: 0.140076 Aug 04 23:43:18.940387 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1014/2056] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:43:18 2022] DELETE /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 23:43:18.952906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-703626bd-b465-459e-a1db-3acb16336420 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:18.953519 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-703626bd-b465-459e-a1db-3acb16336420 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:18.959816 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-703626bd-b465-459e-a1db-3acb16336420 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:18.960886 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-703626bd-b465-459e-a1db-3acb16336420 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:18.961317 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-703626bd-b465-459e-a1db-3acb16336420 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:18.962018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-703626bd-b465-459e-a1db-3acb16336420 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:18.962493 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-703626bd-b465-459e-a1db-3acb16336420 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:18.962911 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-703626bd-b465-459e-a1db-3acb16336420 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:19.316004 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-703626bd-b465-459e-a1db-3acb16336420 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:19.324613 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-703626bd-b465-459e-a1db-3acb16336420 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.375544 Aug 04 23:43:19.325201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1043/2057] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:18 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:20.346620 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c3573479-56cb-47c1-83fe-7e70fff92822 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:20.347589 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c3573479-56cb-47c1-83fe-7e70fff92822 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:20.356866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c3573479-56cb-47c1-83fe-7e70fff92822 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:20.357444 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c3573479-56cb-47c1-83fe-7e70fff92822 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:20.357886 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c3573479-56cb-47c1-83fe-7e70fff92822 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:20.358637 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c3573479-56cb-47c1-83fe-7e70fff92822 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:20.359093 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c3573479-56cb-47c1-83fe-7e70fff92822 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:20.359520 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c3573479-56cb-47c1-83fe-7e70fff92822 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:20.556713 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c3573479-56cb-47c1-83fe-7e70fff92822 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:20.565107 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c3573479-56cb-47c1-83fe-7e70fff92822 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.222835 Aug 04 23:43:20.565680 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1015/2058] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:20 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:21.586940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-203462a8-6bd8-456d-a416-d4e6d63ca9fc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:21.587635 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-203462a8-6bd8-456d-a416-d4e6d63ca9fc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:21.594206 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-203462a8-6bd8-456d-a416-d4e6d63ca9fc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:21.594709 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-203462a8-6bd8-456d-a416-d4e6d63ca9fc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:21.595137 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-203462a8-6bd8-456d-a416-d4e6d63ca9fc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:21.595926 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-203462a8-6bd8-456d-a416-d4e6d63ca9fc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:21.596498 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-203462a8-6bd8-456d-a416-d4e6d63ca9fc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:21.597000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-203462a8-6bd8-456d-a416-d4e6d63ca9fc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:21.736445 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-203462a8-6bd8-456d-a416-d4e6d63ca9fc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:21.746482 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-203462a8-6bd8-456d-a416-d4e6d63ca9fc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.163711 Aug 04 23:43:21.747067 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1044/2059] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:21 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:22.768241 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0ac2b7f6-86ee-40b8-a87d-a11b8082ed5a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:22.768837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0ac2b7f6-86ee-40b8-a87d-a11b8082ed5a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:22.775948 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0ac2b7f6-86ee-40b8-a87d-a11b8082ed5a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:22.776437 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0ac2b7f6-86ee-40b8-a87d-a11b8082ed5a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:22.776878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0ac2b7f6-86ee-40b8-a87d-a11b8082ed5a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:22.777583 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0ac2b7f6-86ee-40b8-a87d-a11b8082ed5a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:22.778028 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0ac2b7f6-86ee-40b8-a87d-a11b8082ed5a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:22.778477 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0ac2b7f6-86ee-40b8-a87d-a11b8082ed5a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:23.147833 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0ac2b7f6-86ee-40b8-a87d-a11b8082ed5a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:23.156973 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0ac2b7f6-86ee-40b8-a87d-a11b8082ed5a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.392661 Aug 04 23:43:23.157543 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1016/2060] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:22 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:24.180572 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-26cf0229-a514-4aa0-a98b-0b9192d90fd2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:24.181175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-26cf0229-a514-4aa0-a98b-0b9192d90fd2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:24.187899 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-26cf0229-a514-4aa0-a98b-0b9192d90fd2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:24.188386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-26cf0229-a514-4aa0-a98b-0b9192d90fd2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:24.188823 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-26cf0229-a514-4aa0-a98b-0b9192d90fd2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:24.189521 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-26cf0229-a514-4aa0-a98b-0b9192d90fd2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:24.189973 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-26cf0229-a514-4aa0-a98b-0b9192d90fd2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:24.190420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-26cf0229-a514-4aa0-a98b-0b9192d90fd2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:24.333752 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-26cf0229-a514-4aa0-a98b-0b9192d90fd2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:24.342464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-26cf0229-a514-4aa0-a98b-0b9192d90fd2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.167155 Aug 04 23:43:24.343024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1045/2061] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:24 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:25.364236 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f07786a1-2e0a-41cf-89fc-14478bb97b17 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:25.364844 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f07786a1-2e0a-41cf-89fc-14478bb97b17 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:25.371932 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f07786a1-2e0a-41cf-89fc-14478bb97b17 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:25.372360 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f07786a1-2e0a-41cf-89fc-14478bb97b17 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:25.372783 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f07786a1-2e0a-41cf-89fc-14478bb97b17 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:25.373466 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f07786a1-2e0a-41cf-89fc-14478bb97b17 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:25.373905 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f07786a1-2e0a-41cf-89fc-14478bb97b17 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:25.374317 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f07786a1-2e0a-41cf-89fc-14478bb97b17 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:25.509543 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f07786a1-2e0a-41cf-89fc-14478bb97b17 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:25.517598 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f07786a1-2e0a-41cf-89fc-14478bb97b17 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.157183 Aug 04 23:43:25.518158 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1017/2062] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:25 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:26.540778 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b3a6d787-f063-407f-941c-eccab9b97b85 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:26.541472 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b3a6d787-f063-407f-941c-eccab9b97b85 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:26.548307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3a6d787-f063-407f-941c-eccab9b97b85 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:26.548788 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3a6d787-f063-407f-941c-eccab9b97b85 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:26.549233 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3a6d787-f063-407f-941c-eccab9b97b85 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:26.550633 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3a6d787-f063-407f-941c-eccab9b97b85 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:26.551086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3a6d787-f063-407f-941c-eccab9b97b85 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:26.551507 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3a6d787-f063-407f-941c-eccab9b97b85 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:26.696590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b3a6d787-f063-407f-941c-eccab9b97b85 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:26.704957 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b3a6d787-f063-407f-941c-eccab9b97b85 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.168720 Aug 04 23:43:26.705543 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1046/2063] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:26 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:27.728478 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1937e53a-0d24-4216-a2bd-ff871bfc9f42 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:27.729223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1937e53a-0d24-4216-a2bd-ff871bfc9f42 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:27.735703 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1937e53a-0d24-4216-a2bd-ff871bfc9f42 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:27.736185 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1937e53a-0d24-4216-a2bd-ff871bfc9f42 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:27.736616 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1937e53a-0d24-4216-a2bd-ff871bfc9f42 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:27.737316 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1937e53a-0d24-4216-a2bd-ff871bfc9f42 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:27.737761 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1937e53a-0d24-4216-a2bd-ff871bfc9f42 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:27.738178 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1937e53a-0d24-4216-a2bd-ff871bfc9f42 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:27.872257 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1937e53a-0d24-4216-a2bd-ff871bfc9f42 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:27.880313 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1937e53a-0d24-4216-a2bd-ff871bfc9f42 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.156739 Aug 04 23:43:27.880901 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1018/2064] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:27 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:28.902094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b923a15d-df0c-477a-a548-cd1872e8e751 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:28.902764 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b923a15d-df0c-477a-a548-cd1872e8e751 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:28.909370 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b923a15d-df0c-477a-a548-cd1872e8e751 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:28.909816 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b923a15d-df0c-477a-a548-cd1872e8e751 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:28.910270 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b923a15d-df0c-477a-a548-cd1872e8e751 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:28.910970 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b923a15d-df0c-477a-a548-cd1872e8e751 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:28.911426 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b923a15d-df0c-477a-a548-cd1872e8e751 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:28.911853 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b923a15d-df0c-477a-a548-cd1872e8e751 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:29.044409 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b923a15d-df0c-477a-a548-cd1872e8e751 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:29.052313 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b923a15d-df0c-477a-a548-cd1872e8e751 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.154977 Aug 04 23:43:29.053426 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1047/2065] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:28 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:30.073935 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-761cab4f-51e0-424c-83e7-059eaed459f1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:30.074564 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-761cab4f-51e0-424c-83e7-059eaed459f1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:30.081463 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-761cab4f-51e0-424c-83e7-059eaed459f1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:30.081948 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-761cab4f-51e0-424c-83e7-059eaed459f1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:30.082401 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-761cab4f-51e0-424c-83e7-059eaed459f1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:30.083127 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-761cab4f-51e0-424c-83e7-059eaed459f1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:30.083587 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-761cab4f-51e0-424c-83e7-059eaed459f1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:30.084014 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-761cab4f-51e0-424c-83e7-059eaed459f1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:30.227238 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-761cab4f-51e0-424c-83e7-059eaed459f1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:30.235795 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-761cab4f-51e0-424c-83e7-059eaed459f1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.165670 Aug 04 23:43:30.236400 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1019/2066] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:30 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:43:31.259635 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b919b04b-b983-4672-902b-da9fc1391c4d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:31.260249 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b919b04b-b983-4672-902b-da9fc1391c4d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:31.266714 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b919b04b-b983-4672-902b-da9fc1391c4d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:31.267189 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b919b04b-b983-4672-902b-da9fc1391c4d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:31.267614 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b919b04b-b983-4672-902b-da9fc1391c4d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:31.268307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b919b04b-b983-4672-902b-da9fc1391c4d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:31.268749 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b919b04b-b983-4672-902b-da9fc1391c4d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:31.269163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b919b04b-b983-4672-902b-da9fc1391c4d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:31.407357 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b919b04b-b983-4672-902b-da9fc1391c4d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:31.415777 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b919b04b-b983-4672-902b-da9fc1391c4d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.161718 Aug 04 23:43:31.416364 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1048/2067] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:31 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:32.438145 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b242ca6d-53ca-48e6-90ef-2e0152470e41 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:32.439019 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b242ca6d-53ca-48e6-90ef-2e0152470e41 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:32.447121 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b242ca6d-53ca-48e6-90ef-2e0152470e41 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:32.447607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b242ca6d-53ca-48e6-90ef-2e0152470e41 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:32.448038 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b242ca6d-53ca-48e6-90ef-2e0152470e41 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:32.448743 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b242ca6d-53ca-48e6-90ef-2e0152470e41 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:32.449283 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b242ca6d-53ca-48e6-90ef-2e0152470e41 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:32.449603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b242ca6d-53ca-48e6-90ef-2e0152470e41 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:32.618323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b242ca6d-53ca-48e6-90ef-2e0152470e41 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:32.626983 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b242ca6d-53ca-48e6-90ef-2e0152470e41 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.192877 Aug 04 23:43:32.627568 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1020/2068] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:32 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:33.649630 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ab8a3666-235c-45a0-a86e-3f1d75f15090 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:33.653272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ab8a3666-235c-45a0-a86e-3f1d75f15090 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:33.656985 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab8a3666-235c-45a0-a86e-3f1d75f15090 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:33.657466 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab8a3666-235c-45a0-a86e-3f1d75f15090 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:33.657894 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab8a3666-235c-45a0-a86e-3f1d75f15090 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:33.658624 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab8a3666-235c-45a0-a86e-3f1d75f15090 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:33.659068 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab8a3666-235c-45a0-a86e-3f1d75f15090 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:33.659482 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab8a3666-235c-45a0-a86e-3f1d75f15090 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:33.808732 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ab8a3666-235c-45a0-a86e-3f1d75f15090 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:33.819246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ab8a3666-235c-45a0-a86e-3f1d75f15090 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.173556 Aug 04 23:43:33.819828 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1049/2069] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:33 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:43:34.841257 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-35c666b4-324c-4e6b-a1cc-6d6a176b2944 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:34.841867 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-35c666b4-324c-4e6b-a1cc-6d6a176b2944 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:34.848372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35c666b4-324c-4e6b-a1cc-6d6a176b2944 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:34.848847 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35c666b4-324c-4e6b-a1cc-6d6a176b2944 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:34.849284 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35c666b4-324c-4e6b-a1cc-6d6a176b2944 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:34.849971 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35c666b4-324c-4e6b-a1cc-6d6a176b2944 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:34.850438 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35c666b4-324c-4e6b-a1cc-6d6a176b2944 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:34.850859 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35c666b4-324c-4e6b-a1cc-6d6a176b2944 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:34.981817 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-35c666b4-324c-4e6b-a1cc-6d6a176b2944 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:34.990082 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-35c666b4-324c-4e6b-a1cc-6d6a176b2944 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.152592 Aug 04 23:43:34.990681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1021/2070] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:34 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:36.012006 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-01092f6a-1561-4fca-aea0-1b4c77922390 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:36.012620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-01092f6a-1561-4fca-aea0-1b4c77922390 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:36.019128 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-01092f6a-1561-4fca-aea0-1b4c77922390 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:36.019606 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-01092f6a-1561-4fca-aea0-1b4c77922390 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:36.020036 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-01092f6a-1561-4fca-aea0-1b4c77922390 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:36.020732 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-01092f6a-1561-4fca-aea0-1b4c77922390 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:36.021183 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-01092f6a-1561-4fca-aea0-1b4c77922390 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:36.021616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-01092f6a-1561-4fca-aea0-1b4c77922390 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:36.152759 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-01092f6a-1561-4fca-aea0-1b4c77922390 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:36.160805 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-01092f6a-1561-4fca-aea0-1b4c77922390 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.152621 Aug 04 23:43:36.161492 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1050/2071] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:36 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:43:37.184086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5237600d-8f9d-47e1-9d7a-8c6c001ec79d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:37.184724 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5237600d-8f9d-47e1-9d7a-8c6c001ec79d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:37.191116 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5237600d-8f9d-47e1-9d7a-8c6c001ec79d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:37.191614 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5237600d-8f9d-47e1-9d7a-8c6c001ec79d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:37.192039 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5237600d-8f9d-47e1-9d7a-8c6c001ec79d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:37.192714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5237600d-8f9d-47e1-9d7a-8c6c001ec79d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:37.193155 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5237600d-8f9d-47e1-9d7a-8c6c001ec79d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:37.193571 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5237600d-8f9d-47e1-9d7a-8c6c001ec79d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:37.328751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5237600d-8f9d-47e1-9d7a-8c6c001ec79d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:37.336936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5237600d-8f9d-47e1-9d7a-8c6c001ec79d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.157820 Aug 04 23:43:37.337496 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1022/2072] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:37 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:38.357620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3a17bac0-1761-4dea-bc03-b91d5d26957f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:38.358218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3a17bac0-1761-4dea-bc03-b91d5d26957f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:38.364688 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a17bac0-1761-4dea-bc03-b91d5d26957f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:38.365164 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a17bac0-1761-4dea-bc03-b91d5d26957f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:38.365598 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a17bac0-1761-4dea-bc03-b91d5d26957f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:38.366282 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a17bac0-1761-4dea-bc03-b91d5d26957f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:38.366830 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a17bac0-1761-4dea-bc03-b91d5d26957f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:38.367258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a17bac0-1761-4dea-bc03-b91d5d26957f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:38.495023 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3a17bac0-1761-4dea-bc03-b91d5d26957f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:38.502943 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3a17bac0-1761-4dea-bc03-b91d5d26957f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.149131 Aug 04 23:43:38.503500 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1051/2073] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:38 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:39.524658 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9e4d620d-513e-4e6a-a781-745cc58922f8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:39.525259 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9e4d620d-513e-4e6a-a781-745cc58922f8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:39.531698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e4d620d-513e-4e6a-a781-745cc58922f8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:39.532174 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e4d620d-513e-4e6a-a781-745cc58922f8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:39.532608 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e4d620d-513e-4e6a-a781-745cc58922f8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:39.533295 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e4d620d-513e-4e6a-a781-745cc58922f8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:39.533746 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e4d620d-513e-4e6a-a781-745cc58922f8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:39.534167 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e4d620d-513e-4e6a-a781-745cc58922f8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:39.668918 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9e4d620d-513e-4e6a-a781-745cc58922f8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:39.676865 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9e4d620d-513e-4e6a-a781-745cc58922f8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.156240 Aug 04 23:43:39.677416 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1023/2074] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:39 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:40.698983 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c9b79e75-4015-420c-b6f5-30751bdf7546 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:40.699580 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c9b79e75-4015-420c-b6f5-30751bdf7546 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:40.706090 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c9b79e75-4015-420c-b6f5-30751bdf7546 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:40.706612 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c9b79e75-4015-420c-b6f5-30751bdf7546 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:40.707045 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c9b79e75-4015-420c-b6f5-30751bdf7546 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:40.707728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c9b79e75-4015-420c-b6f5-30751bdf7546 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:40.708177 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c9b79e75-4015-420c-b6f5-30751bdf7546 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:40.708599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c9b79e75-4015-420c-b6f5-30751bdf7546 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:40.838945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c9b79e75-4015-420c-b6f5-30751bdf7546 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:40.847559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c9b79e75-4015-420c-b6f5-30751bdf7546 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.152813 Aug 04 23:43:40.847976 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1052/2075] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:40 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:41.870439 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e187c937-ff18-4193-a407-8375611470ab tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:41.871047 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e187c937-ff18-4193-a407-8375611470ab tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:41.877881 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e187c937-ff18-4193-a407-8375611470ab tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:41.878353 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e187c937-ff18-4193-a407-8375611470ab tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:41.878808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e187c937-ff18-4193-a407-8375611470ab tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:41.879499 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e187c937-ff18-4193-a407-8375611470ab tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:41.879942 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e187c937-ff18-4193-a407-8375611470ab tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:41.880363 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e187c937-ff18-4193-a407-8375611470ab tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:42.016115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e187c937-ff18-4193-a407-8375611470ab tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:42.024955 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e187c937-ff18-4193-a407-8375611470ab tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.159631 Aug 04 23:43:42.025544 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1024/2076] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:41 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:43.048484 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c92c5393-e5a5-4df0-a2f5-f6b4c54bdf86 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:43.049101 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c92c5393-e5a5-4df0-a2f5-f6b4c54bdf86 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:43.056202 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c92c5393-e5a5-4df0-a2f5-f6b4c54bdf86 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:43.056686 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c92c5393-e5a5-4df0-a2f5-f6b4c54bdf86 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:43.057122 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c92c5393-e5a5-4df0-a2f5-f6b4c54bdf86 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:43.057825 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c92c5393-e5a5-4df0-a2f5-f6b4c54bdf86 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:43.058281 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c92c5393-e5a5-4df0-a2f5-f6b4c54bdf86 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:43.058737 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c92c5393-e5a5-4df0-a2f5-f6b4c54bdf86 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:43.190824 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c92c5393-e5a5-4df0-a2f5-f6b4c54bdf86 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:43.199866 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c92c5393-e5a5-4df0-a2f5-f6b4c54bdf86 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.155288 Aug 04 23:43:43.200423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1053/2077] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:43 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:44.221145 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-da5e7248-b4a3-4ffd-801d-15b27fb15805 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:44.221757 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-da5e7248-b4a3-4ffd-801d-15b27fb15805 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:44.228771 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-da5e7248-b4a3-4ffd-801d-15b27fb15805 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:44.229249 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-da5e7248-b4a3-4ffd-801d-15b27fb15805 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:44.229677 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-da5e7248-b4a3-4ffd-801d-15b27fb15805 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:44.230392 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-da5e7248-b4a3-4ffd-801d-15b27fb15805 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:44.230837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-da5e7248-b4a3-4ffd-801d-15b27fb15805 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:44.231253 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-da5e7248-b4a3-4ffd-801d-15b27fb15805 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:44.365279 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-da5e7248-b4a3-4ffd-801d-15b27fb15805 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:44.374280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-da5e7248-b4a3-4ffd-801d-15b27fb15805 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.157043 Aug 04 23:43:44.374863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1025/2078] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:44 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:45.395426 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b32d42a9-bc54-49ef-87d3-237798dd9072 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:45.396018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b32d42a9-bc54-49ef-87d3-237798dd9072 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:45.403042 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b32d42a9-bc54-49ef-87d3-237798dd9072 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:45.403517 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b32d42a9-bc54-49ef-87d3-237798dd9072 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:45.403944 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b32d42a9-bc54-49ef-87d3-237798dd9072 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:45.404625 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b32d42a9-bc54-49ef-87d3-237798dd9072 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:45.405073 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b32d42a9-bc54-49ef-87d3-237798dd9072 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:45.405491 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b32d42a9-bc54-49ef-87d3-237798dd9072 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:45.539790 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b32d42a9-bc54-49ef-87d3-237798dd9072 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:45.549539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b32d42a9-bc54-49ef-87d3-237798dd9072 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.157915 Aug 04 23:43:45.550113 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1054/2079] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:45 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:43:46.573088 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d1a0ae83-035c-482a-b25a-f87572236d0f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:46.573702 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d1a0ae83-035c-482a-b25a-f87572236d0f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:46.580219 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1a0ae83-035c-482a-b25a-f87572236d0f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:46.580692 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1a0ae83-035c-482a-b25a-f87572236d0f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:46.581124 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1a0ae83-035c-482a-b25a-f87572236d0f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:46.581812 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1a0ae83-035c-482a-b25a-f87572236d0f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:46.582254 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1a0ae83-035c-482a-b25a-f87572236d0f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:46.582721 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d1a0ae83-035c-482a-b25a-f87572236d0f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:46.714767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d1a0ae83-035c-482a-b25a-f87572236d0f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:46.722801 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d1a0ae83-035c-482a-b25a-f87572236d0f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.154420 Aug 04 23:43:46.723420 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1026/2080] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:46 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:47.744686 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-45adf020-fc39-4bd7-86b2-8c0d119efa30 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:47.745459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-45adf020-fc39-4bd7-86b2-8c0d119efa30 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:47.752061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-45adf020-fc39-4bd7-86b2-8c0d119efa30 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:47.752547 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-45adf020-fc39-4bd7-86b2-8c0d119efa30 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:47.752990 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-45adf020-fc39-4bd7-86b2-8c0d119efa30 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:47.753729 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-45adf020-fc39-4bd7-86b2-8c0d119efa30 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:47.754179 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-45adf020-fc39-4bd7-86b2-8c0d119efa30 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:47.754642 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-45adf020-fc39-4bd7-86b2-8c0d119efa30 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:47.902845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-45adf020-fc39-4bd7-86b2-8c0d119efa30 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:47.910936 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-45adf020-fc39-4bd7-86b2-8c0d119efa30 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.170164 Aug 04 23:43:47.911503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1055/2081] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:47 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:48.934495 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-48327992-7c50-43cb-b582-088f3ec2edb6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:48.935121 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-48327992-7c50-43cb-b582-088f3ec2edb6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:48.937575 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:43:48.942887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-48327992-7c50-43cb-b582-088f3ec2edb6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:48.943356 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-48327992-7c50-43cb-b582-088f3ec2edb6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:48.943783 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-48327992-7c50-43cb-b582-088f3ec2edb6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:48.944897 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-48327992-7c50-43cb-b582-088f3ec2edb6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:48.945463 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-48327992-7c50-43cb-b582-088f3ec2edb6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:48.945885 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-48327992-7c50-43cb-b582-088f3ec2edb6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:48.949129 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:43:49.079115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-48327992-7c50-43cb-b582-088f3ec2edb6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:49.088024 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-48327992-7c50-43cb-b582-088f3ec2edb6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.157538 Aug 04 23:43:49.088517 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1027/2082] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:48 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:49.540259 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:43:49.540530 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:43:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:43:50.110016 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-44c0c1dd-10ed-4bec-9ebf-91b978a90f86 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:50.110627 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-44c0c1dd-10ed-4bec-9ebf-91b978a90f86 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:50.112930 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=29 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:43:50.118668 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44c0c1dd-10ed-4bec-9ebf-91b978a90f86 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:50.119154 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44c0c1dd-10ed-4bec-9ebf-91b978a90f86 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:50.119587 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44c0c1dd-10ed-4bec-9ebf-91b978a90f86 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:50.120285 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44c0c1dd-10ed-4bec-9ebf-91b978a90f86 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:50.120735 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44c0c1dd-10ed-4bec-9ebf-91b978a90f86 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:50.121153 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44c0c1dd-10ed-4bec-9ebf-91b978a90f86 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:50.124420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=81 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:43:50.261143 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-44c0c1dd-10ed-4bec-9ebf-91b978a90f86 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:50.269641 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-44c0c1dd-10ed-4bec-9ebf-91b978a90f86 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.163518 Aug 04 23:43:50.270224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1056/2083] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:50 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:51.292825 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-cec247cb-09fe-4b81-8162-5d5a6de2400b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:51.293426 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-cec247cb-09fe-4b81-8162-5d5a6de2400b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:51.299917 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cec247cb-09fe-4b81-8162-5d5a6de2400b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:51.300406 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cec247cb-09fe-4b81-8162-5d5a6de2400b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:51.300815 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cec247cb-09fe-4b81-8162-5d5a6de2400b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:51.301507 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cec247cb-09fe-4b81-8162-5d5a6de2400b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:51.301948 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cec247cb-09fe-4b81-8162-5d5a6de2400b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:51.302387 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cec247cb-09fe-4b81-8162-5d5a6de2400b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:51.442213 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cec247cb-09fe-4b81-8162-5d5a6de2400b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:51.451507 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-cec247cb-09fe-4b81-8162-5d5a6de2400b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.163791 Aug 04 23:43:51.452092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1028/2084] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:51 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:52.473616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6b854c62-b353-47a8-b78e-a7a5bbbb37a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:52.474272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6b854c62-b353-47a8-b78e-a7a5bbbb37a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:52.481556 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b854c62-b353-47a8-b78e-a7a5bbbb37a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:52.482035 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b854c62-b353-47a8-b78e-a7a5bbbb37a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:52.482551 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b854c62-b353-47a8-b78e-a7a5bbbb37a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:52.483235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b854c62-b353-47a8-b78e-a7a5bbbb37a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:52.483686 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b854c62-b353-47a8-b78e-a7a5bbbb37a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:52.484103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b854c62-b353-47a8-b78e-a7a5bbbb37a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:52.618921 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6b854c62-b353-47a8-b78e-a7a5bbbb37a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:52.627068 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6b854c62-b353-47a8-b78e-a7a5bbbb37a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.157446 Aug 04 23:43:52.627643 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1057/2085] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:52 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:53.651107 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-bbdf477b-51b7-462c-b542-870e4c96aeef tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:53.651706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-bbdf477b-51b7-462c-b542-870e4c96aeef tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:53.657926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bbdf477b-51b7-462c-b542-870e4c96aeef tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:53.658426 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bbdf477b-51b7-462c-b542-870e4c96aeef tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:53.658858 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bbdf477b-51b7-462c-b542-870e4c96aeef tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:53.659542 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bbdf477b-51b7-462c-b542-870e4c96aeef tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:53.659990 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bbdf477b-51b7-462c-b542-870e4c96aeef tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:53.660409 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bbdf477b-51b7-462c-b542-870e4c96aeef tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:53.794008 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-bbdf477b-51b7-462c-b542-870e4c96aeef tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:53.802176 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-bbdf477b-51b7-462c-b542-870e4c96aeef tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.155838 Aug 04 23:43:53.802770 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1029/2086] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:53 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:54.824061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-bcce5dcf-95af-4ef1-a662-5ed03011b59b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:54.824690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-bcce5dcf-95af-4ef1-a662-5ed03011b59b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:54.830865 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bcce5dcf-95af-4ef1-a662-5ed03011b59b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:54.831337 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bcce5dcf-95af-4ef1-a662-5ed03011b59b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:54.831770 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bcce5dcf-95af-4ef1-a662-5ed03011b59b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:54.832471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bcce5dcf-95af-4ef1-a662-5ed03011b59b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:54.832911 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bcce5dcf-95af-4ef1-a662-5ed03011b59b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:54.833329 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bcce5dcf-95af-4ef1-a662-5ed03011b59b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:54.964470 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-bcce5dcf-95af-4ef1-a662-5ed03011b59b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:54.972351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-bcce5dcf-95af-4ef1-a662-5ed03011b59b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.152522 Aug 04 23:43:54.972910 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1058/2087] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:54 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:55.993968 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ed52d8c4-d3e1-4b69-bda0-dcab6602b7e8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:55.994763 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ed52d8c4-d3e1-4b69-bda0-dcab6602b7e8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:56.001537 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ed52d8c4-d3e1-4b69-bda0-dcab6602b7e8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:56.002016 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ed52d8c4-d3e1-4b69-bda0-dcab6602b7e8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:56.002735 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ed52d8c4-d3e1-4b69-bda0-dcab6602b7e8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:56.003460 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ed52d8c4-d3e1-4b69-bda0-dcab6602b7e8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:56.003909 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ed52d8c4-d3e1-4b69-bda0-dcab6602b7e8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:56.004329 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ed52d8c4-d3e1-4b69-bda0-dcab6602b7e8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:56.138467 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ed52d8c4-d3e1-4b69-bda0-dcab6602b7e8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:56.146428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ed52d8c4-d3e1-4b69-bda0-dcab6602b7e8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.156927 Aug 04 23:43:56.147133 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1030/2088] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:55 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:57.167341 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3af1bd12-ca4f-477b-b4b6-c2ac3b3cd3b0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:57.167960 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3af1bd12-ca4f-477b-b4b6-c2ac3b3cd3b0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:57.174384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3af1bd12-ca4f-477b-b4b6-c2ac3b3cd3b0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:57.174871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3af1bd12-ca4f-477b-b4b6-c2ac3b3cd3b0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:57.175309 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3af1bd12-ca4f-477b-b4b6-c2ac3b3cd3b0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:57.176003 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3af1bd12-ca4f-477b-b4b6-c2ac3b3cd3b0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:57.176450 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3af1bd12-ca4f-477b-b4b6-c2ac3b3cd3b0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:57.176874 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3af1bd12-ca4f-477b-b4b6-c2ac3b3cd3b0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:57.313204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3af1bd12-ca4f-477b-b4b6-c2ac3b3cd3b0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:57.322263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3af1bd12-ca4f-477b-b4b6-c2ac3b3cd3b0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.158942 Aug 04 23:43:57.322859 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1059/2089] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:57 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:58.343228 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-adc3c2d8-2935-4400-9e35-cee830a784b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:58.343864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-adc3c2d8-2935-4400-9e35-cee830a784b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:58.350507 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adc3c2d8-2935-4400-9e35-cee830a784b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:58.350905 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adc3c2d8-2935-4400-9e35-cee830a784b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:58.351338 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adc3c2d8-2935-4400-9e35-cee830a784b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:58.352029 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adc3c2d8-2935-4400-9e35-cee830a784b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:58.352479 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adc3c2d8-2935-4400-9e35-cee830a784b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:58.352902 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-adc3c2d8-2935-4400-9e35-cee830a784b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:58.486202 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-adc3c2d8-2935-4400-9e35-cee830a784b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:58.495151 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-adc3c2d8-2935-4400-9e35-cee830a784b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.155790 Aug 04 23:43:58.495716 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1031/2090] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:58 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:43:59.516793 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f87a667b-ce80-42d3-9a10-ab2d526a3a51 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:43:59.517415 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f87a667b-ce80-42d3-9a10-ab2d526a3a51 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:43:59.524726 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f87a667b-ce80-42d3-9a10-ab2d526a3a51 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:59.525200 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f87a667b-ce80-42d3-9a10-ab2d526a3a51 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:59.525634 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f87a667b-ce80-42d3-9a10-ab2d526a3a51 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:59.526321 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f87a667b-ce80-42d3-9a10-ab2d526a3a51 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:43:59.526791 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f87a667b-ce80-42d3-9a10-ab2d526a3a51 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:43:59.527217 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f87a667b-ce80-42d3-9a10-ab2d526a3a51 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:43:59.664272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f87a667b-ce80-42d3-9a10-ab2d526a3a51 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:43:59.672471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f87a667b-ce80-42d3-9a10-ab2d526a3a51 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.159512 Aug 04 23:43:59.673036 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1060/2091] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:43:59 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:00.694003 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6b24baa7-6064-4e38-bb0c-5593a7175468 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:00.694716 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6b24baa7-6064-4e38-bb0c-5593a7175468 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:00.701328 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6b24baa7-6064-4e38-bb0c-5593a7175468 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:00.701843 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6b24baa7-6064-4e38-bb0c-5593a7175468 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:00.702275 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6b24baa7-6064-4e38-bb0c-5593a7175468 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:00.703008 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6b24baa7-6064-4e38-bb0c-5593a7175468 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:00.703466 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6b24baa7-6064-4e38-bb0c-5593a7175468 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:00.703918 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6b24baa7-6064-4e38-bb0c-5593a7175468 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:00.837608 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6b24baa7-6064-4e38-bb0c-5593a7175468 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:00.845225 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6b24baa7-6064-4e38-bb0c-5593a7175468 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.155231 Aug 04 23:44:00.845784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1032/2092] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:00 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:01.867114 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e2862716-284b-4595-bca7-b70086458560 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:01.867757 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e2862716-284b-4595-bca7-b70086458560 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:01.874122 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2862716-284b-4595-bca7-b70086458560 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:01.874623 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2862716-284b-4595-bca7-b70086458560 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:01.875053 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2862716-284b-4595-bca7-b70086458560 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:01.875726 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2862716-284b-4595-bca7-b70086458560 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:01.876173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2862716-284b-4595-bca7-b70086458560 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:01.876589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2862716-284b-4595-bca7-b70086458560 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:02.014912 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e2862716-284b-4595-bca7-b70086458560 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:02.023112 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e2862716-284b-4595-bca7-b70086458560 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.160639 Aug 04 23:44:02.023665 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1061/2093] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:01 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:03.045188 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9931b5c6-8bde-48a4-b89b-6791c1783370 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:03.045826 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9931b5c6-8bde-48a4-b89b-6791c1783370 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:03.052331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9931b5c6-8bde-48a4-b89b-6791c1783370 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:03.053114 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9931b5c6-8bde-48a4-b89b-6791c1783370 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:03.053645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9931b5c6-8bde-48a4-b89b-6791c1783370 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:03.054343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9931b5c6-8bde-48a4-b89b-6791c1783370 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:03.054823 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9931b5c6-8bde-48a4-b89b-6791c1783370 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:03.055244 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9931b5c6-8bde-48a4-b89b-6791c1783370 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:03.184298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9931b5c6-8bde-48a4-b89b-6791c1783370 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:03.192262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9931b5c6-8bde-48a4-b89b-6791c1783370 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.151237 Aug 04 23:44:03.192821 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1033/2094] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:03 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:04.215156 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ba01ee44-186e-45df-b4cf-b5d205019592 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:04.215750 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ba01ee44-186e-45df-b4cf-b5d205019592 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:04.222390 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba01ee44-186e-45df-b4cf-b5d205019592 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:04.222873 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba01ee44-186e-45df-b4cf-b5d205019592 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:04.223308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba01ee44-186e-45df-b4cf-b5d205019592 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:04.223991 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba01ee44-186e-45df-b4cf-b5d205019592 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:04.224441 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba01ee44-186e-45df-b4cf-b5d205019592 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:04.225745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ba01ee44-186e-45df-b4cf-b5d205019592 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:04.356634 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ba01ee44-186e-45df-b4cf-b5d205019592 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:04.364621 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ba01ee44-186e-45df-b4cf-b5d205019592 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.153729 Aug 04 23:44:04.365218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1062/2095] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:04 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:05.386075 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-39de88e3-e871-4569-a3f8-a1ab934d225e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:05.386897 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-39de88e3-e871-4569-a3f8-a1ab934d225e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:05.394095 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39de88e3-e871-4569-a3f8-a1ab934d225e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:05.394687 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39de88e3-e871-4569-a3f8-a1ab934d225e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:05.395183 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39de88e3-e871-4569-a3f8-a1ab934d225e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:05.395988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39de88e3-e871-4569-a3f8-a1ab934d225e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:05.396663 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39de88e3-e871-4569-a3f8-a1ab934d225e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:05.397237 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39de88e3-e871-4569-a3f8-a1ab934d225e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:05.532705 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-39de88e3-e871-4569-a3f8-a1ab934d225e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:05.541965 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-39de88e3-e871-4569-a3f8-a1ab934d225e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.160582 Aug 04 23:44:05.542547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1034/2096] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:05 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:06.563366 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8ebcc91c-10d8-424a-ae17-234631160656 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:06.563977 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8ebcc91c-10d8-424a-ae17-234631160656 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:06.570986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8ebcc91c-10d8-424a-ae17-234631160656 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:06.571464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8ebcc91c-10d8-424a-ae17-234631160656 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:06.571896 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8ebcc91c-10d8-424a-ae17-234631160656 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:06.572582 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8ebcc91c-10d8-424a-ae17-234631160656 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:06.573029 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8ebcc91c-10d8-424a-ae17-234631160656 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:06.573451 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8ebcc91c-10d8-424a-ae17-234631160656 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:06.708516 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8ebcc91c-10d8-424a-ae17-234631160656 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:06.717700 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8ebcc91c-10d8-424a-ae17-234631160656 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.158066 Aug 04 23:44:06.718283 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1063/2097] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:06 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:07.739889 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b658c101-f3c8-4d04-9c76-4eb05a5e5733 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:07.740517 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b658c101-f3c8-4d04-9c76-4eb05a5e5733 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:07.747681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b658c101-f3c8-4d04-9c76-4eb05a5e5733 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:07.748263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b658c101-f3c8-4d04-9c76-4eb05a5e5733 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:07.748588 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b658c101-f3c8-4d04-9c76-4eb05a5e5733 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:07.749283 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b658c101-f3c8-4d04-9c76-4eb05a5e5733 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:07.749727 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b658c101-f3c8-4d04-9c76-4eb05a5e5733 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:07.750145 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b658c101-f3c8-4d04-9c76-4eb05a5e5733 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:07.887668 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b658c101-f3c8-4d04-9c76-4eb05a5e5733 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:07.895717 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b658c101-f3c8-4d04-9c76-4eb05a5e5733 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.159637 Aug 04 23:44:07.896274 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1035/2098] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:07 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:44:08.918075 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-571733ab-a8f4-4780-a4df-3c434becdfbd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:08.918726 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-571733ab-a8f4-4780-a4df-3c434becdfbd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:08.925371 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-571733ab-a8f4-4780-a4df-3c434becdfbd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:08.925975 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-571733ab-a8f4-4780-a4df-3c434becdfbd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:08.926308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-571733ab-a8f4-4780-a4df-3c434becdfbd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:08.927013 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-571733ab-a8f4-4780-a4df-3c434becdfbd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:08.927455 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-571733ab-a8f4-4780-a4df-3c434becdfbd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:08.928009 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-571733ab-a8f4-4780-a4df-3c434becdfbd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:09.062771 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-571733ab-a8f4-4780-a4df-3c434becdfbd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:09.070831 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-571733ab-a8f4-4780-a4df-3c434becdfbd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.157651 Aug 04 23:44:09.071461 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1064/2099] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:08 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:10.094744 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8e84acd4-e5a8-4160-9279-77c7048e4873 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:10.095543 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8e84acd4-e5a8-4160-9279-77c7048e4873 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:10.103245 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e84acd4-e5a8-4160-9279-77c7048e4873 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:10.103718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e84acd4-e5a8-4160-9279-77c7048e4873 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:10.104143 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e84acd4-e5a8-4160-9279-77c7048e4873 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:10.104839 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e84acd4-e5a8-4160-9279-77c7048e4873 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:10.105283 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e84acd4-e5a8-4160-9279-77c7048e4873 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:10.105700 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8e84acd4-e5a8-4160-9279-77c7048e4873 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:10.239671 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8e84acd4-e5a8-4160-9279-77c7048e4873 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:10.248399 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8e84acd4-e5a8-4160-9279-77c7048e4873 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.160392 Aug 04 23:44:10.248969 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1036/2100] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:10 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:11.271632 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7ee9e000-a823-4da0-a5af-7d8ed6be496e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:11.272256 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7ee9e000-a823-4da0-a5af-7d8ed6be496e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:11.279042 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ee9e000-a823-4da0-a5af-7d8ed6be496e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:11.279524 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ee9e000-a823-4da0-a5af-7d8ed6be496e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:11.279961 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ee9e000-a823-4da0-a5af-7d8ed6be496e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:11.280654 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ee9e000-a823-4da0-a5af-7d8ed6be496e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:11.281119 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ee9e000-a823-4da0-a5af-7d8ed6be496e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:11.281539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ee9e000-a823-4da0-a5af-7d8ed6be496e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:11.417655 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7ee9e000-a823-4da0-a5af-7d8ed6be496e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:11.425647 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7ee9e000-a823-4da0-a5af-7d8ed6be496e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.158509 Aug 04 23:44:11.426207 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1065/2101] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:11 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:12.448039 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-629c9744-2a9d-4d22-809b-69a525a51c7c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:12.448631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-629c9744-2a9d-4d22-809b-69a525a51c7c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:12.455160 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-629c9744-2a9d-4d22-809b-69a525a51c7c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:12.455636 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-629c9744-2a9d-4d22-809b-69a525a51c7c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:12.456065 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-629c9744-2a9d-4d22-809b-69a525a51c7c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:12.456757 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-629c9744-2a9d-4d22-809b-69a525a51c7c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:12.457204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-629c9744-2a9d-4d22-809b-69a525a51c7c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:12.457639 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-629c9744-2a9d-4d22-809b-69a525a51c7c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:12.588881 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-629c9744-2a9d-4d22-809b-69a525a51c7c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:12.596806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-629c9744-2a9d-4d22-809b-69a525a51c7c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.152800 Aug 04 23:44:12.597356 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1037/2102] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:12 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:13.619037 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-88a3a80e-21da-40ad-bff1-d8303496b0c4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:13.619662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-88a3a80e-21da-40ad-bff1-d8303496b0c4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:13.626114 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-88a3a80e-21da-40ad-bff1-d8303496b0c4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:13.626673 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-88a3a80e-21da-40ad-bff1-d8303496b0c4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:13.627141 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-88a3a80e-21da-40ad-bff1-d8303496b0c4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:13.627796 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-88a3a80e-21da-40ad-bff1-d8303496b0c4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:13.628249 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-88a3a80e-21da-40ad-bff1-d8303496b0c4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:13.628674 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-88a3a80e-21da-40ad-bff1-d8303496b0c4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:13.781096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-88a3a80e-21da-40ad-bff1-d8303496b0c4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:13.789492 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-88a3a80e-21da-40ad-bff1-d8303496b0c4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.174586 Aug 04 23:44:13.790067 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1066/2103] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:13 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:14.814030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b7340674-7940-44a5-97bc-08d1cc6b9979 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:14.814692 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b7340674-7940-44a5-97bc-08d1cc6b9979 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:14.821863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b7340674-7940-44a5-97bc-08d1cc6b9979 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:14.822354 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b7340674-7940-44a5-97bc-08d1cc6b9979 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:14.822886 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b7340674-7940-44a5-97bc-08d1cc6b9979 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:14.823601 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b7340674-7940-44a5-97bc-08d1cc6b9979 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:14.824049 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b7340674-7940-44a5-97bc-08d1cc6b9979 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:14.824469 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b7340674-7940-44a5-97bc-08d1cc6b9979 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:14.965669 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b7340674-7940-44a5-97bc-08d1cc6b9979 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:14.974538 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b7340674-7940-44a5-97bc-08d1cc6b9979 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.164874 Aug 04 23:44:14.975692 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1038/2104] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:14 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:15.997020 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9b6f7721-1164-40de-9536-ea26bf51c45a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:15.997631 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9b6f7721-1164-40de-9536-ea26bf51c45a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:16.004428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9b6f7721-1164-40de-9536-ea26bf51c45a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:16.004890 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9b6f7721-1164-40de-9536-ea26bf51c45a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:16.005324 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9b6f7721-1164-40de-9536-ea26bf51c45a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:16.006016 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9b6f7721-1164-40de-9536-ea26bf51c45a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:16.006587 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9b6f7721-1164-40de-9536-ea26bf51c45a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:16.007068 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9b6f7721-1164-40de-9536-ea26bf51c45a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:16.156101 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9b6f7721-1164-40de-9536-ea26bf51c45a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:16.167199 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9b6f7721-1164-40de-9536-ea26bf51c45a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.174367 Aug 04 23:44:16.167778 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1067/2105] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:15 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:17.188749 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-95d58f4d-bd10-4c8a-bdc4-2ec91cca5435 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:17.189361 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-95d58f4d-bd10-4c8a-bdc4-2ec91cca5435 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:17.196039 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95d58f4d-bd10-4c8a-bdc4-2ec91cca5435 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:17.196524 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95d58f4d-bd10-4c8a-bdc4-2ec91cca5435 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:17.196957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95d58f4d-bd10-4c8a-bdc4-2ec91cca5435 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:17.197656 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95d58f4d-bd10-4c8a-bdc4-2ec91cca5435 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:17.198105 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95d58f4d-bd10-4c8a-bdc4-2ec91cca5435 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:17.199737 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-95d58f4d-bd10-4c8a-bdc4-2ec91cca5435 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:17.334010 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-95d58f4d-bd10-4c8a-bdc4-2ec91cca5435 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:17.342135 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-95d58f4d-bd10-4c8a-bdc4-2ec91cca5435 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.157209 Aug 04 23:44:17.342729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1039/2106] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:17 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:18.488218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-de7ccbc9-c13f-4b3d-aa52-b6c9543c3ca9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:18.488824 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-de7ccbc9-c13f-4b3d-aa52-b6c9543c3ca9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:18.495417 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de7ccbc9-c13f-4b3d-aa52-b6c9543c3ca9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:18.495884 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de7ccbc9-c13f-4b3d-aa52-b6c9543c3ca9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:18.496310 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de7ccbc9-c13f-4b3d-aa52-b6c9543c3ca9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:18.496977 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de7ccbc9-c13f-4b3d-aa52-b6c9543c3ca9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:18.497418 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de7ccbc9-c13f-4b3d-aa52-b6c9543c3ca9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:18.497830 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-de7ccbc9-c13f-4b3d-aa52-b6c9543c3ca9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:18.626975 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-de7ccbc9-c13f-4b3d-aa52-b6c9543c3ca9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:18.635935 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-de7ccbc9-c13f-4b3d-aa52-b6c9543c3ca9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.275484 Aug 04 23:44:18.636506 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1068/2107] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:18 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:19.657693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d3d618ea-6c53-44da-9d93-783941682399 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:19.658312 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d3d618ea-6c53-44da-9d93-783941682399 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:19.660609 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=26 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:44:19.667179 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d3d618ea-6c53-44da-9d93-783941682399 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:19.667656 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d3d618ea-6c53-44da-9d93-783941682399 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:19.668085 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d3d618ea-6c53-44da-9d93-783941682399 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:19.668775 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d3d618ea-6c53-44da-9d93-783941682399 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:19.669219 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d3d618ea-6c53-44da-9d93-783941682399 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:19.669637 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d3d618ea-6c53-44da-9d93-783941682399 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:19.672401 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=78 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:44:19.805320 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d3d618ea-6c53-44da-9d93-783941682399 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:19.813609 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d3d618ea-6c53-44da-9d93-783941682399 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.159697 Aug 04 23:44:19.814180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1040/2108] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:19 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:20.837029 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2952f572-ca6a-4336-9c0d-47d9aa2868b1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:20.837663 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2952f572-ca6a-4336-9c0d-47d9aa2868b1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:20.839966 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=26 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:44:20.845359 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2952f572-ca6a-4336-9c0d-47d9aa2868b1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:20.845838 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2952f572-ca6a-4336-9c0d-47d9aa2868b1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:20.846273 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2952f572-ca6a-4336-9c0d-47d9aa2868b1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:20.846999 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2952f572-ca6a-4336-9c0d-47d9aa2868b1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:20.847439 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2952f572-ca6a-4336-9c0d-47d9aa2868b1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:20.847862 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2952f572-ca6a-4336-9c0d-47d9aa2868b1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:20.851103 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=78 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:44:20.986866 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2952f572-ca6a-4336-9c0d-47d9aa2868b1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:20.995443 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2952f572-ca6a-4336-9c0d-47d9aa2868b1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.164122 Aug 04 23:44:20.995999 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1069/2109] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:20 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:22.017311 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1ff8cc25-2efe-41e8-ad6f-6087a714ee01 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:22.017894 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1ff8cc25-2efe-41e8-ad6f-6087a714ee01 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:22.024536 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ff8cc25-2efe-41e8-ad6f-6087a714ee01 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:22.025013 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ff8cc25-2efe-41e8-ad6f-6087a714ee01 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:22.025442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ff8cc25-2efe-41e8-ad6f-6087a714ee01 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:22.026131 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ff8cc25-2efe-41e8-ad6f-6087a714ee01 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:22.026618 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ff8cc25-2efe-41e8-ad6f-6087a714ee01 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:22.027037 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ff8cc25-2efe-41e8-ad6f-6087a714ee01 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:22.172440 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1ff8cc25-2efe-41e8-ad6f-6087a714ee01 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:22.181601 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1ff8cc25-2efe-41e8-ad6f-6087a714ee01 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.168119 Aug 04 23:44:22.182168 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1041/2110] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:22 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:23.204035 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-634da056-e4d3-4eee-ae35-71a20e07036a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:23.204729 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-634da056-e4d3-4eee-ae35-71a20e07036a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:23.213133 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-634da056-e4d3-4eee-ae35-71a20e07036a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:23.213371 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-634da056-e4d3-4eee-ae35-71a20e07036a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:23.213734 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-634da056-e4d3-4eee-ae35-71a20e07036a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:23.214490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-634da056-e4d3-4eee-ae35-71a20e07036a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:23.214946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-634da056-e4d3-4eee-ae35-71a20e07036a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:23.215361 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-634da056-e4d3-4eee-ae35-71a20e07036a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:23.526551 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-634da056-e4d3-4eee-ae35-71a20e07036a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:23.535845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-634da056-e4d3-4eee-ae35-71a20e07036a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.336088 Aug 04 23:44:23.536409 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1070/2111] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:23 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:24.558912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-cea51744-8a76-4db1-a6ac-cb05b4a65701 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:24.559540 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-cea51744-8a76-4db1-a6ac-cb05b4a65701 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:24.565499 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cea51744-8a76-4db1-a6ac-cb05b4a65701 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:24.565976 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cea51744-8a76-4db1-a6ac-cb05b4a65701 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:24.566422 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cea51744-8a76-4db1-a6ac-cb05b4a65701 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:24.567107 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cea51744-8a76-4db1-a6ac-cb05b4a65701 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:24.567553 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cea51744-8a76-4db1-a6ac-cb05b4a65701 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:24.567979 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cea51744-8a76-4db1-a6ac-cb05b4a65701 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:24.698746 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cea51744-8a76-4db1-a6ac-cb05b4a65701 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:24.706699 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-cea51744-8a76-4db1-a6ac-cb05b4a65701 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.151783 Aug 04 23:44:24.707258 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1042/2112] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:24 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:25.728603 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-39dac8fe-e92a-4782-903f-3504f275aa14 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:25.729742 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-39dac8fe-e92a-4782-903f-3504f275aa14 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:25.735799 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-39dac8fe-e92a-4782-903f-3504f275aa14 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:25.736282 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-39dac8fe-e92a-4782-903f-3504f275aa14 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:25.736718 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-39dac8fe-e92a-4782-903f-3504f275aa14 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:25.737408 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-39dac8fe-e92a-4782-903f-3504f275aa14 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:25.737862 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-39dac8fe-e92a-4782-903f-3504f275aa14 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:25.738293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-39dac8fe-e92a-4782-903f-3504f275aa14 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:25.877678 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-39dac8fe-e92a-4782-903f-3504f275aa14 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:25.885938 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-39dac8fe-e92a-4782-903f-3504f275aa14 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.161541 Aug 04 23:44:25.886510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1071/2113] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:25 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:26.908289 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-bdb22318-e1c1-4895-9b1b-8d8b242fd5cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:26.908896 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-bdb22318-e1c1-4895-9b1b-8d8b242fd5cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:26.916423 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdb22318-e1c1-4895-9b1b-8d8b242fd5cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:26.916898 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdb22318-e1c1-4895-9b1b-8d8b242fd5cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:26.917331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdb22318-e1c1-4895-9b1b-8d8b242fd5cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:26.918018 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdb22318-e1c1-4895-9b1b-8d8b242fd5cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:26.918501 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdb22318-e1c1-4895-9b1b-8d8b242fd5cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:26.918924 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bdb22318-e1c1-4895-9b1b-8d8b242fd5cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:27.052517 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-bdb22318-e1c1-4895-9b1b-8d8b242fd5cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:27.062090 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-bdb22318-e1c1-4895-9b1b-8d8b242fd5cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.157597 Aug 04 23:44:27.062694 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1043/2114] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:26 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:28.082760 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-92fdb0b8-c8f8-487f-8aa1-677c291b7214 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:28.083354 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-92fdb0b8-c8f8-487f-8aa1-677c291b7214 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:28.090070 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92fdb0b8-c8f8-487f-8aa1-677c291b7214 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:28.090521 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92fdb0b8-c8f8-487f-8aa1-677c291b7214 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:28.090955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92fdb0b8-c8f8-487f-8aa1-677c291b7214 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:28.091638 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92fdb0b8-c8f8-487f-8aa1-677c291b7214 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:28.092083 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92fdb0b8-c8f8-487f-8aa1-677c291b7214 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:28.092498 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-92fdb0b8-c8f8-487f-8aa1-677c291b7214 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:28.222470 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-92fdb0b8-c8f8-487f-8aa1-677c291b7214 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:28.230953 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-92fdb0b8-c8f8-487f-8aa1-677c291b7214 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.151989 Aug 04 23:44:28.231553 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1072/2115] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:28 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:29.253073 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-28359a55-fe7e-4a2f-bc8c-2a6d71de6836 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:29.253708 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-28359a55-fe7e-4a2f-bc8c-2a6d71de6836 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:29.260961 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28359a55-fe7e-4a2f-bc8c-2a6d71de6836 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:29.261437 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28359a55-fe7e-4a2f-bc8c-2a6d71de6836 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:29.261864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28359a55-fe7e-4a2f-bc8c-2a6d71de6836 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:29.262576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28359a55-fe7e-4a2f-bc8c-2a6d71de6836 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:29.263020 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28359a55-fe7e-4a2f-bc8c-2a6d71de6836 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:29.263434 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-28359a55-fe7e-4a2f-bc8c-2a6d71de6836 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:29.396097 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-28359a55-fe7e-4a2f-bc8c-2a6d71de6836 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:29.405287 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-28359a55-fe7e-4a2f-bc8c-2a6d71de6836 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.156094 Aug 04 23:44:29.405846 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1044/2116] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:29 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:30.427536 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2c7118cc-4d55-40b6-b9da-fe6dd6cd08af tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:30.428171 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2c7118cc-4d55-40b6-b9da-fe6dd6cd08af tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:30.435606 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c7118cc-4d55-40b6-b9da-fe6dd6cd08af tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:30.436085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c7118cc-4d55-40b6-b9da-fe6dd6cd08af tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:30.436516 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c7118cc-4d55-40b6-b9da-fe6dd6cd08af tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:30.437209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c7118cc-4d55-40b6-b9da-fe6dd6cd08af tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:30.437659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c7118cc-4d55-40b6-b9da-fe6dd6cd08af tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:30.438080 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c7118cc-4d55-40b6-b9da-fe6dd6cd08af tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:30.533429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:44:30.533716 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:44:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 (ip 10.222.0.33) !!! Aug 04 23:44:30.574457 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2c7118cc-4d55-40b6-b9da-fe6dd6cd08af tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:30.582563 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2c7118cc-4d55-40b6-b9da-fe6dd6cd08af tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.159729 Aug 04 23:44:30.583131 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1073/2117] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:30 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:31.604258 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-42d62457-1741-494d-9ee1-9a5fea30f911 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:31.604890 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-42d62457-1741-494d-9ee1-9a5fea30f911 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:31.611338 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-42d62457-1741-494d-9ee1-9a5fea30f911 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:31.611851 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-42d62457-1741-494d-9ee1-9a5fea30f911 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:31.612286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-42d62457-1741-494d-9ee1-9a5fea30f911 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:31.612978 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-42d62457-1741-494d-9ee1-9a5fea30f911 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:31.613428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-42d62457-1741-494d-9ee1-9a5fea30f911 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:31.613851 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-42d62457-1741-494d-9ee1-9a5fea30f911 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:31.753648 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-42d62457-1741-494d-9ee1-9a5fea30f911 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:31.761729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-42d62457-1741-494d-9ee1-9a5fea30f911 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.161952 Aug 04 23:44:31.762299 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1045/2118] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:31 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:32.783566 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-31823cfe-dda2-400a-b4db-a3c424e0accc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:32.784165 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-31823cfe-dda2-400a-b4db-a3c424e0accc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:32.791481 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31823cfe-dda2-400a-b4db-a3c424e0accc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:32.791965 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31823cfe-dda2-400a-b4db-a3c424e0accc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:32.792400 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31823cfe-dda2-400a-b4db-a3c424e0accc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:32.793095 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31823cfe-dda2-400a-b4db-a3c424e0accc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:32.793568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31823cfe-dda2-400a-b4db-a3c424e0accc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:32.793986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31823cfe-dda2-400a-b4db-a3c424e0accc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:32.924654 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-31823cfe-dda2-400a-b4db-a3c424e0accc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:32.933387 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-31823cfe-dda2-400a-b4db-a3c424e0accc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.153706 Aug 04 23:44:32.933950 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1074/2119] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:32 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:33.954525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ca24518f-56a5-4a88-a5a3-a878579017b0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:33.955130 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ca24518f-56a5-4a88-a5a3-a878579017b0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:33.963431 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ca24518f-56a5-4a88-a5a3-a878579017b0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:33.963918 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ca24518f-56a5-4a88-a5a3-a878579017b0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:33.964356 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ca24518f-56a5-4a88-a5a3-a878579017b0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:33.965047 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ca24518f-56a5-4a88-a5a3-a878579017b0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:33.965501 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ca24518f-56a5-4a88-a5a3-a878579017b0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:33.965924 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ca24518f-56a5-4a88-a5a3-a878579017b0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:34.101533 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ca24518f-56a5-4a88-a5a3-a878579017b0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:34.109568 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ca24518f-56a5-4a88-a5a3-a878579017b0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.158952 Aug 04 23:44:34.110144 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1046/2120] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:33 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:35.132491 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f68e5d5b-8490-4bf0-afb9-d5286f0150cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:35.133203 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f68e5d5b-8490-4bf0-afb9-d5286f0150cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:35.139708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f68e5d5b-8490-4bf0-afb9-d5286f0150cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:35.140196 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f68e5d5b-8490-4bf0-afb9-d5286f0150cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:35.140634 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f68e5d5b-8490-4bf0-afb9-d5286f0150cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:35.141337 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f68e5d5b-8490-4bf0-afb9-d5286f0150cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:35.141791 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f68e5d5b-8490-4bf0-afb9-d5286f0150cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:35.142217 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f68e5d5b-8490-4bf0-afb9-d5286f0150cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:35.271871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f68e5d5b-8490-4bf0-afb9-d5286f0150cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:35.280270 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f68e5d5b-8490-4bf0-afb9-d5286f0150cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.151774 Aug 04 23:44:35.280831 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1075/2121] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:35 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:36.302561 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7d1d723f-dfa3-44ae-8357-87ff6dcec3d2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:36.303156 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7d1d723f-dfa3-44ae-8357-87ff6dcec3d2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:36.310003 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7d1d723f-dfa3-44ae-8357-87ff6dcec3d2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:36.310520 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7d1d723f-dfa3-44ae-8357-87ff6dcec3d2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:36.310959 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7d1d723f-dfa3-44ae-8357-87ff6dcec3d2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:36.311655 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7d1d723f-dfa3-44ae-8357-87ff6dcec3d2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:36.312109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7d1d723f-dfa3-44ae-8357-87ff6dcec3d2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:36.312525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7d1d723f-dfa3-44ae-8357-87ff6dcec3d2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:36.448818 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7d1d723f-dfa3-44ae-8357-87ff6dcec3d2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:36.456781 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7d1d723f-dfa3-44ae-8357-87ff6dcec3d2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.158115 Aug 04 23:44:36.457350 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1047/2122] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:36 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:37.478653 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-bd377e14-3600-4977-890a-8d72e5d1f653 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:37.479272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-bd377e14-3600-4977-890a-8d72e5d1f653 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:37.485915 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bd377e14-3600-4977-890a-8d72e5d1f653 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:37.486486 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bd377e14-3600-4977-890a-8d72e5d1f653 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:37.486935 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bd377e14-3600-4977-890a-8d72e5d1f653 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:37.487631 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bd377e14-3600-4977-890a-8d72e5d1f653 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:37.488085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bd377e14-3600-4977-890a-8d72e5d1f653 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:37.488513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bd377e14-3600-4977-890a-8d72e5d1f653 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:37.619358 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-bd377e14-3600-4977-890a-8d72e5d1f653 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:37.627591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-bd377e14-3600-4977-890a-8d72e5d1f653 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.153044 Aug 04 23:44:37.628147 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1076/2123] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:37 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:38.650748 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8057d54d-6fba-402c-b78c-56b2b86f4e82 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:38.651353 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8057d54d-6fba-402c-b78c-56b2b86f4e82 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:38.657682 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8057d54d-6fba-402c-b78c-56b2b86f4e82 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:38.658151 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8057d54d-6fba-402c-b78c-56b2b86f4e82 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:38.658617 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8057d54d-6fba-402c-b78c-56b2b86f4e82 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:38.659303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8057d54d-6fba-402c-b78c-56b2b86f4e82 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:38.659746 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8057d54d-6fba-402c-b78c-56b2b86f4e82 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:38.660160 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8057d54d-6fba-402c-b78c-56b2b86f4e82 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:38.791945 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8057d54d-6fba-402c-b78c-56b2b86f4e82 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:38.799904 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8057d54d-6fba-402c-b78c-56b2b86f4e82 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.153909 Aug 04 23:44:38.800458 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1048/2124] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:38 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:39.821837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5c229a5a-7044-41b3-a2cc-73ab1b6ddabc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:39.822491 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5c229a5a-7044-41b3-a2cc-73ab1b6ddabc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:39.829321 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c229a5a-7044-41b3-a2cc-73ab1b6ddabc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:39.829836 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c229a5a-7044-41b3-a2cc-73ab1b6ddabc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:39.830266 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c229a5a-7044-41b3-a2cc-73ab1b6ddabc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:39.830981 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c229a5a-7044-41b3-a2cc-73ab1b6ddabc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:39.831430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c229a5a-7044-41b3-a2cc-73ab1b6ddabc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:39.831844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5c229a5a-7044-41b3-a2cc-73ab1b6ddabc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:39.966100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5c229a5a-7044-41b3-a2cc-73ab1b6ddabc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:39.974481 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5c229a5a-7044-41b3-a2cc-73ab1b6ddabc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.157057 Aug 04 23:44:39.974927 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1077/2125] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:39 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:40.996674 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6645e124-84ab-407a-bff5-d1256f311ba2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:40.997299 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6645e124-84ab-407a-bff5-d1256f311ba2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:41.003759 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6645e124-84ab-407a-bff5-d1256f311ba2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:41.004659 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6645e124-84ab-407a-bff5-d1256f311ba2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:41.004659 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6645e124-84ab-407a-bff5-d1256f311ba2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:41.005403 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6645e124-84ab-407a-bff5-d1256f311ba2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:41.005755 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6645e124-84ab-407a-bff5-d1256f311ba2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:41.006168 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6645e124-84ab-407a-bff5-d1256f311ba2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:41.140678 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6645e124-84ab-407a-bff5-d1256f311ba2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:41.148883 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6645e124-84ab-407a-bff5-d1256f311ba2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.157042 Aug 04 23:44:41.149448 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1049/2126] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:40 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:42.170632 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0c352180-1f7e-4ce0-b249-3c3e5ad2d83c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:42.171477 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0c352180-1f7e-4ce0-b249-3c3e5ad2d83c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:42.177683 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0c352180-1f7e-4ce0-b249-3c3e5ad2d83c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:42.178166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0c352180-1f7e-4ce0-b249-3c3e5ad2d83c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:42.178619 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0c352180-1f7e-4ce0-b249-3c3e5ad2d83c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:42.179462 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0c352180-1f7e-4ce0-b249-3c3e5ad2d83c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:42.179918 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0c352180-1f7e-4ce0-b249-3c3e5ad2d83c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:42.180348 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0c352180-1f7e-4ce0-b249-3c3e5ad2d83c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:42.317212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0c352180-1f7e-4ce0-b249-3c3e5ad2d83c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:42.325718 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0c352180-1f7e-4ce0-b249-3c3e5ad2d83c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.159148 Aug 04 23:44:42.327183 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1078/2127] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:42 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:43.348418 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e8db8e1f-47a5-4033-bce6-71fe0ad88d05 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:43.349039 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e8db8e1f-47a5-4033-bce6-71fe0ad88d05 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:43.356046 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e8db8e1f-47a5-4033-bce6-71fe0ad88d05 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:43.356521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e8db8e1f-47a5-4033-bce6-71fe0ad88d05 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:43.356953 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e8db8e1f-47a5-4033-bce6-71fe0ad88d05 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:43.357640 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e8db8e1f-47a5-4033-bce6-71fe0ad88d05 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:43.358084 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e8db8e1f-47a5-4033-bce6-71fe0ad88d05 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:43.358545 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e8db8e1f-47a5-4033-bce6-71fe0ad88d05 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:43.445423 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:44:43.445579 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:44:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 (ip 10.222.0.33) !!! Aug 04 23:44:43.487891 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e8db8e1f-47a5-4033-bce6-71fe0ad88d05 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:43.497106 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e8db8e1f-47a5-4033-bce6-71fe0ad88d05 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.152483 Aug 04 23:44:43.497671 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1050/2128] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:43 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:44.518469 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ed3b1c0d-c988-4857-9b94-e6d57442f5af tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:44.519061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ed3b1c0d-c988-4857-9b94-e6d57442f5af tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:44.526641 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed3b1c0d-c988-4857-9b94-e6d57442f5af tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:44.527122 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed3b1c0d-c988-4857-9b94-e6d57442f5af tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:44.527555 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed3b1c0d-c988-4857-9b94-e6d57442f5af tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:44.528249 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed3b1c0d-c988-4857-9b94-e6d57442f5af tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:44.528701 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed3b1c0d-c988-4857-9b94-e6d57442f5af tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:44.529123 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed3b1c0d-c988-4857-9b94-e6d57442f5af tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:44.665412 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ed3b1c0d-c988-4857-9b94-e6d57442f5af tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:44.673268 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ed3b1c0d-c988-4857-9b94-e6d57442f5af tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.158726 Aug 04 23:44:44.673829 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1079/2129] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:44 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:45.693815 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7cb06119-38bc-4308-a889-a2e9064a74a3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:45.694975 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7cb06119-38bc-4308-a889-a2e9064a74a3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:45.701606 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7cb06119-38bc-4308-a889-a2e9064a74a3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:45.702092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7cb06119-38bc-4308-a889-a2e9064a74a3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:45.702567 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7cb06119-38bc-4308-a889-a2e9064a74a3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:45.703262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7cb06119-38bc-4308-a889-a2e9064a74a3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:45.703715 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7cb06119-38bc-4308-a889-a2e9064a74a3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:45.704404 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7cb06119-38bc-4308-a889-a2e9064a74a3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:45.837625 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7cb06119-38bc-4308-a889-a2e9064a74a3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:45.845763 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7cb06119-38bc-4308-a889-a2e9064a74a3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.155786 Aug 04 23:44:45.846327 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1051/2130] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:45 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:46.866971 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1af6a3e5-a4f3-4cbd-897f-9a756b6494cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:46.867549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1af6a3e5-a4f3-4cbd-897f-9a756b6494cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:46.873911 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1af6a3e5-a4f3-4cbd-897f-9a756b6494cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:46.874416 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1af6a3e5-a4f3-4cbd-897f-9a756b6494cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:46.874847 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1af6a3e5-a4f3-4cbd-897f-9a756b6494cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:46.875537 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1af6a3e5-a4f3-4cbd-897f-9a756b6494cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:46.875982 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1af6a3e5-a4f3-4cbd-897f-9a756b6494cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:46.876528 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1af6a3e5-a4f3-4cbd-897f-9a756b6494cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:47.006940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1af6a3e5-a4f3-4cbd-897f-9a756b6494cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:47.016293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1af6a3e5-a4f3-4cbd-897f-9a756b6494cf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.153272 Aug 04 23:44:47.016853 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1080/2131] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:46 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:48.037232 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-67ad2ac6-b773-41ed-a077-e724bc53fb83 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:48.037842 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-67ad2ac6-b773-41ed-a077-e724bc53fb83 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:48.044786 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-67ad2ac6-b773-41ed-a077-e724bc53fb83 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:48.045261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-67ad2ac6-b773-41ed-a077-e724bc53fb83 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:48.045716 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-67ad2ac6-b773-41ed-a077-e724bc53fb83 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:48.046435 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-67ad2ac6-b773-41ed-a077-e724bc53fb83 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:48.046887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-67ad2ac6-b773-41ed-a077-e724bc53fb83 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:48.047307 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-67ad2ac6-b773-41ed-a077-e724bc53fb83 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:48.183461 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-67ad2ac6-b773-41ed-a077-e724bc53fb83 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:48.191344 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-67ad2ac6-b773-41ed-a077-e724bc53fb83 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.157983 Aug 04 23:44:48.191901 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1052/2132] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:48 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:49.213381 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1588bb4a-5bf7-44af-a19d-9686ab70a47e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:49.214034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1588bb4a-5bf7-44af-a19d-9686ab70a47e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:49.221010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1588bb4a-5bf7-44af-a19d-9686ab70a47e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:49.221488 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1588bb4a-5bf7-44af-a19d-9686ab70a47e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:49.221952 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1588bb4a-5bf7-44af-a19d-9686ab70a47e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:49.222709 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1588bb4a-5bf7-44af-a19d-9686ab70a47e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:49.223155 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1588bb4a-5bf7-44af-a19d-9686ab70a47e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:49.223574 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1588bb4a-5bf7-44af-a19d-9686ab70a47e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:49.355054 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1588bb4a-5bf7-44af-a19d-9686ab70a47e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:49.363031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1588bb4a-5bf7-44af-a19d-9686ab70a47e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.153847 Aug 04 23:44:49.363600 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1081/2133] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:49 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:50.386635 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-86a702c5-a7c8-48e0-901c-aa0e9ef47da6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:50.387256 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-86a702c5-a7c8-48e0-901c-aa0e9ef47da6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:50.389501 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=26 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:44:50.394993 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-86a702c5-a7c8-48e0-901c-aa0e9ef47da6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:50.395469 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-86a702c5-a7c8-48e0-901c-aa0e9ef47da6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:50.395894 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-86a702c5-a7c8-48e0-901c-aa0e9ef47da6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:50.396584 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-86a702c5-a7c8-48e0-901c-aa0e9ef47da6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:50.397030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-86a702c5-a7c8-48e0-901c-aa0e9ef47da6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:50.397482 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-86a702c5-a7c8-48e0-901c-aa0e9ef47da6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:50.400313 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=78 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:44:50.541583 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-86a702c5-a7c8-48e0-901c-aa0e9ef47da6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:50.550331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-86a702c5-a7c8-48e0-901c-aa0e9ef47da6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.168234 Aug 04 23:44:50.551115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1053/2134] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:50 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:51.572688 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5d6a270b-e4d3-4a79-8a8d-8d988a78ad3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:51.573296 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5d6a270b-e4d3-4a79-8a8d-8d988a78ad3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:51.575730 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=26 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:44:51.581160 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d6a270b-e4d3-4a79-8a8d-8d988a78ad3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:51.581640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d6a270b-e4d3-4a79-8a8d-8d988a78ad3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:51.582075 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d6a270b-e4d3-4a79-8a8d-8d988a78ad3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:51.582809 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d6a270b-e4d3-4a79-8a8d-8d988a78ad3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:51.583260 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d6a270b-e4d3-4a79-8a8d-8d988a78ad3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:51.583684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d6a270b-e4d3-4a79-8a8d-8d988a78ad3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:51.586402 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=78 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:44:51.717396 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5d6a270b-e4d3-4a79-8a8d-8d988a78ad3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:51.733018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5d6a270b-e4d3-4a79-8a8d-8d988a78ad3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.164759 Aug 04 23:44:51.733608 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1082/2135] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:51 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:52.756214 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-98a0caaa-2f25-4ca3-abfa-376fcfefb34a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:52.757366 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-98a0caaa-2f25-4ca3-abfa-376fcfefb34a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:52.763618 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98a0caaa-2f25-4ca3-abfa-376fcfefb34a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:52.764092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98a0caaa-2f25-4ca3-abfa-376fcfefb34a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:52.764542 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98a0caaa-2f25-4ca3-abfa-376fcfefb34a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:52.765222 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98a0caaa-2f25-4ca3-abfa-376fcfefb34a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:52.765662 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98a0caaa-2f25-4ca3-abfa-376fcfefb34a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:52.766075 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98a0caaa-2f25-4ca3-abfa-376fcfefb34a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:52.898242 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-98a0caaa-2f25-4ca3-abfa-376fcfefb34a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:52.906373 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-98a0caaa-2f25-4ca3-abfa-376fcfefb34a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.154912 Aug 04 23:44:52.906938 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1054/2136] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:52 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:53.928562 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f77566c8-609e-4252-89eb-f82c88efccb8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:53.929238 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f77566c8-609e-4252-89eb-f82c88efccb8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:53.935390 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f77566c8-609e-4252-89eb-f82c88efccb8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:53.935870 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f77566c8-609e-4252-89eb-f82c88efccb8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:53.936304 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f77566c8-609e-4252-89eb-f82c88efccb8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:53.936991 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f77566c8-609e-4252-89eb-f82c88efccb8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:53.937443 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f77566c8-609e-4252-89eb-f82c88efccb8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:53.937872 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f77566c8-609e-4252-89eb-f82c88efccb8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:54.071660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f77566c8-609e-4252-89eb-f82c88efccb8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:54.079791 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f77566c8-609e-4252-89eb-f82c88efccb8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.155123 Aug 04 23:44:54.080348 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1083/2137] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:53 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:55.102528 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1f6e7e7f-96cf-4e4a-971a-05f2f1e70a04 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:55.103120 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1f6e7e7f-96cf-4e4a-971a-05f2f1e70a04 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:55.109610 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f6e7e7f-96cf-4e4a-971a-05f2f1e70a04 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:55.110096 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f6e7e7f-96cf-4e4a-971a-05f2f1e70a04 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:55.110562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f6e7e7f-96cf-4e4a-971a-05f2f1e70a04 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:55.111248 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f6e7e7f-96cf-4e4a-971a-05f2f1e70a04 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:55.111699 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f6e7e7f-96cf-4e4a-971a-05f2f1e70a04 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:55.112126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f6e7e7f-96cf-4e4a-971a-05f2f1e70a04 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:55.240380 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1f6e7e7f-96cf-4e4a-971a-05f2f1e70a04 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:55.248545 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1f6e7e7f-96cf-4e4a-971a-05f2f1e70a04 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.150900 Aug 04 23:44:55.249113 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1055/2138] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:55 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:56.269730 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-72502097-26f1-4bb3-bc46-b5f05c226dc3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:56.270389 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-72502097-26f1-4bb3-bc46-b5f05c226dc3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:56.277026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72502097-26f1-4bb3-bc46-b5f05c226dc3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:56.277504 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72502097-26f1-4bb3-bc46-b5f05c226dc3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:56.277940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72502097-26f1-4bb3-bc46-b5f05c226dc3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:56.278655 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72502097-26f1-4bb3-bc46-b5f05c226dc3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:56.279104 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72502097-26f1-4bb3-bc46-b5f05c226dc3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:56.279525 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72502097-26f1-4bb3-bc46-b5f05c226dc3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:56.418589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-72502097-26f1-4bb3-bc46-b5f05c226dc3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:56.426447 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-72502097-26f1-4bb3-bc46-b5f05c226dc3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.160624 Aug 04 23:44:56.427013 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1084/2139] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:56 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:57.448666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-303e037c-e19f-43b8-b39a-cc4998010534 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:57.449273 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-303e037c-e19f-43b8-b39a-cc4998010534 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:57.456093 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-303e037c-e19f-43b8-b39a-cc4998010534 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:57.456573 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-303e037c-e19f-43b8-b39a-cc4998010534 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:57.457003 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-303e037c-e19f-43b8-b39a-cc4998010534 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:57.457694 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-303e037c-e19f-43b8-b39a-cc4998010534 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:57.458140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-303e037c-e19f-43b8-b39a-cc4998010534 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:57.458593 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-303e037c-e19f-43b8-b39a-cc4998010534 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:57.606217 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-303e037c-e19f-43b8-b39a-cc4998010534 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:57.614306 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-303e037c-e19f-43b8-b39a-cc4998010534 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.170444 Aug 04 23:44:57.614904 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1056/2140] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:57 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:58.635848 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a244e648-d2a3-4d24-811a-e4a237b10005 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:58.636449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a244e648-d2a3-4d24-811a-e4a237b10005 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:58.642979 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a244e648-d2a3-4d24-811a-e4a237b10005 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:58.643453 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a244e648-d2a3-4d24-811a-e4a237b10005 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:58.643882 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a244e648-d2a3-4d24-811a-e4a237b10005 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:58.644572 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a244e648-d2a3-4d24-811a-e4a237b10005 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:58.645014 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a244e648-d2a3-4d24-811a-e4a237b10005 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:58.645425 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a244e648-d2a3-4d24-811a-e4a237b10005 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:58.777827 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a244e648-d2a3-4d24-811a-e4a237b10005 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:58.785764 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a244e648-d2a3-4d24-811a-e4a237b10005 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.153795 Aug 04 23:44:58.786311 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1085/2141] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:58 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:44:59.807719 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-69f6d409-4705-42a7-853a-46130d4bba13 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:44:59.808411 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-69f6d409-4705-42a7-853a-46130d4bba13 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:44:59.814843 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-69f6d409-4705-42a7-853a-46130d4bba13 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:59.815323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-69f6d409-4705-42a7-853a-46130d4bba13 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:59.815751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-69f6d409-4705-42a7-853a-46130d4bba13 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:59.816434 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-69f6d409-4705-42a7-853a-46130d4bba13 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:44:59.816878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-69f6d409-4705-42a7-853a-46130d4bba13 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:44:59.817286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-69f6d409-4705-42a7-853a-46130d4bba13 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:44:59.948189 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-69f6d409-4705-42a7-853a-46130d4bba13 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:44:59.956152 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-69f6d409-4705-42a7-853a-46130d4bba13 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.152885 Aug 04 23:44:59.956717 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1057/2142] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:44:59 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:00.978741 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4ffd1ed7-6aee-471c-a642-28dc739c9bd2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:00.979356 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4ffd1ed7-6aee-471c-a642-28dc739c9bd2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:00.985792 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4ffd1ed7-6aee-471c-a642-28dc739c9bd2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:00.986275 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4ffd1ed7-6aee-471c-a642-28dc739c9bd2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:00.986744 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4ffd1ed7-6aee-471c-a642-28dc739c9bd2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:00.987433 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4ffd1ed7-6aee-471c-a642-28dc739c9bd2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:00.987886 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4ffd1ed7-6aee-471c-a642-28dc739c9bd2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:00.988310 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4ffd1ed7-6aee-471c-a642-28dc739c9bd2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:01.087973 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:45:01.088188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:45:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 (ip 10.222.0.33) !!! Aug 04 23:45:01.120026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4ffd1ed7-6aee-471c-a642-28dc739c9bd2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:01.128072 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4ffd1ed7-6aee-471c-a642-28dc739c9bd2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.153848 Aug 04 23:45:01.128640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1086/2143] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:00 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:02.149252 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-377a816e-da57-4afa-843e-aa5eb4233e30 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:02.149801 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-377a816e-da57-4afa-843e-aa5eb4233e30 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:02.156313 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-377a816e-da57-4afa-843e-aa5eb4233e30 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:02.156789 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-377a816e-da57-4afa-843e-aa5eb4233e30 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:02.157217 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-377a816e-da57-4afa-843e-aa5eb4233e30 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:02.157900 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-377a816e-da57-4afa-843e-aa5eb4233e30 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:02.158353 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-377a816e-da57-4afa-843e-aa5eb4233e30 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:02.158793 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-377a816e-da57-4afa-843e-aa5eb4233e30 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:02.296169 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-377a816e-da57-4afa-843e-aa5eb4233e30 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:02.304217 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-377a816e-da57-4afa-843e-aa5eb4233e30 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.159087 Aug 04 23:45:02.304780 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1058/2144] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:02 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:03.325080 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a035b3fe-42bd-4dac-b2ee-a108d86fd55f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:03.325712 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a035b3fe-42bd-4dac-b2ee-a108d86fd55f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:03.332221 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a035b3fe-42bd-4dac-b2ee-a108d86fd55f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:03.332706 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a035b3fe-42bd-4dac-b2ee-a108d86fd55f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:03.333146 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a035b3fe-42bd-4dac-b2ee-a108d86fd55f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:03.333836 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a035b3fe-42bd-4dac-b2ee-a108d86fd55f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:03.334868 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a035b3fe-42bd-4dac-b2ee-a108d86fd55f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:03.335364 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a035b3fe-42bd-4dac-b2ee-a108d86fd55f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:03.463886 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a035b3fe-42bd-4dac-b2ee-a108d86fd55f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:03.471803 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a035b3fe-42bd-4dac-b2ee-a108d86fd55f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.150617 Aug 04 23:45:03.472368 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1087/2145] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:03 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:04.496495 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f3f3a0bd-d020-4a5a-9ad6-a7c15d432994 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:04.500083 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f3f3a0bd-d020-4a5a-9ad6-a7c15d432994 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:04.508528 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f3f3a0bd-d020-4a5a-9ad6-a7c15d432994 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:04.509058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f3f3a0bd-d020-4a5a-9ad6-a7c15d432994 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:04.509487 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f3f3a0bd-d020-4a5a-9ad6-a7c15d432994 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:04.510302 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f3f3a0bd-d020-4a5a-9ad6-a7c15d432994 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:04.510657 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f3f3a0bd-d020-4a5a-9ad6-a7c15d432994 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:04.511082 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f3f3a0bd-d020-4a5a-9ad6-a7c15d432994 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:04.650942 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f3f3a0bd-d020-4a5a-9ad6-a7c15d432994 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:04.658817 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f3f3a0bd-d020-4a5a-9ad6-a7c15d432994 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.168580 Aug 04 23:45:04.659379 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1059/2146] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:04 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:05.681074 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-cf848cee-a664-4108-91a1-6537f020d7a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:05.681738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-cf848cee-a664-4108-91a1-6537f020d7a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:05.688102 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf848cee-a664-4108-91a1-6537f020d7a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:05.688571 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf848cee-a664-4108-91a1-6537f020d7a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:05.689001 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf848cee-a664-4108-91a1-6537f020d7a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:05.689679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf848cee-a664-4108-91a1-6537f020d7a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:05.690121 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf848cee-a664-4108-91a1-6537f020d7a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:05.690575 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf848cee-a664-4108-91a1-6537f020d7a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:05.822748 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-cf848cee-a664-4108-91a1-6537f020d7a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:05.830868 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-cf848cee-a664-4108-91a1-6537f020d7a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.154048 Aug 04 23:45:05.831440 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1088/2147] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:05 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:06.852221 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1766e0c3-4418-4868-910e-20844dce3881 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:06.852816 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1766e0c3-4418-4868-910e-20844dce3881 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:06.859270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1766e0c3-4418-4868-910e-20844dce3881 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:06.859752 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1766e0c3-4418-4868-910e-20844dce3881 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:06.860186 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1766e0c3-4418-4868-910e-20844dce3881 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:06.860873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1766e0c3-4418-4868-910e-20844dce3881 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:06.861326 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1766e0c3-4418-4868-910e-20844dce3881 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:06.861745 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1766e0c3-4418-4868-910e-20844dce3881 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:06.992585 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1766e0c3-4418-4868-910e-20844dce3881 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:07.000753 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1766e0c3-4418-4868-910e-20844dce3881 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.152416 Aug 04 23:45:07.001321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1060/2148] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:06 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:08.022304 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-53387379-cdd5-4482-821a-80469b83677a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:08.023410 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-53387379-cdd5-4482-821a-80469b83677a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:08.029329 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53387379-cdd5-4482-821a-80469b83677a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:08.029814 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53387379-cdd5-4482-821a-80469b83677a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:08.030258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53387379-cdd5-4482-821a-80469b83677a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:08.030989 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53387379-cdd5-4482-821a-80469b83677a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:08.031513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53387379-cdd5-4482-821a-80469b83677a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:08.031970 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-53387379-cdd5-4482-821a-80469b83677a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:08.167703 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-53387379-cdd5-4482-821a-80469b83677a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:08.175713 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-53387379-cdd5-4482-821a-80469b83677a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.157273 Aug 04 23:45:08.176277 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1089/2149] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:08 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:09.197621 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7419e62d-05f8-4fa6-9e21-cbc871eed628 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:09.198223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7419e62d-05f8-4fa6-9e21-cbc871eed628 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:09.205254 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7419e62d-05f8-4fa6-9e21-cbc871eed628 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:09.205731 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7419e62d-05f8-4fa6-9e21-cbc871eed628 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:09.206162 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7419e62d-05f8-4fa6-9e21-cbc871eed628 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:09.206890 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7419e62d-05f8-4fa6-9e21-cbc871eed628 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:09.207337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7419e62d-05f8-4fa6-9e21-cbc871eed628 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:09.207751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7419e62d-05f8-4fa6-9e21-cbc871eed628 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:09.337983 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7419e62d-05f8-4fa6-9e21-cbc871eed628 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:09.345862 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7419e62d-05f8-4fa6-9e21-cbc871eed628 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.152187 Aug 04 23:45:09.346509 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1061/2150] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:09 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:45:10.368469 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-72ad911b-3fe7-42ab-b5ec-74e1eee52df0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:10.369079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-72ad911b-3fe7-42ab-b5ec-74e1eee52df0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:10.375529 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72ad911b-3fe7-42ab-b5ec-74e1eee52df0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:10.376013 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72ad911b-3fe7-42ab-b5ec-74e1eee52df0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:10.376452 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72ad911b-3fe7-42ab-b5ec-74e1eee52df0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:10.377142 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72ad911b-3fe7-42ab-b5ec-74e1eee52df0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:10.377593 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72ad911b-3fe7-42ab-b5ec-74e1eee52df0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:10.378016 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72ad911b-3fe7-42ab-b5ec-74e1eee52df0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:10.512734 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-72ad911b-3fe7-42ab-b5ec-74e1eee52df0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:10.520733 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-72ad911b-3fe7-42ab-b5ec-74e1eee52df0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.156768 Aug 04 23:45:10.521301 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1090/2151] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:10 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:11.542268 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-10e4f1e1-5e9f-4451-9192-812285bb36b7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:11.542887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-10e4f1e1-5e9f-4451-9192-812285bb36b7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:11.550088 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-10e4f1e1-5e9f-4451-9192-812285bb36b7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:11.551230 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-10e4f1e1-5e9f-4451-9192-812285bb36b7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:11.551703 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-10e4f1e1-5e9f-4451-9192-812285bb36b7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:11.552399 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-10e4f1e1-5e9f-4451-9192-812285bb36b7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:11.552852 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-10e4f1e1-5e9f-4451-9192-812285bb36b7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:11.553278 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-10e4f1e1-5e9f-4451-9192-812285bb36b7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:11.687034 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-10e4f1e1-5e9f-4451-9192-812285bb36b7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:11.695075 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-10e4f1e1-5e9f-4451-9192-812285bb36b7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.156733 Aug 04 23:45:11.695666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1062/2152] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:11 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:12.716679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-20aaab62-68f0-497b-ba17-3d845fd40955 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:12.717291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-20aaab62-68f0-497b-ba17-3d845fd40955 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:12.723873 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-20aaab62-68f0-497b-ba17-3d845fd40955 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:12.724354 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-20aaab62-68f0-497b-ba17-3d845fd40955 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:12.724791 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-20aaab62-68f0-497b-ba17-3d845fd40955 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:12.725488 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-20aaab62-68f0-497b-ba17-3d845fd40955 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:12.726048 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-20aaab62-68f0-497b-ba17-3d845fd40955 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:12.726517 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-20aaab62-68f0-497b-ba17-3d845fd40955 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:12.864631 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-20aaab62-68f0-497b-ba17-3d845fd40955 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:12.872546 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-20aaab62-68f0-497b-ba17-3d845fd40955 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.159804 Aug 04 23:45:12.873111 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1091/2153] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:12 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:13.893888 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ba23f151-8fa5-45cf-968f-973847f6e47d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:13.894560 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ba23f151-8fa5-45cf-968f-973847f6e47d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:13.900992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba23f151-8fa5-45cf-968f-973847f6e47d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:13.901463 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba23f151-8fa5-45cf-968f-973847f6e47d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:13.901885 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba23f151-8fa5-45cf-968f-973847f6e47d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:13.902597 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba23f151-8fa5-45cf-968f-973847f6e47d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:13.903043 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba23f151-8fa5-45cf-968f-973847f6e47d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:13.903460 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ba23f151-8fa5-45cf-968f-973847f6e47d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:14.032427 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ba23f151-8fa5-45cf-968f-973847f6e47d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:14.041176 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ba23f151-8fa5-45cf-968f-973847f6e47d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.151153 Aug 04 23:45:14.041733 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1063/2154] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:13 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:15.063356 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-12e5c784-a10d-4ce9-b747-079bab1cd00e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:15.063981 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-12e5c784-a10d-4ce9-b747-079bab1cd00e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:15.071059 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-12e5c784-a10d-4ce9-b747-079bab1cd00e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:15.071545 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-12e5c784-a10d-4ce9-b747-079bab1cd00e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:15.071985 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-12e5c784-a10d-4ce9-b747-079bab1cd00e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:15.072684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-12e5c784-a10d-4ce9-b747-079bab1cd00e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:15.073137 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-12e5c784-a10d-4ce9-b747-079bab1cd00e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:15.073586 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-12e5c784-a10d-4ce9-b747-079bab1cd00e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:15.205739 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-12e5c784-a10d-4ce9-b747-079bab1cd00e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:15.214175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-12e5c784-a10d-4ce9-b747-079bab1cd00e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.154698 Aug 04 23:45:15.214762 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1092/2155] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:15 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:16.236975 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-759c6b2f-f0ce-4537-bc3d-8549bda80470 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:16.237847 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-759c6b2f-f0ce-4537-bc3d-8549bda80470 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:16.245768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-759c6b2f-f0ce-4537-bc3d-8549bda80470 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:16.246188 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-759c6b2f-f0ce-4537-bc3d-8549bda80470 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:16.246660 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-759c6b2f-f0ce-4537-bc3d-8549bda80470 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:16.247352 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-759c6b2f-f0ce-4537-bc3d-8549bda80470 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:16.247804 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-759c6b2f-f0ce-4537-bc3d-8549bda80470 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:16.248228 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-759c6b2f-f0ce-4537-bc3d-8549bda80470 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:16.390190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-759c6b2f-f0ce-4537-bc3d-8549bda80470 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:16.398910 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-759c6b2f-f0ce-4537-bc3d-8549bda80470 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.165820 Aug 04 23:45:16.399471 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1064/2156] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:16 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:45:17.420500 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4c1ffa47-78cd-44f4-abf1-c8a8cba8dc40 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:17.421109 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4c1ffa47-78cd-44f4-abf1-c8a8cba8dc40 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:17.427688 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c1ffa47-78cd-44f4-abf1-c8a8cba8dc40 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:17.428165 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c1ffa47-78cd-44f4-abf1-c8a8cba8dc40 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:17.428652 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c1ffa47-78cd-44f4-abf1-c8a8cba8dc40 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:17.429409 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c1ffa47-78cd-44f4-abf1-c8a8cba8dc40 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:17.429856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c1ffa47-78cd-44f4-abf1-c8a8cba8dc40 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:17.430277 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c1ffa47-78cd-44f4-abf1-c8a8cba8dc40 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:17.558815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4c1ffa47-78cd-44f4-abf1-c8a8cba8dc40 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:17.566724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4c1ffa47-78cd-44f4-abf1-c8a8cba8dc40 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.150140 Aug 04 23:45:17.567290 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1093/2157] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:17 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:18.588396 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-bf55b63a-07b1-477f-9c05-a3b3687a5a6b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:18.589016 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-bf55b63a-07b1-477f-9c05-a3b3687a5a6b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:18.596307 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bf55b63a-07b1-477f-9c05-a3b3687a5a6b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:18.596777 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bf55b63a-07b1-477f-9c05-a3b3687a5a6b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:18.597206 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bf55b63a-07b1-477f-9c05-a3b3687a5a6b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:18.597889 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bf55b63a-07b1-477f-9c05-a3b3687a5a6b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:18.598342 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bf55b63a-07b1-477f-9c05-a3b3687a5a6b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:18.598777 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bf55b63a-07b1-477f-9c05-a3b3687a5a6b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:18.737609 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-bf55b63a-07b1-477f-9c05-a3b3687a5a6b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:18.746008 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-bf55b63a-07b1-477f-9c05-a3b3687a5a6b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.162206 Aug 04 23:45:18.746642 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1065/2158] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:18 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:19.767833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b5d7c9f4-7cd7-4229-96ac-7d87a5d42565 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:19.768443 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b5d7c9f4-7cd7-4229-96ac-7d87a5d42565 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:19.775428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5d7c9f4-7cd7-4229-96ac-7d87a5d42565 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:19.775906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5d7c9f4-7cd7-4229-96ac-7d87a5d42565 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:19.776342 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5d7c9f4-7cd7-4229-96ac-7d87a5d42565 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:19.777031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5d7c9f4-7cd7-4229-96ac-7d87a5d42565 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:19.777531 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5d7c9f4-7cd7-4229-96ac-7d87a5d42565 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:19.777905 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b5d7c9f4-7cd7-4229-96ac-7d87a5d42565 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:19.907982 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b5d7c9f4-7cd7-4229-96ac-7d87a5d42565 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:19.916877 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b5d7c9f4-7cd7-4229-96ac-7d87a5d42565 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.152913 Aug 04 23:45:19.917443 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1094/2159] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:19 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:20.937298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-24932b6e-bf83-4afe-b3ca-fac12bec5658 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:20.937920 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-24932b6e-bf83-4afe-b3ca-fac12bec5658 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:20.940237 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=26 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:45:20.946285 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24932b6e-bf83-4afe-b3ca-fac12bec5658 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:20.946798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24932b6e-bf83-4afe-b3ca-fac12bec5658 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:20.947231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24932b6e-bf83-4afe-b3ca-fac12bec5658 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:20.947924 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24932b6e-bf83-4afe-b3ca-fac12bec5658 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:20.948379 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24932b6e-bf83-4afe-b3ca-fac12bec5658 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:20.948799 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24932b6e-bf83-4afe-b3ca-fac12bec5658 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:20.951600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=78 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:45:21.081046 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-24932b6e-bf83-4afe-b3ca-fac12bec5658 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:21.090042 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-24932b6e-bf83-4afe-b3ca-fac12bec5658 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.156531 Aug 04 23:45:21.090559 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1066/2160] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:20 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:22.111149 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-577bb93c-854b-48f3-9d8c-e1bf7bd2b875 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:22.111794 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-577bb93c-854b-48f3-9d8c-e1bf7bd2b875 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:22.114074 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=26 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:45:22.120581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-577bb93c-854b-48f3-9d8c-e1bf7bd2b875 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:22.121056 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-577bb93c-854b-48f3-9d8c-e1bf7bd2b875 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:22.121484 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-577bb93c-854b-48f3-9d8c-e1bf7bd2b875 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:22.122169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-577bb93c-854b-48f3-9d8c-e1bf7bd2b875 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:22.122635 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-577bb93c-854b-48f3-9d8c-e1bf7bd2b875 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:22.123053 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-577bb93c-854b-48f3-9d8c-e1bf7bd2b875 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:22.125761 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=78 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:45:22.259056 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-577bb93c-854b-48f3-9d8c-e1bf7bd2b875 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:22.266997 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-577bb93c-854b-48f3-9d8c-e1bf7bd2b875 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.159644 Aug 04 23:45:22.267566 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1095/2161] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:22 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:23.288415 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-32f8700a-d92f-418c-964b-0cdb70f9cc62 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:23.289465 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-32f8700a-d92f-418c-964b-0cdb70f9cc62 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:23.295397 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32f8700a-d92f-418c-964b-0cdb70f9cc62 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:23.295865 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32f8700a-d92f-418c-964b-0cdb70f9cc62 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:23.296289 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32f8700a-d92f-418c-964b-0cdb70f9cc62 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:23.296962 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32f8700a-d92f-418c-964b-0cdb70f9cc62 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:23.297404 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32f8700a-d92f-418c-964b-0cdb70f9cc62 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:23.297819 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-32f8700a-d92f-418c-964b-0cdb70f9cc62 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:23.425335 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-32f8700a-d92f-418c-964b-0cdb70f9cc62 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:23.434120 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-32f8700a-d92f-418c-964b-0cdb70f9cc62 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.149974 Aug 04 23:45:23.434720 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1067/2162] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:23 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:24.455657 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1a2db84b-e394-488f-8f99-790b291e2974 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:24.456298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1a2db84b-e394-488f-8f99-790b291e2974 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:24.463490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1a2db84b-e394-488f-8f99-790b291e2974 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:24.463966 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1a2db84b-e394-488f-8f99-790b291e2974 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:24.464397 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1a2db84b-e394-488f-8f99-790b291e2974 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:24.465077 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1a2db84b-e394-488f-8f99-790b291e2974 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:24.465528 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1a2db84b-e394-488f-8f99-790b291e2974 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:24.465949 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1a2db84b-e394-488f-8f99-790b291e2974 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:24.603307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1a2db84b-e394-488f-8f99-790b291e2974 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:24.611229 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1a2db84b-e394-488f-8f99-790b291e2974 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.159394 Aug 04 23:45:24.611794 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1096/2163] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:24 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:25.633450 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b97d296f-dc5d-4046-938f-4fbd9ebbe6a9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:25.634062 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b97d296f-dc5d-4046-938f-4fbd9ebbe6a9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:25.641183 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b97d296f-dc5d-4046-938f-4fbd9ebbe6a9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:25.641894 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b97d296f-dc5d-4046-938f-4fbd9ebbe6a9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:25.642435 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b97d296f-dc5d-4046-938f-4fbd9ebbe6a9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:25.643148 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b97d296f-dc5d-4046-938f-4fbd9ebbe6a9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:25.643724 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b97d296f-dc5d-4046-938f-4fbd9ebbe6a9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:25.644273 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b97d296f-dc5d-4046-938f-4fbd9ebbe6a9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:25.775566 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b97d296f-dc5d-4046-938f-4fbd9ebbe6a9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:25.783515 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b97d296f-dc5d-4046-938f-4fbd9ebbe6a9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.153993 Aug 04 23:45:25.784084 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1068/2164] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:25 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:26.806284 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-56d1a347-c1b7-4b64-86d6-231c9f232632 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:26.806926 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-56d1a347-c1b7-4b64-86d6-231c9f232632 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:26.813463 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-56d1a347-c1b7-4b64-86d6-231c9f232632 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:26.813940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-56d1a347-c1b7-4b64-86d6-231c9f232632 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:26.814384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-56d1a347-c1b7-4b64-86d6-231c9f232632 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:26.815071 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-56d1a347-c1b7-4b64-86d6-231c9f232632 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:26.815512 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-56d1a347-c1b7-4b64-86d6-231c9f232632 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:26.815925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-56d1a347-c1b7-4b64-86d6-231c9f232632 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:26.952931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-56d1a347-c1b7-4b64-86d6-231c9f232632 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:26.961588 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-56d1a347-c1b7-4b64-86d6-231c9f232632 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.159653 Aug 04 23:45:26.962152 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1097/2165] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:26 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:27.983442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ff9ca276-5188-4418-9c31-7a8c7d87f1da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:27.984247 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ff9ca276-5188-4418-9c31-7a8c7d87f1da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:27.990951 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ff9ca276-5188-4418-9c31-7a8c7d87f1da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:27.992012 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ff9ca276-5188-4418-9c31-7a8c7d87f1da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:27.992450 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ff9ca276-5188-4418-9c31-7a8c7d87f1da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:27.993151 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ff9ca276-5188-4418-9c31-7a8c7d87f1da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:27.993600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ff9ca276-5188-4418-9c31-7a8c7d87f1da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:27.994027 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ff9ca276-5188-4418-9c31-7a8c7d87f1da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:28.123945 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ff9ca276-5188-4418-9c31-7a8c7d87f1da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:28.131948 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ff9ca276-5188-4418-9c31-7a8c7d87f1da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.152527 Aug 04 23:45:28.133874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1069/2166] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:27 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:29.154410 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7e441d6a-1e01-4ce9-aca5-bd050eeb5160 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:29.155027 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7e441d6a-1e01-4ce9-aca5-bd050eeb5160 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:29.161505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7e441d6a-1e01-4ce9-aca5-bd050eeb5160 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:29.161984 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7e441d6a-1e01-4ce9-aca5-bd050eeb5160 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:29.162708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7e441d6a-1e01-4ce9-aca5-bd050eeb5160 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:29.163396 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7e441d6a-1e01-4ce9-aca5-bd050eeb5160 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:29.163845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7e441d6a-1e01-4ce9-aca5-bd050eeb5160 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:29.164790 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7e441d6a-1e01-4ce9-aca5-bd050eeb5160 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:29.295022 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7e441d6a-1e01-4ce9-aca5-bd050eeb5160 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:29.302914 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7e441d6a-1e01-4ce9-aca5-bd050eeb5160 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.152396 Aug 04 23:45:29.303465 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1098/2167] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:29 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:30.325462 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-248cb39e-6e5a-49f5-9d7e-a496616dc093 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:30.326122 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-248cb39e-6e5a-49f5-9d7e-a496616dc093 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:30.332885 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-248cb39e-6e5a-49f5-9d7e-a496616dc093 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:30.333357 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-248cb39e-6e5a-49f5-9d7e-a496616dc093 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:30.333782 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-248cb39e-6e5a-49f5-9d7e-a496616dc093 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:30.334489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-248cb39e-6e5a-49f5-9d7e-a496616dc093 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:30.334934 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-248cb39e-6e5a-49f5-9d7e-a496616dc093 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:30.335347 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-248cb39e-6e5a-49f5-9d7e-a496616dc093 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:30.485743 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-248cb39e-6e5a-49f5-9d7e-a496616dc093 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:30.493742 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-248cb39e-6e5a-49f5-9d7e-a496616dc093 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.172346 Aug 04 23:45:30.494337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1070/2168] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:30 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:31.513886 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e96ff02b-c33f-4eb9-8d33-86a55287d3c3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:31.514532 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e96ff02b-c33f-4eb9-8d33-86a55287d3c3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:31.520969 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e96ff02b-c33f-4eb9-8d33-86a55287d3c3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:31.521451 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e96ff02b-c33f-4eb9-8d33-86a55287d3c3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:31.521889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e96ff02b-c33f-4eb9-8d33-86a55287d3c3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:31.522616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e96ff02b-c33f-4eb9-8d33-86a55287d3c3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:31.523071 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e96ff02b-c33f-4eb9-8d33-86a55287d3c3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:31.523603 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e96ff02b-c33f-4eb9-8d33-86a55287d3c3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:31.650943 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e96ff02b-c33f-4eb9-8d33-86a55287d3c3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:31.660083 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e96ff02b-c33f-4eb9-8d33-86a55287d3c3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.150045 Aug 04 23:45:31.660656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1099/2169] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:31 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:32.682104 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fa93cfd9-3c08-49c7-ab92-3d7742a57482 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:32.682775 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-fa93cfd9-3c08-49c7-ab92-3d7742a57482 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:32.689128 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fa93cfd9-3c08-49c7-ab92-3d7742a57482 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:32.689601 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fa93cfd9-3c08-49c7-ab92-3d7742a57482 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:32.690029 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fa93cfd9-3c08-49c7-ab92-3d7742a57482 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:32.690734 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fa93cfd9-3c08-49c7-ab92-3d7742a57482 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:32.691183 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fa93cfd9-3c08-49c7-ab92-3d7742a57482 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:32.691619 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fa93cfd9-3c08-49c7-ab92-3d7742a57482 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:32.825227 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fa93cfd9-3c08-49c7-ab92-3d7742a57482 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:32.833574 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-fa93cfd9-3c08-49c7-ab92-3d7742a57482 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.156075 Aug 04 23:45:32.834183 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1071/2170] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:32 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:33.856063 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8aec609a-bc9b-410f-923e-a5cb22459c4b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:33.856675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8aec609a-bc9b-410f-923e-a5cb22459c4b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:33.863121 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8aec609a-bc9b-410f-923e-a5cb22459c4b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:33.863603 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8aec609a-bc9b-410f-923e-a5cb22459c4b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:33.864035 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8aec609a-bc9b-410f-923e-a5cb22459c4b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:33.864717 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8aec609a-bc9b-410f-923e-a5cb22459c4b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:33.865165 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8aec609a-bc9b-410f-923e-a5cb22459c4b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:33.865585 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8aec609a-bc9b-410f-923e-a5cb22459c4b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:33.994929 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8aec609a-bc9b-410f-923e-a5cb22459c4b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:34.003540 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8aec609a-bc9b-410f-923e-a5cb22459c4b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.151399 Aug 04 23:45:34.004112 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1100/2171] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:33 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:35.024351 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-cd4bac57-f60a-4996-a706-c93c7acedd3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:35.024955 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-cd4bac57-f60a-4996-a706-c93c7acedd3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:35.031391 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd4bac57-f60a-4996-a706-c93c7acedd3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:35.031873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd4bac57-f60a-4996-a706-c93c7acedd3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:35.032300 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd4bac57-f60a-4996-a706-c93c7acedd3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:35.032990 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd4bac57-f60a-4996-a706-c93c7acedd3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:35.033437 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd4bac57-f60a-4996-a706-c93c7acedd3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:35.033901 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd4bac57-f60a-4996-a706-c93c7acedd3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:35.164540 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cd4bac57-f60a-4996-a706-c93c7acedd3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:35.172519 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-cd4bac57-f60a-4996-a706-c93c7acedd3a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.152650 Aug 04 23:45:35.173083 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1072/2172] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:35 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:36.194059 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-513766f6-8ddf-47fd-bc5c-79f8dc076326 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:36.194720 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-513766f6-8ddf-47fd-bc5c-79f8dc076326 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:36.201746 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-513766f6-8ddf-47fd-bc5c-79f8dc076326 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:36.202226 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-513766f6-8ddf-47fd-bc5c-79f8dc076326 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:36.202696 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-513766f6-8ddf-47fd-bc5c-79f8dc076326 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:36.203391 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-513766f6-8ddf-47fd-bc5c-79f8dc076326 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:36.203845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-513766f6-8ddf-47fd-bc5c-79f8dc076326 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:36.204272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-513766f6-8ddf-47fd-bc5c-79f8dc076326 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:36.565295 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-513766f6-8ddf-47fd-bc5c-79f8dc076326 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:36.573438 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-513766f6-8ddf-47fd-bc5c-79f8dc076326 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.383270 Aug 04 23:45:36.573995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1101/2173] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:36 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:37.594569 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e4c8d6a3-417f-484c-9e04-cd12df4bc2a3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:37.595170 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e4c8d6a3-417f-484c-9e04-cd12df4bc2a3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:37.602244 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4c8d6a3-417f-484c-9e04-cd12df4bc2a3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:37.602745 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4c8d6a3-417f-484c-9e04-cd12df4bc2a3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:37.603179 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4c8d6a3-417f-484c-9e04-cd12df4bc2a3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:37.603870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4c8d6a3-417f-484c-9e04-cd12df4bc2a3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:37.604321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4c8d6a3-417f-484c-9e04-cd12df4bc2a3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:37.604745 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e4c8d6a3-417f-484c-9e04-cd12df4bc2a3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:37.737088 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e4c8d6a3-417f-484c-9e04-cd12df4bc2a3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:37.745916 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e4c8d6a3-417f-484c-9e04-cd12df4bc2a3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.155214 Aug 04 23:45:37.746522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1073/2174] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:37 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:38.768295 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-976dc3d7-cff9-4409-b33a-16b6f3fc8bc2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:38.768898 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-976dc3d7-cff9-4409-b33a-16b6f3fc8bc2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:38.777122 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-976dc3d7-cff9-4409-b33a-16b6f3fc8bc2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:38.777604 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-976dc3d7-cff9-4409-b33a-16b6f3fc8bc2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:38.778034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-976dc3d7-cff9-4409-b33a-16b6f3fc8bc2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:38.778758 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-976dc3d7-cff9-4409-b33a-16b6f3fc8bc2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:38.779202 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-976dc3d7-cff9-4409-b33a-16b6f3fc8bc2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:38.779624 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-976dc3d7-cff9-4409-b33a-16b6f3fc8bc2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:38.913483 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-976dc3d7-cff9-4409-b33a-16b6f3fc8bc2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:38.921859 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-976dc3d7-cff9-4409-b33a-16b6f3fc8bc2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.157805 Aug 04 23:45:38.922447 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1102/2175] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:38 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:39.943056 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5063cc4a-95f3-49ed-ae0c-3ec571556d79 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:39.943647 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5063cc4a-95f3-49ed-ae0c-3ec571556d79 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:39.951103 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5063cc4a-95f3-49ed-ae0c-3ec571556d79 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:39.951617 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5063cc4a-95f3-49ed-ae0c-3ec571556d79 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:39.952051 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5063cc4a-95f3-49ed-ae0c-3ec571556d79 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:39.952735 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5063cc4a-95f3-49ed-ae0c-3ec571556d79 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:39.953181 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5063cc4a-95f3-49ed-ae0c-3ec571556d79 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:39.953600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5063cc4a-95f3-49ed-ae0c-3ec571556d79 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:40.083720 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5063cc4a-95f3-49ed-ae0c-3ec571556d79 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:40.092753 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5063cc4a-95f3-49ed-ae0c-3ec571556d79 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.153526 Aug 04 23:45:40.093317 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1074/2176] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:39 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:41.115574 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-93b5f1cb-8941-4042-9d3e-cd679fad65f9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:41.116138 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-93b5f1cb-8941-4042-9d3e-cd679fad65f9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:41.123153 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-93b5f1cb-8941-4042-9d3e-cd679fad65f9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:41.123640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-93b5f1cb-8941-4042-9d3e-cd679fad65f9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:41.124053 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-93b5f1cb-8941-4042-9d3e-cd679fad65f9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:41.124741 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-93b5f1cb-8941-4042-9d3e-cd679fad65f9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:41.125203 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-93b5f1cb-8941-4042-9d3e-cd679fad65f9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:41.125609 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-93b5f1cb-8941-4042-9d3e-cd679fad65f9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:41.271900 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-93b5f1cb-8941-4042-9d3e-cd679fad65f9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:41.284459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-93b5f1cb-8941-4042-9d3e-cd679fad65f9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.172560 Aug 04 23:45:41.285475 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1103/2177] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:41 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:42.318864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-678a70d9-6728-4b0c-b1e5-f0537ae00f9d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:42.319450 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-678a70d9-6728-4b0c-b1e5-f0537ae00f9d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:42.326541 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-678a70d9-6728-4b0c-b1e5-f0537ae00f9d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:42.327031 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-678a70d9-6728-4b0c-b1e5-f0537ae00f9d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:42.327458 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-678a70d9-6728-4b0c-b1e5-f0537ae00f9d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:42.328153 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-678a70d9-6728-4b0c-b1e5-f0537ae00f9d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:42.328596 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-678a70d9-6728-4b0c-b1e5-f0537ae00f9d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:42.329012 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-678a70d9-6728-4b0c-b1e5-f0537ae00f9d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:42.465515 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-678a70d9-6728-4b0c-b1e5-f0537ae00f9d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:42.473622 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-678a70d9-6728-4b0c-b1e5-f0537ae00f9d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.158645 Aug 04 23:45:42.474179 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1075/2178] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:42 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:43.497328 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0998a59e-fa91-4e09-93aa-7052468f40dc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:43.497956 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0998a59e-fa91-4e09-93aa-7052468f40dc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:43.504387 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0998a59e-fa91-4e09-93aa-7052468f40dc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:43.504871 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0998a59e-fa91-4e09-93aa-7052468f40dc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:43.505318 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0998a59e-fa91-4e09-93aa-7052468f40dc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:43.506010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0998a59e-fa91-4e09-93aa-7052468f40dc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:43.506491 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0998a59e-fa91-4e09-93aa-7052468f40dc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:43.506920 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0998a59e-fa91-4e09-93aa-7052468f40dc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:43.639359 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0998a59e-fa91-4e09-93aa-7052468f40dc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:43.647359 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0998a59e-fa91-4e09-93aa-7052468f40dc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.155972 Aug 04 23:45:43.647928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1104/2179] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:43 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:44.668768 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-81b370e7-5bfd-4d7b-a483-4d276135ab39 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:44.669359 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-81b370e7-5bfd-4d7b-a483-4d276135ab39 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:44.675776 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-81b370e7-5bfd-4d7b-a483-4d276135ab39 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:44.676253 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-81b370e7-5bfd-4d7b-a483-4d276135ab39 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:44.676675 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-81b370e7-5bfd-4d7b-a483-4d276135ab39 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:44.677357 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-81b370e7-5bfd-4d7b-a483-4d276135ab39 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:44.677804 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-81b370e7-5bfd-4d7b-a483-4d276135ab39 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:44.678222 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-81b370e7-5bfd-4d7b-a483-4d276135ab39 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:44.808515 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-81b370e7-5bfd-4d7b-a483-4d276135ab39 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:44.816522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-81b370e7-5bfd-4d7b-a483-4d276135ab39 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.151629 Aug 04 23:45:44.817087 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1076/2180] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:44 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:45.838283 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b69747c4-ab5e-44b3-932e-12643d40cc2a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:45.838925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b69747c4-ab5e-44b3-932e-12643d40cc2a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:45.846787 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b69747c4-ab5e-44b3-932e-12643d40cc2a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:45.847483 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b69747c4-ab5e-44b3-932e-12643d40cc2a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:45.848125 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b69747c4-ab5e-44b3-932e-12643d40cc2a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:45.848961 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b69747c4-ab5e-44b3-932e-12643d40cc2a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:45.849411 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b69747c4-ab5e-44b3-932e-12643d40cc2a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:45.849830 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b69747c4-ab5e-44b3-932e-12643d40cc2a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:45.978761 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b69747c4-ab5e-44b3-932e-12643d40cc2a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:45.986598 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b69747c4-ab5e-44b3-932e-12643d40cc2a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.152808 Aug 04 23:45:45.987158 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1105/2181] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:45 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:47.008153 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a6afe6a6-2798-4bdc-bfa9-cddf4f149c34 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:47.009006 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a6afe6a6-2798-4bdc-bfa9-cddf4f149c34 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:47.015467 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a6afe6a6-2798-4bdc-bfa9-cddf4f149c34 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:47.015936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a6afe6a6-2798-4bdc-bfa9-cddf4f149c34 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:47.016494 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a6afe6a6-2798-4bdc-bfa9-cddf4f149c34 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:47.017359 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a6afe6a6-2798-4bdc-bfa9-cddf4f149c34 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:47.017813 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a6afe6a6-2798-4bdc-bfa9-cddf4f149c34 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:47.018234 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a6afe6a6-2798-4bdc-bfa9-cddf4f149c34 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:47.158244 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a6afe6a6-2798-4bdc-bfa9-cddf4f149c34 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:47.166824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a6afe6a6-2798-4bdc-bfa9-cddf4f149c34 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.162398 Aug 04 23:45:47.167407 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1077/2182] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:47 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:48.188739 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-dd3da044-14c9-4441-bd99-7a7defa626a1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:48.189395 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-dd3da044-14c9-4441-bd99-7a7defa626a1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:48.195951 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dd3da044-14c9-4441-bd99-7a7defa626a1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:48.196463 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dd3da044-14c9-4441-bd99-7a7defa626a1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:48.196912 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dd3da044-14c9-4441-bd99-7a7defa626a1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:48.197599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dd3da044-14c9-4441-bd99-7a7defa626a1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:48.198081 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dd3da044-14c9-4441-bd99-7a7defa626a1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:48.198538 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dd3da044-14c9-4441-bd99-7a7defa626a1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:48.328895 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-dd3da044-14c9-4441-bd99-7a7defa626a1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:48.337457 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-dd3da044-14c9-4441-bd99-7a7defa626a1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.152460 Aug 04 23:45:48.338031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1106/2183] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:48 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:49.358571 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e1e40114-364e-4d82-b907-6c85bf7bf1ae tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:49.359224 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e1e40114-364e-4d82-b907-6c85bf7bf1ae tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:49.365617 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1e40114-364e-4d82-b907-6c85bf7bf1ae tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:49.366089 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1e40114-364e-4d82-b907-6c85bf7bf1ae tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:49.366547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1e40114-364e-4d82-b907-6c85bf7bf1ae tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:49.367223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1e40114-364e-4d82-b907-6c85bf7bf1ae tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:49.367667 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1e40114-364e-4d82-b907-6c85bf7bf1ae tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:49.368630 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1e40114-364e-4d82-b907-6c85bf7bf1ae tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:49.503770 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e1e40114-364e-4d82-b907-6c85bf7bf1ae tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:49.512140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e1e40114-364e-4d82-b907-6c85bf7bf1ae tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.157426 Aug 04 23:45:49.512708 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1078/2184] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:49 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:50.533147 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f44ce182-ab7b-4b49-afe7-30c5522df369 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:50.533753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f44ce182-ab7b-4b49-afe7-30c5522df369 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:50.541640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f44ce182-ab7b-4b49-afe7-30c5522df369 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:50.542121 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f44ce182-ab7b-4b49-afe7-30c5522df369 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:50.542575 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f44ce182-ab7b-4b49-afe7-30c5522df369 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:50.543259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f44ce182-ab7b-4b49-afe7-30c5522df369 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:50.543702 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f44ce182-ab7b-4b49-afe7-30c5522df369 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:50.544121 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f44ce182-ab7b-4b49-afe7-30c5522df369 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:50.678769 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f44ce182-ab7b-4b49-afe7-30c5522df369 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:50.687834 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f44ce182-ab7b-4b49-afe7-30c5522df369 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.158605 Aug 04 23:45:50.688379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1107/2185] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:50 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:51.710457 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9e0a1b50-3da1-4c71-907b-a6e633c16d02 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:51.711080 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9e0a1b50-3da1-4c71-907b-a6e633c16d02 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:51.713491 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=26 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:45:51.718970 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e0a1b50-3da1-4c71-907b-a6e633c16d02 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:51.719453 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e0a1b50-3da1-4c71-907b-a6e633c16d02 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:51.719891 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e0a1b50-3da1-4c71-907b-a6e633c16d02 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:51.720587 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e0a1b50-3da1-4c71-907b-a6e633c16d02 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:51.721045 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e0a1b50-3da1-4c71-907b-a6e633c16d02 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:51.721467 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9e0a1b50-3da1-4c71-907b-a6e633c16d02 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:51.724459 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=78 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:45:51.858430 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9e0a1b50-3da1-4c71-907b-a6e633c16d02 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:51.866906 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9e0a1b50-3da1-4c71-907b-a6e633c16d02 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.160436 Aug 04 23:45:51.867479 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1079/2186] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:51 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:45:52.888546 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-422083e7-1cf6-4ce9-b61d-badbe357edc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:52.889168 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-422083e7-1cf6-4ce9-b61d-badbe357edc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:52.891492 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=26 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:45:52.896754 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-422083e7-1cf6-4ce9-b61d-badbe357edc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:52.897235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-422083e7-1cf6-4ce9-b61d-badbe357edc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:52.897671 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-422083e7-1cf6-4ce9-b61d-badbe357edc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:52.898379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-422083e7-1cf6-4ce9-b61d-badbe357edc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:52.898984 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-422083e7-1cf6-4ce9-b61d-badbe357edc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:52.899294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-422083e7-1cf6-4ce9-b61d-badbe357edc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:52.902094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=78 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:45:53.039175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-422083e7-1cf6-4ce9-b61d-badbe357edc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:53.047734 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-422083e7-1cf6-4ce9-b61d-badbe357edc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.163027 Aug 04 23:45:53.048297 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1108/2187] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:52 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:54.069369 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a2af60ce-920c-46bb-9f67-f2b85410861c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:54.069958 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a2af60ce-920c-46bb-9f67-f2b85410861c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:54.076139 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a2af60ce-920c-46bb-9f67-f2b85410861c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:54.076617 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a2af60ce-920c-46bb-9f67-f2b85410861c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:54.077047 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a2af60ce-920c-46bb-9f67-f2b85410861c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:54.077736 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a2af60ce-920c-46bb-9f67-f2b85410861c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:54.078186 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a2af60ce-920c-46bb-9f67-f2b85410861c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:54.078636 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a2af60ce-920c-46bb-9f67-f2b85410861c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:54.207353 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a2af60ce-920c-46bb-9f67-f2b85410861c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:54.216223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a2af60ce-920c-46bb-9f67-f2b85410861c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.151129 Aug 04 23:45:54.216782 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1080/2188] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:54 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:55.239521 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-831b8191-ab08-4756-b581-c49ff0524cd0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:55.240118 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-831b8191-ab08-4756-b581-c49ff0524cd0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:55.247276 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-831b8191-ab08-4756-b581-c49ff0524cd0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:55.247747 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-831b8191-ab08-4756-b581-c49ff0524cd0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:55.248170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-831b8191-ab08-4756-b581-c49ff0524cd0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:55.248845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-831b8191-ab08-4756-b581-c49ff0524cd0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:55.249287 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-831b8191-ab08-4756-b581-c49ff0524cd0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:55.249700 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-831b8191-ab08-4756-b581-c49ff0524cd0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:55.382650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-831b8191-ab08-4756-b581-c49ff0524cd0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:55.391511 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-831b8191-ab08-4756-b581-c49ff0524cd0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.155882 Aug 04 23:45:55.392073 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1109/2189] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:55 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:56.413477 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-44b3530a-5606-4bb2-95fd-d519ddea4e2e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:56.414448 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-44b3530a-5606-4bb2-95fd-d519ddea4e2e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:56.421178 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44b3530a-5606-4bb2-95fd-d519ddea4e2e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:56.421658 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44b3530a-5606-4bb2-95fd-d519ddea4e2e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:56.422091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44b3530a-5606-4bb2-95fd-d519ddea4e2e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:56.422803 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44b3530a-5606-4bb2-95fd-d519ddea4e2e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:56.423256 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44b3530a-5606-4bb2-95fd-d519ddea4e2e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:56.423674 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44b3530a-5606-4bb2-95fd-d519ddea4e2e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:56.556099 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-44b3530a-5606-4bb2-95fd-d519ddea4e2e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:56.564104 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-44b3530a-5606-4bb2-95fd-d519ddea4e2e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.155156 Aug 04 23:45:56.564645 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1081/2190] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:56 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:57.587192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-049bb5d1-9515-45a4-b539-c2121ef2357d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:57.587953 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-049bb5d1-9515-45a4-b539-c2121ef2357d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:57.594424 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-049bb5d1-9515-45a4-b539-c2121ef2357d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:57.594900 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-049bb5d1-9515-45a4-b539-c2121ef2357d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:57.595327 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-049bb5d1-9515-45a4-b539-c2121ef2357d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:57.596012 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-049bb5d1-9515-45a4-b539-c2121ef2357d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:57.596456 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-049bb5d1-9515-45a4-b539-c2121ef2357d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:57.596900 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-049bb5d1-9515-45a4-b539-c2121ef2357d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:57.736006 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-049bb5d1-9515-45a4-b539-c2121ef2357d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:57.744698 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-049bb5d1-9515-45a4-b539-c2121ef2357d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.162246 Aug 04 23:45:57.745272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1110/2191] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:57 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:58.766235 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b9578839-d4ca-4c68-8ff0-a897e5458429 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:58.766866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b9578839-d4ca-4c68-8ff0-a897e5458429 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:58.773248 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b9578839-d4ca-4c68-8ff0-a897e5458429 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:58.774248 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b9578839-d4ca-4c68-8ff0-a897e5458429 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:58.774707 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b9578839-d4ca-4c68-8ff0-a897e5458429 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:58.775389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b9578839-d4ca-4c68-8ff0-a897e5458429 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:58.775839 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b9578839-d4ca-4c68-8ff0-a897e5458429 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:58.776261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b9578839-d4ca-4c68-8ff0-a897e5458429 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:58.913997 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b9578839-d4ca-4c68-8ff0-a897e5458429 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:45:58.922659 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b9578839-d4ca-4c68-8ff0-a897e5458429 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.160250 Aug 04 23:45:58.923228 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1082/2192] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:58 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:45:59.950091 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8b24ee95-e377-4e87-a5b3-74e39bf1092b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:45:59.950757 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8b24ee95-e377-4e87-a5b3-74e39bf1092b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:45:59.957357 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b24ee95-e377-4e87-a5b3-74e39bf1092b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:59.957836 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b24ee95-e377-4e87-a5b3-74e39bf1092b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:59.958272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b24ee95-e377-4e87-a5b3-74e39bf1092b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:45:59.959002 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b24ee95-e377-4e87-a5b3-74e39bf1092b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:45:59.959453 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b24ee95-e377-4e87-a5b3-74e39bf1092b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:45:59.959879 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8b24ee95-e377-4e87-a5b3-74e39bf1092b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:00.122022 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8b24ee95-e377-4e87-a5b3-74e39bf1092b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:00.131967 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8b24ee95-e377-4e87-a5b3-74e39bf1092b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.186765 Aug 04 23:46:00.132540 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1111/2193] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:45:59 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:01.154849 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-66166a7e-3ecd-4e58-8c63-84c46a56a6a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:01.155457 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-66166a7e-3ecd-4e58-8c63-84c46a56a6a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:01.162530 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66166a7e-3ecd-4e58-8c63-84c46a56a6a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:01.163004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66166a7e-3ecd-4e58-8c63-84c46a56a6a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:01.163437 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66166a7e-3ecd-4e58-8c63-84c46a56a6a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:01.164129 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66166a7e-3ecd-4e58-8c63-84c46a56a6a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:01.164916 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66166a7e-3ecd-4e58-8c63-84c46a56a6a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:01.165348 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66166a7e-3ecd-4e58-8c63-84c46a56a6a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:01.309755 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-66166a7e-3ecd-4e58-8c63-84c46a56a6a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:01.318554 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-66166a7e-3ecd-4e58-8c63-84c46a56a6a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.168087 Aug 04 23:46:01.319481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1083/2194] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:01 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:02.339265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6bccd76f-5780-459d-89f2-5183f37a25f0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:02.339907 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6bccd76f-5780-459d-89f2-5183f37a25f0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:02.346676 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6bccd76f-5780-459d-89f2-5183f37a25f0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:02.347165 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6bccd76f-5780-459d-89f2-5183f37a25f0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:02.347606 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6bccd76f-5780-459d-89f2-5183f37a25f0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:02.348308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6bccd76f-5780-459d-89f2-5183f37a25f0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:02.348763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6bccd76f-5780-459d-89f2-5183f37a25f0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:02.349191 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6bccd76f-5780-459d-89f2-5183f37a25f0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:02.494155 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6bccd76f-5780-459d-89f2-5183f37a25f0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:02.502321 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6bccd76f-5780-459d-89f2-5183f37a25f0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.166982 Aug 04 23:46:02.502922 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1112/2195] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:02 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:03.523453 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7ebde6a9-a5c6-4b94-96bb-7009ddc1b73b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:03.524116 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7ebde6a9-a5c6-4b94-96bb-7009ddc1b73b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:03.530901 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7ebde6a9-a5c6-4b94-96bb-7009ddc1b73b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:03.531383 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7ebde6a9-a5c6-4b94-96bb-7009ddc1b73b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:03.531816 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7ebde6a9-a5c6-4b94-96bb-7009ddc1b73b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:03.532512 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7ebde6a9-a5c6-4b94-96bb-7009ddc1b73b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:03.532959 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7ebde6a9-a5c6-4b94-96bb-7009ddc1b73b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:03.533380 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7ebde6a9-a5c6-4b94-96bb-7009ddc1b73b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:03.673789 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7ebde6a9-a5c6-4b94-96bb-7009ddc1b73b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:03.681866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7ebde6a9-a5c6-4b94-96bb-7009ddc1b73b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.162323 Aug 04 23:46:03.682757 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1084/2196] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:03 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:04.703367 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ebaec611-237f-424d-913b-766ff7693d54 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:04.704001 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ebaec611-237f-424d-913b-766ff7693d54 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:04.710605 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ebaec611-237f-424d-913b-766ff7693d54 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:04.711676 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ebaec611-237f-424d-913b-766ff7693d54 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:04.712150 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ebaec611-237f-424d-913b-766ff7693d54 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:04.712724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ebaec611-237f-424d-913b-766ff7693d54 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:04.713169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ebaec611-237f-424d-913b-766ff7693d54 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:04.713587 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ebaec611-237f-424d-913b-766ff7693d54 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:04.851959 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ebaec611-237f-424d-913b-766ff7693d54 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:04.860261 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ebaec611-237f-424d-913b-766ff7693d54 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.160755 Aug 04 23:46:04.873253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1113/2197] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:04 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:04.906384 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ebfddf06-ed0b-4cf6-b6ac-2bfe02e35139 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:04.906938 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ebfddf06-ed0b-4cf6-b6ac-2bfe02e35139 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:04.914121 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ebfddf06-ed0b-4cf6-b6ac-2bfe02e35139 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:04.914735 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ebfddf06-ed0b-4cf6-b6ac-2bfe02e35139 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:04.915240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ebfddf06-ed0b-4cf6-b6ac-2bfe02e35139 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:04.916016 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ebfddf06-ed0b-4cf6-b6ac-2bfe02e35139 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:04.916607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ebfddf06-ed0b-4cf6-b6ac-2bfe02e35139 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:04.917242 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ebfddf06-ed0b-4cf6-b6ac-2bfe02e35139 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:04.950851 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ebfddf06-ed0b-4cf6-b6ac-2bfe02e35139 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Going to try to terminate instance {{(pid=129791) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 23:46:04.989643 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [req-3404da3d-2da5-4101-a113-1e0f9ff8159f req-27955e8a-0b10-49be-99f7-6692a0d4ac36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee044da9-1338-4d15-a87d-7fcc18f8354a", "tag": "bb606376-a4bc-447a-9437-537ad4e184ad"}]} {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:46:05.000721 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-3404da3d-2da5-4101-a113-1e0f9ff8159f req-27955e8a-0b10-49be-99f7-6692a0d4ac36 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:05.001300 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-3404da3d-2da5-4101-a113-1e0f9ff8159f req-27955e8a-0b10-49be-99f7-6692a0d4ac36 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:05.001804 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [req-3404da3d-2da5-4101-a113-1e0f9ff8159f req-27955e8a-0b10-49be-99f7-6692a0d4ac36 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:05.015377 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.compute.server_external_events [req-3404da3d-2da5-4101-a113-1e0f9ff8159f req-27955e8a-0b10-49be-99f7-6692a0d4ac36 service nova] Creating event network-changed:bb606376-a4bc-447a-9437-537ad4e184ad for instance ee044da9-1338-4d15-a87d-7fcc18f8354a on hv-cinder-85221 Aug 04 23:46:05.022085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [req-3404da3d-2da5-4101-a113-1e0f9ff8159f req-27955e8a-0b10-49be-99f7-6692a0d4ac36 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118601 Aug 04 23:46:05.023529 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1114/2198] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 23:46:05.042964 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ebfddf06-ed0b-4cf6-b6ac-2bfe02e35139 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 204 len: 0 microversion: 2.1 time: 0.141616 Aug 04 23:46:05.043955 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1085/2199] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:46:04 2022] DELETE /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 23:46:05.053145 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ce2e5e49-b398-4979-97e8-af2be6f123d9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:05.054422 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ce2e5e49-b398-4979-97e8-af2be6f123d9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:05.062807 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ce2e5e49-b398-4979-97e8-af2be6f123d9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:05.063643 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ce2e5e49-b398-4979-97e8-af2be6f123d9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:05.064085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ce2e5e49-b398-4979-97e8-af2be6f123d9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:05.064793 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ce2e5e49-b398-4979-97e8-af2be6f123d9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:05.065243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ce2e5e49-b398-4979-97e8-af2be6f123d9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:05.065750 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ce2e5e49-b398-4979-97e8-af2be6f123d9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:05.211487 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ce2e5e49-b398-4979-97e8-af2be6f123d9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:05.219605 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ce2e5e49-b398-4979-97e8-af2be6f123d9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1576 microversion: 2.1 time: 0.171037 Aug 04 23:46:05.220187 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1115/2200] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:05 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:05.881754 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7084a243-2a89-42a4-8cd4-11eb0e0c36e2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:05.882486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7084a243-2a89-42a4-8cd4-11eb0e0c36e2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:05.888551 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7084a243-2a89-42a4-8cd4-11eb0e0c36e2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:05.889032 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7084a243-2a89-42a4-8cd4-11eb0e0c36e2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:05.889493 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7084a243-2a89-42a4-8cd4-11eb0e0c36e2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:05.890185 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7084a243-2a89-42a4-8cd4-11eb0e0c36e2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:05.890671 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7084a243-2a89-42a4-8cd4-11eb0e0c36e2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:05.891099 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7084a243-2a89-42a4-8cd4-11eb0e0c36e2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:06.051108 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7084a243-2a89-42a4-8cd4-11eb0e0c36e2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:06.059998 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7084a243-2a89-42a4-8cd4-11eb0e0c36e2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.182515 Aug 04 23:46:06.060573 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1086/2201] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:05 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:06.241159 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-87023564-5879-4073-9632-a5b854bd72b5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:06.241808 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-87023564-5879-4073-9632-a5b854bd72b5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:06.249480 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87023564-5879-4073-9632-a5b854bd72b5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:06.249961 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87023564-5879-4073-9632-a5b854bd72b5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:06.250453 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87023564-5879-4073-9632-a5b854bd72b5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:06.251196 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87023564-5879-4073-9632-a5b854bd72b5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:06.251761 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87023564-5879-4073-9632-a5b854bd72b5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:06.252188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87023564-5879-4073-9632-a5b854bd72b5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:06.397865 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-87023564-5879-4073-9632-a5b854bd72b5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:06.406245 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-87023564-5879-4073-9632-a5b854bd72b5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1458 microversion: 2.1 time: 0.168963 Aug 04 23:46:06.406968 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1116/2202] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:06 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1458 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:07.038997 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-0c0b4d99-c1e0-400e-adcf-294f8c052333 req-a3a158d3-9f3d-4d71-ba83-c56c614c46d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee044da9-1338-4d15-a87d-7fcc18f8354a", "name": "network-vif-deleted", "tag": "bb606376-a4bc-447a-9437-537ad4e184ad"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:46:07.049553 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-0c0b4d99-c1e0-400e-adcf-294f8c052333 req-a3a158d3-9f3d-4d71-ba83-c56c614c46d7 service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:07.050014 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-0c0b4d99-c1e0-400e-adcf-294f8c052333 req-a3a158d3-9f3d-4d71-ba83-c56c614c46d7 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:07.050461 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-0c0b4d99-c1e0-400e-adcf-294f8c052333 req-a3a158d3-9f3d-4d71-ba83-c56c614c46d7 service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:07.063126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-0c0b4d99-c1e0-400e-adcf-294f8c052333 req-a3a158d3-9f3d-4d71-ba83-c56c614c46d7 service nova] Creating event network-vif-deleted:bb606376-a4bc-447a-9437-537ad4e184ad for instance ee044da9-1338-4d15-a87d-7fcc18f8354a on hv-cinder-85221 Aug 04 23:46:07.068257 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-0c0b4d99-c1e0-400e-adcf-294f8c052333 req-a3a158d3-9f3d-4d71-ba83-c56c614c46d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033453 Aug 04 23:46:07.068871 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1087/2203] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:46:07.081360 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7f39fbff-4c82-4512-add8-7cad5f939f65 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:07.081986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7f39fbff-4c82-4512-add8-7cad5f939f65 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:07.088536 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7f39fbff-4c82-4512-add8-7cad5f939f65 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:07.089014 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7f39fbff-4c82-4512-add8-7cad5f939f65 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:07.089458 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7f39fbff-4c82-4512-add8-7cad5f939f65 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:07.090173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7f39fbff-4c82-4512-add8-7cad5f939f65 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:07.090669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7f39fbff-4c82-4512-add8-7cad5f939f65 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:07.091101 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7f39fbff-4c82-4512-add8-7cad5f939f65 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:07.234744 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7f39fbff-4c82-4512-add8-7cad5f939f65 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:07.243803 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7f39fbff-4c82-4512-add8-7cad5f939f65 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.166299 Aug 04 23:46:07.245138 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1117/2204] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:07 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:07.428888 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5ec6436f-6932-4d2d-9b88-cbe7bd2bf9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:07.429651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5ec6436f-6932-4d2d-9b88-cbe7bd2bf9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:07.436546 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ec6436f-6932-4d2d-9b88-cbe7bd2bf9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:07.437126 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ec6436f-6932-4d2d-9b88-cbe7bd2bf9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:07.437651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ec6436f-6932-4d2d-9b88-cbe7bd2bf9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:07.438462 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ec6436f-6932-4d2d-9b88-cbe7bd2bf9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:07.438992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ec6436f-6932-4d2d-9b88-cbe7bd2bf9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:07.439491 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ec6436f-6932-4d2d-9b88-cbe7bd2bf9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:07.508269 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5ec6436f-6932-4d2d-9b88-cbe7bd2bf9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:07.516301 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5ec6436f-6932-4d2d-9b88-cbe7bd2bf9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.091544 Aug 04 23:46:07.516871 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1088/2205] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:07 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:08.266740 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1c02ab66-e2fe-4c9c-a695-7bbad84f2766 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:08.267393 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1c02ab66-e2fe-4c9c-a695-7bbad84f2766 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:08.275008 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c02ab66-e2fe-4c9c-a695-7bbad84f2766 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:08.275494 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c02ab66-e2fe-4c9c-a695-7bbad84f2766 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:08.275962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c02ab66-e2fe-4c9c-a695-7bbad84f2766 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:08.276638 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c02ab66-e2fe-4c9c-a695-7bbad84f2766 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:08.277091 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c02ab66-e2fe-4c9c-a695-7bbad84f2766 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:08.277544 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1c02ab66-e2fe-4c9c-a695-7bbad84f2766 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:08.416762 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1c02ab66-e2fe-4c9c-a695-7bbad84f2766 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:08.424733 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1c02ab66-e2fe-4c9c-a695-7bbad84f2766 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.161943 Aug 04 23:46:08.425294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1118/2206] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:08 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:08.537346 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-04fd7b62-722d-4ccd-8689-b181f5644287 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:08.537922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-04fd7b62-722d-4ccd-8689-b181f5644287 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:08.545102 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-04fd7b62-722d-4ccd-8689-b181f5644287 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:08.545581 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-04fd7b62-722d-4ccd-8689-b181f5644287 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:08.546014 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-04fd7b62-722d-4ccd-8689-b181f5644287 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:08.546730 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-04fd7b62-722d-4ccd-8689-b181f5644287 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:08.547177 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-04fd7b62-722d-4ccd-8689-b181f5644287 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:08.547597 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-04fd7b62-722d-4ccd-8689-b181f5644287 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:08.612162 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-04fd7b62-722d-4ccd-8689-b181f5644287 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:08.619901 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-04fd7b62-722d-4ccd-8689-b181f5644287 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086754 Aug 04 23:46:08.620465 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1089/2207] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:08 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:09.447003 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-60c54b51-c100-40b2-ab39-ef09e5e535c1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:09.448025 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-60c54b51-c100-40b2-ab39-ef09e5e535c1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:09.454465 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60c54b51-c100-40b2-ab39-ef09e5e535c1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:09.454938 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60c54b51-c100-40b2-ab39-ef09e5e535c1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:09.455382 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60c54b51-c100-40b2-ab39-ef09e5e535c1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:09.456047 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60c54b51-c100-40b2-ab39-ef09e5e535c1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:09.456494 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60c54b51-c100-40b2-ab39-ef09e5e535c1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:09.456913 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60c54b51-c100-40b2-ab39-ef09e5e535c1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:09.586872 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-60c54b51-c100-40b2-ab39-ef09e5e535c1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:09.594980 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-60c54b51-c100-40b2-ab39-ef09e5e535c1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.153089 Aug 04 23:46:09.595552 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1119/2208] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:09 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:09.641022 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-05d1042f-8c00-43cd-9978-0ea98c472aca tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:09.641611 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-05d1042f-8c00-43cd-9978-0ea98c472aca tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:09.650320 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05d1042f-8c00-43cd-9978-0ea98c472aca tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:09.650320 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05d1042f-8c00-43cd-9978-0ea98c472aca tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:09.650320 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05d1042f-8c00-43cd-9978-0ea98c472aca tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:09.650747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05d1042f-8c00-43cd-9978-0ea98c472aca tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:09.650929 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05d1042f-8c00-43cd-9978-0ea98c472aca tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:09.651357 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-05d1042f-8c00-43cd-9978-0ea98c472aca tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:09.712812 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-05d1042f-8c00-43cd-9978-0ea98c472aca tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:09.720317 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-05d1042f-8c00-43cd-9978-0ea98c472aca tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083170 Aug 04 23:46:09.720909 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1090/2209] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:09 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:10.616613 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f62ed6e9-44a3-4927-953d-5829b871cdd7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:10.617393 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f62ed6e9-44a3-4927-953d-5829b871cdd7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:10.623745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f62ed6e9-44a3-4927-953d-5829b871cdd7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:10.624223 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f62ed6e9-44a3-4927-953d-5829b871cdd7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:10.624661 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f62ed6e9-44a3-4927-953d-5829b871cdd7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:10.625346 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f62ed6e9-44a3-4927-953d-5829b871cdd7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:10.625796 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f62ed6e9-44a3-4927-953d-5829b871cdd7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:10.626217 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f62ed6e9-44a3-4927-953d-5829b871cdd7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:10.740674 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e2a837ee-d060-4c55-98ce-c690fd8e9a8c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:10.741285 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e2a837ee-d060-4c55-98ce-c690fd8e9a8c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:10.748441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2a837ee-d060-4c55-98ce-c690fd8e9a8c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:10.748922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2a837ee-d060-4c55-98ce-c690fd8e9a8c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:10.749358 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2a837ee-d060-4c55-98ce-c690fd8e9a8c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:10.750056 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2a837ee-d060-4c55-98ce-c690fd8e9a8c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:10.750546 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2a837ee-d060-4c55-98ce-c690fd8e9a8c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:10.750969 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e2a837ee-d060-4c55-98ce-c690fd8e9a8c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:10.760398 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f62ed6e9-44a3-4927-953d-5829b871cdd7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:10.768718 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f62ed6e9-44a3-4927-953d-5829b871cdd7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.155940 Aug 04 23:46:10.769307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1120/2210] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:10 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:10.814628 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e2a837ee-d060-4c55-98ce-c690fd8e9a8c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:10.823214 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e2a837ee-d060-4c55-98ce-c690fd8e9a8c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086379 Aug 04 23:46:10.823781 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1091/2211] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:10 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:46:11.789388 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-59c518ff-1b7e-44b4-badd-47356ba78b88 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:11.790039 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-59c518ff-1b7e-44b4-badd-47356ba78b88 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:11.796532 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59c518ff-1b7e-44b4-badd-47356ba78b88 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:11.797015 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59c518ff-1b7e-44b4-badd-47356ba78b88 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:11.797450 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59c518ff-1b7e-44b4-badd-47356ba78b88 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:11.798146 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59c518ff-1b7e-44b4-badd-47356ba78b88 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:11.798629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59c518ff-1b7e-44b4-badd-47356ba78b88 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:11.799053 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-59c518ff-1b7e-44b4-badd-47356ba78b88 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:11.843468 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-538e3501-1680-4789-ae15-20f76ea7dfe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:11.844078 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-538e3501-1680-4789-ae15-20f76ea7dfe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:11.850580 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-538e3501-1680-4789-ae15-20f76ea7dfe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:11.851082 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-538e3501-1680-4789-ae15-20f76ea7dfe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:11.852057 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-538e3501-1680-4789-ae15-20f76ea7dfe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:11.852752 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-538e3501-1680-4789-ae15-20f76ea7dfe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:11.853201 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-538e3501-1680-4789-ae15-20f76ea7dfe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:11.853622 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-538e3501-1680-4789-ae15-20f76ea7dfe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:11.933835 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-538e3501-1680-4789-ae15-20f76ea7dfe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:11.941235 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-538e3501-1680-4789-ae15-20f76ea7dfe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.101614 Aug 04 23:46:11.942030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1092/2212] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:11 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:46:11.957747 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-59c518ff-1b7e-44b4-badd-47356ba78b88 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:11.966531 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-59c518ff-1b7e-44b4-badd-47356ba78b88 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.181326 Aug 04 23:46:11.967104 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1121/2213] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:11 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:12.962149 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-06f85ca1-3ce6-4863-acec-2a735958cc4f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:12.962810 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-06f85ca1-3ce6-4863-acec-2a735958cc4f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:12.969188 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-06f85ca1-3ce6-4863-acec-2a735958cc4f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:12.969665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-06f85ca1-3ce6-4863-acec-2a735958cc4f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:12.970098 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-06f85ca1-3ce6-4863-acec-2a735958cc4f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:12.970818 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-06f85ca1-3ce6-4863-acec-2a735958cc4f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:12.971266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-06f85ca1-3ce6-4863-acec-2a735958cc4f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:12.971688 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-06f85ca1-3ce6-4863-acec-2a735958cc4f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:12.987310 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d285b553-7ed6-4acb-830d-4bd231250a8f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:12.987918 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d285b553-7ed6-4acb-830d-4bd231250a8f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:12.995635 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d285b553-7ed6-4acb-830d-4bd231250a8f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:12.996122 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d285b553-7ed6-4acb-830d-4bd231250a8f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:12.996553 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d285b553-7ed6-4acb-830d-4bd231250a8f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:12.997241 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d285b553-7ed6-4acb-830d-4bd231250a8f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:12.997687 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d285b553-7ed6-4acb-830d-4bd231250a8f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:12.998104 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d285b553-7ed6-4acb-830d-4bd231250a8f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:13.051301 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-06f85ca1-3ce6-4863-acec-2a735958cc4f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:13.059550 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-06f85ca1-3ce6-4863-acec-2a735958cc4f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.101315 Aug 04 23:46:13.060125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1093/2214] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:12 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:13.140230 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d285b553-7ed6-4acb-830d-4bd231250a8f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:13.148940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d285b553-7ed6-4acb-830d-4bd231250a8f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.165653 Aug 04 23:46:13.149502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1122/2215] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:12 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:46:14.080461 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0c839a50-a5aa-44a3-aa01-20f6e7a29521 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:14.081065 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0c839a50-a5aa-44a3-aa01-20f6e7a29521 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:14.088758 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c839a50-a5aa-44a3-aa01-20f6e7a29521 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:14.089162 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c839a50-a5aa-44a3-aa01-20f6e7a29521 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:14.089588 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c839a50-a5aa-44a3-aa01-20f6e7a29521 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:14.090261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c839a50-a5aa-44a3-aa01-20f6e7a29521 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:14.090732 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c839a50-a5aa-44a3-aa01-20f6e7a29521 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:14.091142 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0c839a50-a5aa-44a3-aa01-20f6e7a29521 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:14.152473 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0c839a50-a5aa-44a3-aa01-20f6e7a29521 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:14.154797 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:46:14.162347 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0c839a50-a5aa-44a3-aa01-20f6e7a29521 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085672 Aug 04 23:46:14.162924 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1094/2216] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:14 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:14.169080 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-dfd62218-7863-4201-bf62-69bbe18fdaa8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:14.169694 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-dfd62218-7863-4201-bf62-69bbe18fdaa8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:14.176143 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dfd62218-7863-4201-bf62-69bbe18fdaa8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:14.176620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dfd62218-7863-4201-bf62-69bbe18fdaa8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:14.177052 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dfd62218-7863-4201-bf62-69bbe18fdaa8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:14.177737 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dfd62218-7863-4201-bf62-69bbe18fdaa8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:14.178184 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dfd62218-7863-4201-bf62-69bbe18fdaa8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:14.178633 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-dfd62218-7863-4201-bf62-69bbe18fdaa8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:14.309670 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-dfd62218-7863-4201-bf62-69bbe18fdaa8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:14.317501 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-dfd62218-7863-4201-bf62-69bbe18fdaa8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.152233 Aug 04 23:46:14.318058 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1123/2217] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:14 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:15.183690 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4f933f81-eb10-42c0-9347-5093e2003729 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:15.184373 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4f933f81-eb10-42c0-9347-5093e2003729 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:15.191972 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f933f81-eb10-42c0-9347-5093e2003729 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:15.192453 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f933f81-eb10-42c0-9347-5093e2003729 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:15.192895 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f933f81-eb10-42c0-9347-5093e2003729 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:15.193583 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f933f81-eb10-42c0-9347-5093e2003729 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:15.194044 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f933f81-eb10-42c0-9347-5093e2003729 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:15.194526 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f933f81-eb10-42c0-9347-5093e2003729 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:15.255711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4f933f81-eb10-42c0-9347-5093e2003729 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:15.263772 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4f933f81-eb10-42c0-9347-5093e2003729 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084808 Aug 04 23:46:15.264342 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1095/2218] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:15 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:15.340382 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8d5f4b1f-bd90-4f2e-8006-132566c6f366 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:15.341000 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8d5f4b1f-bd90-4f2e-8006-132566c6f366 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:15.347791 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d5f4b1f-bd90-4f2e-8006-132566c6f366 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:15.348276 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d5f4b1f-bd90-4f2e-8006-132566c6f366 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:15.348745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d5f4b1f-bd90-4f2e-8006-132566c6f366 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:15.349440 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d5f4b1f-bd90-4f2e-8006-132566c6f366 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:15.349895 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d5f4b1f-bd90-4f2e-8006-132566c6f366 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:15.350324 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8d5f4b1f-bd90-4f2e-8006-132566c6f366 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:15.487090 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8d5f4b1f-bd90-4f2e-8006-132566c6f366 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:15.496142 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8d5f4b1f-bd90-4f2e-8006-132566c6f366 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.159594 Aug 04 23:46:15.496700 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1124/2219] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:15 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:16.284937 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-955ff23a-fb3b-42c8-9da7-106788e6e265 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:16.285876 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-955ff23a-fb3b-42c8-9da7-106788e6e265 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:16.293041 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-955ff23a-fb3b-42c8-9da7-106788e6e265 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:16.293522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-955ff23a-fb3b-42c8-9da7-106788e6e265 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:16.293955 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-955ff23a-fb3b-42c8-9da7-106788e6e265 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:16.294691 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-955ff23a-fb3b-42c8-9da7-106788e6e265 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:16.295142 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-955ff23a-fb3b-42c8-9da7-106788e6e265 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:16.295566 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-955ff23a-fb3b-42c8-9da7-106788e6e265 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:16.364889 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-955ff23a-fb3b-42c8-9da7-106788e6e265 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:16.373029 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-955ff23a-fb3b-42c8-9da7-106788e6e265 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.092093 Aug 04 23:46:16.373602 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1096/2220] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:16 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:16.517214 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-55976552-9c86-4f7e-8a74-5c0fe9015e1d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:16.517826 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-55976552-9c86-4f7e-8a74-5c0fe9015e1d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:16.524960 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55976552-9c86-4f7e-8a74-5c0fe9015e1d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:16.525434 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55976552-9c86-4f7e-8a74-5c0fe9015e1d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:16.525869 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55976552-9c86-4f7e-8a74-5c0fe9015e1d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:16.526590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55976552-9c86-4f7e-8a74-5c0fe9015e1d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:16.527041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55976552-9c86-4f7e-8a74-5c0fe9015e1d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:16.527463 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55976552-9c86-4f7e-8a74-5c0fe9015e1d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:16.542726 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:46:16.658849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-55976552-9c86-4f7e-8a74-5c0fe9015e1d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:16.667375 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-55976552-9c86-4f7e-8a74-5c0fe9015e1d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.154037 Aug 04 23:46:16.667957 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1125/2221] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:16 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:17.394943 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8da118d3-b693-4e6f-9fc5-2111f78e84a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:17.395557 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8da118d3-b693-4e6f-9fc5-2111f78e84a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:17.402080 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8da118d3-b693-4e6f-9fc5-2111f78e84a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:17.402595 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8da118d3-b693-4e6f-9fc5-2111f78e84a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:17.403040 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8da118d3-b693-4e6f-9fc5-2111f78e84a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:17.403734 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8da118d3-b693-4e6f-9fc5-2111f78e84a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:17.404188 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8da118d3-b693-4e6f-9fc5-2111f78e84a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:17.404612 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8da118d3-b693-4e6f-9fc5-2111f78e84a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:17.467349 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8da118d3-b693-4e6f-9fc5-2111f78e84a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:17.475005 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8da118d3-b693-4e6f-9fc5-2111f78e84a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083890 Aug 04 23:46:17.475558 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1097/2222] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:17 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:46:17.689564 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-051cf825-c53c-4728-bcdc-002f722f7ee5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:17.690165 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-051cf825-c53c-4728-bcdc-002f722f7ee5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:17.697202 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-051cf825-c53c-4728-bcdc-002f722f7ee5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:17.697672 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-051cf825-c53c-4728-bcdc-002f722f7ee5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:17.698100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-051cf825-c53c-4728-bcdc-002f722f7ee5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:17.698805 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-051cf825-c53c-4728-bcdc-002f722f7ee5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:17.699273 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-051cf825-c53c-4728-bcdc-002f722f7ee5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:17.699696 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-051cf825-c53c-4728-bcdc-002f722f7ee5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:17.835608 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-051cf825-c53c-4728-bcdc-002f722f7ee5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:17.843331 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-051cf825-c53c-4728-bcdc-002f722f7ee5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.157681 Aug 04 23:46:17.843900 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1126/2223] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:17 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:18.496631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-80fc48fb-ebd0-4e39-ac5d-d8131251156f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:18.497283 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-80fc48fb-ebd0-4e39-ac5d-d8131251156f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:18.504883 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80fc48fb-ebd0-4e39-ac5d-d8131251156f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:18.505372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80fc48fb-ebd0-4e39-ac5d-d8131251156f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:18.505897 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80fc48fb-ebd0-4e39-ac5d-d8131251156f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:18.506853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80fc48fb-ebd0-4e39-ac5d-d8131251156f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:18.507457 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80fc48fb-ebd0-4e39-ac5d-d8131251156f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:18.508061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80fc48fb-ebd0-4e39-ac5d-d8131251156f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:18.575633 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-80fc48fb-ebd0-4e39-ac5d-d8131251156f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:18.583331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-80fc48fb-ebd0-4e39-ac5d-d8131251156f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.091189 Aug 04 23:46:18.583903 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1098/2224] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:18 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:46:18.864417 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-717135b1-0c6c-4902-969b-619fc1376cde tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:18.865029 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-717135b1-0c6c-4902-969b-619fc1376cde tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:18.871637 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-717135b1-0c6c-4902-969b-619fc1376cde tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:18.872122 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-717135b1-0c6c-4902-969b-619fc1376cde tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:18.872562 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-717135b1-0c6c-4902-969b-619fc1376cde tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:18.873253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-717135b1-0c6c-4902-969b-619fc1376cde tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:18.873713 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-717135b1-0c6c-4902-969b-619fc1376cde tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:18.874137 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-717135b1-0c6c-4902-969b-619fc1376cde tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:19.003253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-717135b1-0c6c-4902-969b-619fc1376cde tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:19.012012 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-717135b1-0c6c-4902-969b-619fc1376cde tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.151458 Aug 04 23:46:19.012580 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1127/2225] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:18 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:19.604974 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-af1541d8-02ff-402f-8481-e1e897f95edc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:19.605666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-af1541d8-02ff-402f-8481-e1e897f95edc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:19.612132 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af1541d8-02ff-402f-8481-e1e897f95edc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:19.612609 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af1541d8-02ff-402f-8481-e1e897f95edc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:19.613035 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af1541d8-02ff-402f-8481-e1e897f95edc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:19.613725 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af1541d8-02ff-402f-8481-e1e897f95edc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:19.614167 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af1541d8-02ff-402f-8481-e1e897f95edc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:19.614620 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af1541d8-02ff-402f-8481-e1e897f95edc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:19.685738 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-af1541d8-02ff-402f-8481-e1e897f95edc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:19.693496 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-af1541d8-02ff-402f-8481-e1e897f95edc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.093075 Aug 04 23:46:19.694079 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1099/2226] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:19 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:20.033169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d267bfcb-8fe0-40bb-9a1a-e1c04462cb19 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:20.033779 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d267bfcb-8fe0-40bb-9a1a-e1c04462cb19 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:20.041941 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d267bfcb-8fe0-40bb-9a1a-e1c04462cb19 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:20.042459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d267bfcb-8fe0-40bb-9a1a-e1c04462cb19 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:20.042895 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d267bfcb-8fe0-40bb-9a1a-e1c04462cb19 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:20.043583 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d267bfcb-8fe0-40bb-9a1a-e1c04462cb19 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:20.044033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d267bfcb-8fe0-40bb-9a1a-e1c04462cb19 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:20.044449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d267bfcb-8fe0-40bb-9a1a-e1c04462cb19 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:20.182803 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d267bfcb-8fe0-40bb-9a1a-e1c04462cb19 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:20.190845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d267bfcb-8fe0-40bb-9a1a-e1c04462cb19 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.161444 Aug 04 23:46:20.191416 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1128/2227] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:20 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:20.715525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0d75a4c1-41d4-42ad-a052-a0a44ef80075 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:20.716140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0d75a4c1-41d4-42ad-a052-a0a44ef80075 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:20.723006 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0d75a4c1-41d4-42ad-a052-a0a44ef80075 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:20.723485 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0d75a4c1-41d4-42ad-a052-a0a44ef80075 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:20.723943 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0d75a4c1-41d4-42ad-a052-a0a44ef80075 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:20.724643 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0d75a4c1-41d4-42ad-a052-a0a44ef80075 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:20.725092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0d75a4c1-41d4-42ad-a052-a0a44ef80075 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:20.725548 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0d75a4c1-41d4-42ad-a052-a0a44ef80075 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:20.795817 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0d75a4c1-41d4-42ad-a052-a0a44ef80075 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:20.803510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0d75a4c1-41d4-42ad-a052-a0a44ef80075 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.092478 Aug 04 23:46:20.804083 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1100/2228] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:20 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:46:21.212988 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0992252f-d6d1-4efa-84e3-7d3af28b555a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:21.213611 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0992252f-d6d1-4efa-84e3-7d3af28b555a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:21.220036 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0992252f-d6d1-4efa-84e3-7d3af28b555a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:21.220512 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0992252f-d6d1-4efa-84e3-7d3af28b555a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:21.220945 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0992252f-d6d1-4efa-84e3-7d3af28b555a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:21.221625 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0992252f-d6d1-4efa-84e3-7d3af28b555a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:21.222073 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0992252f-d6d1-4efa-84e3-7d3af28b555a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:21.222522 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0992252f-d6d1-4efa-84e3-7d3af28b555a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:21.352795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0992252f-d6d1-4efa-84e3-7d3af28b555a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:21.360727 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0992252f-d6d1-4efa-84e3-7d3af28b555a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.152249 Aug 04 23:46:21.361299 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1129/2229] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:21 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:21.824551 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-75ff2f4b-ae17-42b6-ba07-065f7e3df102 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:21.825163 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-75ff2f4b-ae17-42b6-ba07-065f7e3df102 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:21.827506 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:46:21.834017 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-75ff2f4b-ae17-42b6-ba07-065f7e3df102 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:21.834542 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-75ff2f4b-ae17-42b6-ba07-065f7e3df102 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:21.835430 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-75ff2f4b-ae17-42b6-ba07-065f7e3df102 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:21.835670 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-75ff2f4b-ae17-42b6-ba07-065f7e3df102 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:21.836639 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-75ff2f4b-ae17-42b6-ba07-065f7e3df102 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:21.837055 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-75ff2f4b-ae17-42b6-ba07-065f7e3df102 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:21.900259 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-75ff2f4b-ae17-42b6-ba07-065f7e3df102 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:21.907757 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-75ff2f4b-ae17-42b6-ba07-065f7e3df102 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087337 Aug 04 23:46:21.908314 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1101/2230] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:21 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:22.382046 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-882f457e-91f1-48f4-9499-85f57268dbb1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:22.383389 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-882f457e-91f1-48f4-9499-85f57268dbb1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:22.391925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-882f457e-91f1-48f4-9499-85f57268dbb1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:22.392411 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-882f457e-91f1-48f4-9499-85f57268dbb1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:22.392852 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-882f457e-91f1-48f4-9499-85f57268dbb1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:22.393548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-882f457e-91f1-48f4-9499-85f57268dbb1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:22.394007 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-882f457e-91f1-48f4-9499-85f57268dbb1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:22.394464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-882f457e-91f1-48f4-9499-85f57268dbb1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:22.525602 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-882f457e-91f1-48f4-9499-85f57268dbb1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:22.533589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-882f457e-91f1-48f4-9499-85f57268dbb1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.155417 Aug 04 23:46:22.534150 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1130/2231] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:22 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:22.929277 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7569d377-c1f6-4d85-b798-0149b543a3f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:22.931226 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7569d377-c1f6-4d85-b798-0149b543a3f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:22.937093 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7569d377-c1f6-4d85-b798-0149b543a3f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:22.937559 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7569d377-c1f6-4d85-b798-0149b543a3f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:22.937987 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7569d377-c1f6-4d85-b798-0149b543a3f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:22.938697 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7569d377-c1f6-4d85-b798-0149b543a3f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:22.939143 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7569d377-c1f6-4d85-b798-0149b543a3f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:22.939556 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7569d377-c1f6-4d85-b798-0149b543a3f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:23.003792 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7569d377-c1f6-4d85-b798-0149b543a3f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:23.015584 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7569d377-c1f6-4d85-b798-0149b543a3f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.090057 Aug 04 23:46:23.016169 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1102/2232] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:22 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:23.555918 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9861e2be-a586-4720-befa-4b9279fbd03b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:23.556557 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9861e2be-a586-4720-befa-4b9279fbd03b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:23.558917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=46 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:46:23.564343 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9861e2be-a586-4720-befa-4b9279fbd03b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:23.564834 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9861e2be-a586-4720-befa-4b9279fbd03b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:23.565265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9861e2be-a586-4720-befa-4b9279fbd03b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:23.565962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9861e2be-a586-4720-befa-4b9279fbd03b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:23.566449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9861e2be-a586-4720-befa-4b9279fbd03b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:23.566873 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9861e2be-a586-4720-befa-4b9279fbd03b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:23.635052 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:46:23.635330 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:46:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 (ip 10.222.0.33) !!! Aug 04 23:46:23.701995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9861e2be-a586-4720-befa-4b9279fbd03b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:23.709900 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9861e2be-a586-4720-befa-4b9279fbd03b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.158393 Aug 04 23:46:23.710481 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1131/2233] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:23 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:24.036345 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-cd42c8c7-7096-40fa-a8af-52bd1a65d44b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:24.037002 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-cd42c8c7-7096-40fa-a8af-52bd1a65d44b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:24.044626 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd42c8c7-7096-40fa-a8af-52bd1a65d44b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:24.045156 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd42c8c7-7096-40fa-a8af-52bd1a65d44b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:24.045642 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd42c8c7-7096-40fa-a8af-52bd1a65d44b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:24.046455 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd42c8c7-7096-40fa-a8af-52bd1a65d44b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:24.046914 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd42c8c7-7096-40fa-a8af-52bd1a65d44b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:24.047472 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cd42c8c7-7096-40fa-a8af-52bd1a65d44b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:24.118630 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cd42c8c7-7096-40fa-a8af-52bd1a65d44b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:24.126171 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-cd42c8c7-7096-40fa-a8af-52bd1a65d44b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.094107 Aug 04 23:46:24.126776 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1103/2234] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:24 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:24.731982 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-05106159-a994-4010-a07b-94cbbbae04a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:24.732590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-05106159-a994-4010-a07b-94cbbbae04a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:24.738567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-05106159-a994-4010-a07b-94cbbbae04a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:24.739040 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-05106159-a994-4010-a07b-94cbbbae04a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:24.739469 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-05106159-a994-4010-a07b-94cbbbae04a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:24.740148 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-05106159-a994-4010-a07b-94cbbbae04a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:24.740592 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-05106159-a994-4010-a07b-94cbbbae04a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:24.741011 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-05106159-a994-4010-a07b-94cbbbae04a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:24.876840 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-05106159-a994-4010-a07b-94cbbbae04a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:24.886055 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-05106159-a994-4010-a07b-94cbbbae04a4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.158064 Aug 04 23:46:24.886637 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1132/2235] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:24 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:25.147294 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-eee5ecd2-470d-451e-9c49-c9d5e4f0d824 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:25.147870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-eee5ecd2-470d-451e-9c49-c9d5e4f0d824 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:25.154418 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eee5ecd2-470d-451e-9c49-c9d5e4f0d824 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:25.154903 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eee5ecd2-470d-451e-9c49-c9d5e4f0d824 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:25.155334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eee5ecd2-470d-451e-9c49-c9d5e4f0d824 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:25.156020 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eee5ecd2-470d-451e-9c49-c9d5e4f0d824 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:25.156468 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eee5ecd2-470d-451e-9c49-c9d5e4f0d824 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:25.156885 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eee5ecd2-470d-451e-9c49-c9d5e4f0d824 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:25.218304 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-eee5ecd2-470d-451e-9c49-c9d5e4f0d824 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:25.225929 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-eee5ecd2-470d-451e-9c49-c9d5e4f0d824 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.082558 Aug 04 23:46:25.227359 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1104/2236] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:25 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:25.906166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e9bfa622-14f7-464e-ac63-0561cfe4d33f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:25.906784 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e9bfa622-14f7-464e-ac63-0561cfe4d33f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:25.913510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e9bfa622-14f7-464e-ac63-0561cfe4d33f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:25.915220 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e9bfa622-14f7-464e-ac63-0561cfe4d33f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:25.915665 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e9bfa622-14f7-464e-ac63-0561cfe4d33f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:25.916354 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e9bfa622-14f7-464e-ac63-0561cfe4d33f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:25.916798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e9bfa622-14f7-464e-ac63-0561cfe4d33f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:25.917212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e9bfa622-14f7-464e-ac63-0561cfe4d33f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:26.048013 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e9bfa622-14f7-464e-ac63-0561cfe4d33f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:26.056769 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e9bfa622-14f7-464e-ac63-0561cfe4d33f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.154409 Aug 04 23:46:26.057330 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1133/2237] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:25 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:26.247892 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f1cf2c0d-d298-4d2d-bc23-272028632eec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:26.248427 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f1cf2c0d-d298-4d2d-bc23-272028632eec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:26.254948 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f1cf2c0d-d298-4d2d-bc23-272028632eec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:26.255437 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f1cf2c0d-d298-4d2d-bc23-272028632eec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:26.255869 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f1cf2c0d-d298-4d2d-bc23-272028632eec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:26.256555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f1cf2c0d-d298-4d2d-bc23-272028632eec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:26.257005 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f1cf2c0d-d298-4d2d-bc23-272028632eec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:26.257424 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f1cf2c0d-d298-4d2d-bc23-272028632eec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:26.325830 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f1cf2c0d-d298-4d2d-bc23-272028632eec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:26.334066 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f1cf2c0d-d298-4d2d-bc23-272028632eec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.090088 Aug 04 23:46:26.334663 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1105/2238] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:26 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:27.077715 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2fa0948d-3d14-4ed1-81bb-18d0352c1293 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:27.078326 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2fa0948d-3d14-4ed1-81bb-18d0352c1293 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:27.084900 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fa0948d-3d14-4ed1-81bb-18d0352c1293 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:27.085323 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fa0948d-3d14-4ed1-81bb-18d0352c1293 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:27.085809 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fa0948d-3d14-4ed1-81bb-18d0352c1293 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:27.086711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fa0948d-3d14-4ed1-81bb-18d0352c1293 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:27.087161 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fa0948d-3d14-4ed1-81bb-18d0352c1293 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:27.087582 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fa0948d-3d14-4ed1-81bb-18d0352c1293 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:27.216756 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2fa0948d-3d14-4ed1-81bb-18d0352c1293 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:27.224590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2fa0948d-3d14-4ed1-81bb-18d0352c1293 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.150769 Aug 04 23:46:27.225146 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1134/2239] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:27 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:27.355350 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8fea28d1-0d33-4875-a6cc-7403b1ef0dd8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:27.355887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8fea28d1-0d33-4875-a6cc-7403b1ef0dd8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:27.362249 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8fea28d1-0d33-4875-a6cc-7403b1ef0dd8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:27.362764 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8fea28d1-0d33-4875-a6cc-7403b1ef0dd8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:27.363200 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8fea28d1-0d33-4875-a6cc-7403b1ef0dd8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:27.363889 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8fea28d1-0d33-4875-a6cc-7403b1ef0dd8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:27.364343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8fea28d1-0d33-4875-a6cc-7403b1ef0dd8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:27.364765 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8fea28d1-0d33-4875-a6cc-7403b1ef0dd8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:27.427587 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8fea28d1-0d33-4875-a6cc-7403b1ef0dd8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:27.436462 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8fea28d1-0d33-4875-a6cc-7403b1ef0dd8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085153 Aug 04 23:46:27.437026 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1106/2240] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:27 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:28.246592 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5d384677-3a89-4476-b5d4-88b6057d339b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:28.247212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5d384677-3a89-4476-b5d4-88b6057d339b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:28.253701 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d384677-3a89-4476-b5d4-88b6057d339b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:28.254323 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d384677-3a89-4476-b5d4-88b6057d339b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:28.254651 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d384677-3a89-4476-b5d4-88b6057d339b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:28.255340 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d384677-3a89-4476-b5d4-88b6057d339b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:28.255792 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d384677-3a89-4476-b5d4-88b6057d339b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:28.256212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5d384677-3a89-4476-b5d4-88b6057d339b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:28.390802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5d384677-3a89-4476-b5d4-88b6057d339b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:28.400108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5d384677-3a89-4476-b5d4-88b6057d339b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.156652 Aug 04 23:46:28.400675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1135/2241] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:28 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:28.456957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-15fad373-25b5-43ac-a493-03e1b5781a0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:28.457568 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-15fad373-25b5-43ac-a493-03e1b5781a0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:28.464769 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-15fad373-25b5-43ac-a493-03e1b5781a0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:28.465250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-15fad373-25b5-43ac-a493-03e1b5781a0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:28.465687 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-15fad373-25b5-43ac-a493-03e1b5781a0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:28.466398 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-15fad373-25b5-43ac-a493-03e1b5781a0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:28.466856 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-15fad373-25b5-43ac-a493-03e1b5781a0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:28.467278 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-15fad373-25b5-43ac-a493-03e1b5781a0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:28.528930 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-15fad373-25b5-43ac-a493-03e1b5781a0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:28.536789 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-15fad373-25b5-43ac-a493-03e1b5781a0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083728 Aug 04 23:46:28.537353 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1107/2242] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:28 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:29.421629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2d53b1ab-ebb5-4e93-896d-54528a4b120e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:29.422592 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2d53b1ab-ebb5-4e93-896d-54528a4b120e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:29.428634 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2d53b1ab-ebb5-4e93-896d-54528a4b120e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:29.429119 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2d53b1ab-ebb5-4e93-896d-54528a4b120e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:29.429708 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2d53b1ab-ebb5-4e93-896d-54528a4b120e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:29.431047 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2d53b1ab-ebb5-4e93-896d-54528a4b120e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:29.431047 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2d53b1ab-ebb5-4e93-896d-54528a4b120e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:29.431378 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2d53b1ab-ebb5-4e93-896d-54528a4b120e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:29.557469 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7f78466f-ad22-4311-aba5-7622ab928b95 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:29.558110 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7f78466f-ad22-4311-aba5-7622ab928b95 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:29.562173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2d53b1ab-ebb5-4e93-896d-54528a4b120e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:29.564291 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7f78466f-ad22-4311-aba5-7622ab928b95 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:29.564767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7f78466f-ad22-4311-aba5-7622ab928b95 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:29.565198 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7f78466f-ad22-4311-aba5-7622ab928b95 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:29.565895 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7f78466f-ad22-4311-aba5-7622ab928b95 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:29.566482 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7f78466f-ad22-4311-aba5-7622ab928b95 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:29.566788 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7f78466f-ad22-4311-aba5-7622ab928b95 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:29.570998 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2d53b1ab-ebb5-4e93-896d-54528a4b120e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.152593 Aug 04 23:46:29.571344 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1136/2243] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:29 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:29.632515 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7f78466f-ad22-4311-aba5-7622ab928b95 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:29.640317 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7f78466f-ad22-4311-aba5-7622ab928b95 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086764 Aug 04 23:46:29.640883 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1108/2244] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:29 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:30.592550 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2fbc7a6a-5f24-4569-a1df-60a2b1d0a464 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:30.593353 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2fbc7a6a-5f24-4569-a1df-60a2b1d0a464 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:30.601226 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fbc7a6a-5f24-4569-a1df-60a2b1d0a464 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:30.601770 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fbc7a6a-5f24-4569-a1df-60a2b1d0a464 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:30.602942 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fbc7a6a-5f24-4569-a1df-60a2b1d0a464 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:30.603806 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fbc7a6a-5f24-4569-a1df-60a2b1d0a464 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:30.604273 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fbc7a6a-5f24-4569-a1df-60a2b1d0a464 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:30.604697 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2fbc7a6a-5f24-4569-a1df-60a2b1d0a464 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:30.661056 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4ca6fe89-3724-47bf-8c9b-c5a5da82300e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:30.661750 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4ca6fe89-3724-47bf-8c9b-c5a5da82300e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:30.668776 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ca6fe89-3724-47bf-8c9b-c5a5da82300e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:30.669257 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ca6fe89-3724-47bf-8c9b-c5a5da82300e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:30.669720 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ca6fe89-3724-47bf-8c9b-c5a5da82300e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:30.670444 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ca6fe89-3724-47bf-8c9b-c5a5da82300e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:30.670897 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ca6fe89-3724-47bf-8c9b-c5a5da82300e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:30.671345 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4ca6fe89-3724-47bf-8c9b-c5a5da82300e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:30.748953 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4ca6fe89-3724-47bf-8c9b-c5a5da82300e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:30.756751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4ca6fe89-3724-47bf-8c9b-c5a5da82300e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.099728 Aug 04 23:46:30.757337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1109/2245] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:30 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:46:30.767768 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2fbc7a6a-5f24-4569-a1df-60a2b1d0a464 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:30.776991 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2fbc7a6a-5f24-4569-a1df-60a2b1d0a464 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.188555 Aug 04 23:46:30.777570 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1137/2246] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:30 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:46:31.778239 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f42a6d62-d2b3-43bc-85bc-779dec786f0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:31.778955 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f42a6d62-d2b3-43bc-85bc-779dec786f0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:31.785814 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f42a6d62-d2b3-43bc-85bc-779dec786f0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:31.786299 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f42a6d62-d2b3-43bc-85bc-779dec786f0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:31.786758 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f42a6d62-d2b3-43bc-85bc-779dec786f0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:31.787451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f42a6d62-d2b3-43bc-85bc-779dec786f0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:31.787905 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f42a6d62-d2b3-43bc-85bc-779dec786f0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:31.788592 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f42a6d62-d2b3-43bc-85bc-779dec786f0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:31.799108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9ff54c82-2585-49b3-86a6-7e63efa21e7c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:31.799890 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9ff54c82-2585-49b3-86a6-7e63efa21e7c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:31.807175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ff54c82-2585-49b3-86a6-7e63efa21e7c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:31.807653 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ff54c82-2585-49b3-86a6-7e63efa21e7c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:31.808083 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ff54c82-2585-49b3-86a6-7e63efa21e7c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:31.808795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ff54c82-2585-49b3-86a6-7e63efa21e7c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:31.809241 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ff54c82-2585-49b3-86a6-7e63efa21e7c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:31.809654 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9ff54c82-2585-49b3-86a6-7e63efa21e7c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:31.866751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f42a6d62-d2b3-43bc-85bc-779dec786f0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:31.874346 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f42a6d62-d2b3-43bc-85bc-779dec786f0e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.100513 Aug 04 23:46:31.874940 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1110/2247] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:31 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:31.954765 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9ff54c82-2585-49b3-86a6-7e63efa21e7c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:31.964024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9ff54c82-2585-49b3-86a6-7e63efa21e7c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.168894 Aug 04 23:46:31.964591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1138/2248] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:31 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:32.895696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9b3e949c-a469-4d3f-bedc-cb7c0bcecfd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:32.896345 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9b3e949c-a469-4d3f-bedc-cb7c0bcecfd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:32.903147 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9b3e949c-a469-4d3f-bedc-cb7c0bcecfd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:32.903650 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9b3e949c-a469-4d3f-bedc-cb7c0bcecfd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:32.904804 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9b3e949c-a469-4d3f-bedc-cb7c0bcecfd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:32.905493 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9b3e949c-a469-4d3f-bedc-cb7c0bcecfd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:32.905948 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9b3e949c-a469-4d3f-bedc-cb7c0bcecfd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:32.906384 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9b3e949c-a469-4d3f-bedc-cb7c0bcecfd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:32.921832 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:46:32.968863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9b3e949c-a469-4d3f-bedc-cb7c0bcecfd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:32.976421 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9b3e949c-a469-4d3f-bedc-cb7c0bcecfd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084607 Aug 04 23:46:32.976980 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1111/2249] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:32 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:32.985022 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c15b9f18-8065-4d47-a287-83538f23435f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:32.985669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c15b9f18-8065-4d47-a287-83538f23435f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:32.992355 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c15b9f18-8065-4d47-a287-83538f23435f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:32.992834 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c15b9f18-8065-4d47-a287-83538f23435f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:32.993851 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c15b9f18-8065-4d47-a287-83538f23435f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:32.994629 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c15b9f18-8065-4d47-a287-83538f23435f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:32.995075 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c15b9f18-8065-4d47-a287-83538f23435f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:32.995496 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c15b9f18-8065-4d47-a287-83538f23435f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:33.126973 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c15b9f18-8065-4d47-a287-83538f23435f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:33.134903 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c15b9f18-8065-4d47-a287-83538f23435f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.153855 Aug 04 23:46:33.135486 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1139/2250] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:32 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:33.998246 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b803cd32-163d-4cb2-b91c-3a0d60b24fe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:33.999016 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b803cd32-163d-4cb2-b91c-3a0d60b24fe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:34.005282 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b803cd32-163d-4cb2-b91c-3a0d60b24fe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:34.005764 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b803cd32-163d-4cb2-b91c-3a0d60b24fe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:34.006195 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b803cd32-163d-4cb2-b91c-3a0d60b24fe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:34.006912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b803cd32-163d-4cb2-b91c-3a0d60b24fe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:34.007371 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b803cd32-163d-4cb2-b91c-3a0d60b24fe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:34.007801 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b803cd32-163d-4cb2-b91c-3a0d60b24fe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:34.072674 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b803cd32-163d-4cb2-b91c-3a0d60b24fe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:34.081012 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b803cd32-163d-4cb2-b91c-3a0d60b24fe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087192 Aug 04 23:46:34.081578 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1112/2251] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:33 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:34.156787 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c57bafb8-0c0a-4684-81ce-db441dd3c208 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:34.157358 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c57bafb8-0c0a-4684-81ce-db441dd3c208 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:34.164186 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c57bafb8-0c0a-4684-81ce-db441dd3c208 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:34.164667 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c57bafb8-0c0a-4684-81ce-db441dd3c208 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:34.165106 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c57bafb8-0c0a-4684-81ce-db441dd3c208 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:34.165791 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c57bafb8-0c0a-4684-81ce-db441dd3c208 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:34.166246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c57bafb8-0c0a-4684-81ce-db441dd3c208 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:34.166699 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c57bafb8-0c0a-4684-81ce-db441dd3c208 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:34.296418 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c57bafb8-0c0a-4684-81ce-db441dd3c208 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:34.304431 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c57bafb8-0c0a-4684-81ce-db441dd3c208 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.151584 Aug 04 23:46:34.304998 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1140/2252] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:34 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:35.100933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a144357a-a7cb-4d6c-8119-c9663e3626d8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:35.101537 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a144357a-a7cb-4d6c-8119-c9663e3626d8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:35.108601 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a144357a-a7cb-4d6c-8119-c9663e3626d8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:35.109007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a144357a-a7cb-4d6c-8119-c9663e3626d8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:35.109434 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a144357a-a7cb-4d6c-8119-c9663e3626d8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:35.110123 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a144357a-a7cb-4d6c-8119-c9663e3626d8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:35.110591 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a144357a-a7cb-4d6c-8119-c9663e3626d8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:35.111007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a144357a-a7cb-4d6c-8119-c9663e3626d8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:35.175964 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a144357a-a7cb-4d6c-8119-c9663e3626d8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:35.183845 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a144357a-a7cb-4d6c-8119-c9663e3626d8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086844 Aug 04 23:46:35.184401 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1113/2253] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:35 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:35.326700 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3b0f1ca7-c611-4317-9050-01beecd39783 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:35.327479 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3b0f1ca7-c611-4317-9050-01beecd39783 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:35.334207 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b0f1ca7-c611-4317-9050-01beecd39783 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:35.334711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b0f1ca7-c611-4317-9050-01beecd39783 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:35.335169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b0f1ca7-c611-4317-9050-01beecd39783 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:35.335852 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b0f1ca7-c611-4317-9050-01beecd39783 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:35.336296 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b0f1ca7-c611-4317-9050-01beecd39783 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:35.336715 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b0f1ca7-c611-4317-9050-01beecd39783 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:35.466896 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3b0f1ca7-c611-4317-9050-01beecd39783 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:35.474796 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3b0f1ca7-c611-4317-9050-01beecd39783 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.153193 Aug 04 23:46:35.475360 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1141/2254] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:35 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:36.204641 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-39ae25ed-3e52-4c69-af20-1930cef1f612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:36.205290 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-39ae25ed-3e52-4c69-af20-1930cef1f612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:36.211730 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39ae25ed-3e52-4c69-af20-1930cef1f612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:36.212210 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39ae25ed-3e52-4c69-af20-1930cef1f612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:36.212643 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39ae25ed-3e52-4c69-af20-1930cef1f612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:36.213333 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39ae25ed-3e52-4c69-af20-1930cef1f612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:36.213808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39ae25ed-3e52-4c69-af20-1930cef1f612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:36.214820 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-39ae25ed-3e52-4c69-af20-1930cef1f612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:36.278107 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-39ae25ed-3e52-4c69-af20-1930cef1f612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:36.285868 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-39ae25ed-3e52-4c69-af20-1930cef1f612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084861 Aug 04 23:46:36.286437 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1114/2255] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:36 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:36.497823 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e51ae038-e21d-4ae9-a41c-17aec9811e76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:36.498561 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e51ae038-e21d-4ae9-a41c-17aec9811e76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:36.505141 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e51ae038-e21d-4ae9-a41c-17aec9811e76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:36.505628 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e51ae038-e21d-4ae9-a41c-17aec9811e76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:36.506064 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e51ae038-e21d-4ae9-a41c-17aec9811e76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:36.506784 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e51ae038-e21d-4ae9-a41c-17aec9811e76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:36.507238 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e51ae038-e21d-4ae9-a41c-17aec9811e76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:36.507667 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e51ae038-e21d-4ae9-a41c-17aec9811e76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:36.510243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:46:36.661663 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e51ae038-e21d-4ae9-a41c-17aec9811e76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:36.670146 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e51ae038-e21d-4ae9-a41c-17aec9811e76 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.177390 Aug 04 23:46:36.670745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1142/2256] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:36 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:37.307366 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d8581589-1ed2-4256-b5aa-7575e75870ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:37.308175 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d8581589-1ed2-4256-b5aa-7575e75870ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:37.314632 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d8581589-1ed2-4256-b5aa-7575e75870ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:37.315107 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d8581589-1ed2-4256-b5aa-7575e75870ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:37.315533 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d8581589-1ed2-4256-b5aa-7575e75870ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:37.316243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d8581589-1ed2-4256-b5aa-7575e75870ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:37.316692 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d8581589-1ed2-4256-b5aa-7575e75870ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:37.317108 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d8581589-1ed2-4256-b5aa-7575e75870ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:37.378753 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d8581589-1ed2-4256-b5aa-7575e75870ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:37.386891 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d8581589-1ed2-4256-b5aa-7575e75870ec tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083402 Aug 04 23:46:37.387442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1115/2257] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:37 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:37.692092 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-707cbc75-5ab9-4e9b-a60d-364c5994fcc2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:37.692724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-707cbc75-5ab9-4e9b-a60d-364c5994fcc2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:37.700440 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-707cbc75-5ab9-4e9b-a60d-364c5994fcc2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:37.700913 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-707cbc75-5ab9-4e9b-a60d-364c5994fcc2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:37.701343 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-707cbc75-5ab9-4e9b-a60d-364c5994fcc2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:37.702052 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-707cbc75-5ab9-4e9b-a60d-364c5994fcc2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:37.702534 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-707cbc75-5ab9-4e9b-a60d-364c5994fcc2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:37.702960 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-707cbc75-5ab9-4e9b-a60d-364c5994fcc2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:37.833014 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-707cbc75-5ab9-4e9b-a60d-364c5994fcc2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:37.841438 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-707cbc75-5ab9-4e9b-a60d-364c5994fcc2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.153345 Aug 04 23:46:37.842015 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1143/2258] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:37 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:38.408082 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-555fe99e-07ee-4758-a701-d19de579f3cb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:38.408646 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-555fe99e-07ee-4758-a701-d19de579f3cb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:38.415271 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-555fe99e-07ee-4758-a701-d19de579f3cb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:38.415744 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-555fe99e-07ee-4758-a701-d19de579f3cb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:38.416173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-555fe99e-07ee-4758-a701-d19de579f3cb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:38.416884 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-555fe99e-07ee-4758-a701-d19de579f3cb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:38.418142 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-555fe99e-07ee-4758-a701-d19de579f3cb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:38.418596 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-555fe99e-07ee-4758-a701-d19de579f3cb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:38.483404 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-555fe99e-07ee-4758-a701-d19de579f3cb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:38.491076 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-555fe99e-07ee-4758-a701-d19de579f3cb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086958 Aug 04 23:46:38.491637 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1116/2259] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:38 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:38.862560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6149ab61-a82c-4572-9c64-1747736efa13 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:38.863170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6149ab61-a82c-4572-9c64-1747736efa13 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:38.869561 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6149ab61-a82c-4572-9c64-1747736efa13 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:38.870035 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6149ab61-a82c-4572-9c64-1747736efa13 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:38.870524 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6149ab61-a82c-4572-9c64-1747736efa13 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:38.871233 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6149ab61-a82c-4572-9c64-1747736efa13 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:38.871680 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6149ab61-a82c-4572-9c64-1747736efa13 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:38.872101 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6149ab61-a82c-4572-9c64-1747736efa13 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:39.005317 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6149ab61-a82c-4572-9c64-1747736efa13 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:39.013959 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6149ab61-a82c-4572-9c64-1747736efa13 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.155240 Aug 04 23:46:39.014541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1144/2260] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:38 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:39.513445 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-dbb34a02-9ad9-4075-b656-a62b5e9dfaa3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:39.514239 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-dbb34a02-9ad9-4075-b656-a62b5e9dfaa3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:39.520428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dbb34a02-9ad9-4075-b656-a62b5e9dfaa3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:39.520938 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dbb34a02-9ad9-4075-b656-a62b5e9dfaa3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:39.521326 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dbb34a02-9ad9-4075-b656-a62b5e9dfaa3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:39.522001 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dbb34a02-9ad9-4075-b656-a62b5e9dfaa3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:39.522806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dbb34a02-9ad9-4075-b656-a62b5e9dfaa3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:39.523262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dbb34a02-9ad9-4075-b656-a62b5e9dfaa3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:39.586158 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-dbb34a02-9ad9-4075-b656-a62b5e9dfaa3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:39.594020 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-dbb34a02-9ad9-4075-b656-a62b5e9dfaa3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084837 Aug 04 23:46:39.594619 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1117/2261] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:39 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:40.035519 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3eddd595-9706-4a6d-9e67-f27921885057 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:40.036416 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3eddd595-9706-4a6d-9e67-f27921885057 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:40.043461 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3eddd595-9706-4a6d-9e67-f27921885057 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:40.043952 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3eddd595-9706-4a6d-9e67-f27921885057 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:40.044384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3eddd595-9706-4a6d-9e67-f27921885057 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:40.045161 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3eddd595-9706-4a6d-9e67-f27921885057 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:40.045615 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3eddd595-9706-4a6d-9e67-f27921885057 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:40.046045 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3eddd595-9706-4a6d-9e67-f27921885057 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:40.182940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3eddd595-9706-4a6d-9e67-f27921885057 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:40.192358 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3eddd595-9706-4a6d-9e67-f27921885057 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.160906 Aug 04 23:46:40.192944 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1145/2262] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:40 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:40.615362 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-00a53d57-c8dc-471e-a5a0-054aec550786 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:40.615980 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-00a53d57-c8dc-471e-a5a0-054aec550786 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:40.622823 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-00a53d57-c8dc-471e-a5a0-054aec550786 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:40.623303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-00a53d57-c8dc-471e-a5a0-054aec550786 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:40.623735 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-00a53d57-c8dc-471e-a5a0-054aec550786 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:40.624422 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-00a53d57-c8dc-471e-a5a0-054aec550786 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:40.624870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-00a53d57-c8dc-471e-a5a0-054aec550786 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:40.625289 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-00a53d57-c8dc-471e-a5a0-054aec550786 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:40.689600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-00a53d57-c8dc-471e-a5a0-054aec550786 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:40.697198 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-00a53d57-c8dc-471e-a5a0-054aec550786 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085801 Aug 04 23:46:40.697756 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1118/2263] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:40 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:41.213562 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e85c0dcc-d9a2-4031-83bd-5cf347cc5b14 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:41.214182 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e85c0dcc-d9a2-4031-83bd-5cf347cc5b14 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:41.221304 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e85c0dcc-d9a2-4031-83bd-5cf347cc5b14 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:41.221778 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e85c0dcc-d9a2-4031-83bd-5cf347cc5b14 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:41.222209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e85c0dcc-d9a2-4031-83bd-5cf347cc5b14 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:41.222923 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e85c0dcc-d9a2-4031-83bd-5cf347cc5b14 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:41.223372 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e85c0dcc-d9a2-4031-83bd-5cf347cc5b14 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:41.223794 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e85c0dcc-d9a2-4031-83bd-5cf347cc5b14 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:41.360575 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e85c0dcc-d9a2-4031-83bd-5cf347cc5b14 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:41.368637 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e85c0dcc-d9a2-4031-83bd-5cf347cc5b14 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.159034 Aug 04 23:46:41.369211 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1146/2264] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:41 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:41.717928 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-02134023-1f8b-4e89-b6cb-fc645be71b83 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:41.718561 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-02134023-1f8b-4e89-b6cb-fc645be71b83 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:41.725841 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02134023-1f8b-4e89-b6cb-fc645be71b83 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:41.726334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02134023-1f8b-4e89-b6cb-fc645be71b83 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:41.726796 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02134023-1f8b-4e89-b6cb-fc645be71b83 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:41.727489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02134023-1f8b-4e89-b6cb-fc645be71b83 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:41.727940 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02134023-1f8b-4e89-b6cb-fc645be71b83 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:41.728360 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02134023-1f8b-4e89-b6cb-fc645be71b83 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:41.797404 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-02134023-1f8b-4e89-b6cb-fc645be71b83 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:41.805297 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-02134023-1f8b-4e89-b6cb-fc645be71b83 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.091217 Aug 04 23:46:41.805872 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1119/2265] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:41 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:42.391315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-22242cb0-eaf4-407e-a678-d551876ce436 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:42.391877 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-22242cb0-eaf4-407e-a678-d551876ce436 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:42.398697 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-22242cb0-eaf4-407e-a678-d551876ce436 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:42.399214 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-22242cb0-eaf4-407e-a678-d551876ce436 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:42.399685 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-22242cb0-eaf4-407e-a678-d551876ce436 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:42.400349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-22242cb0-eaf4-407e-a678-d551876ce436 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:42.400806 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-22242cb0-eaf4-407e-a678-d551876ce436 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:42.401226 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-22242cb0-eaf4-407e-a678-d551876ce436 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:42.540409 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-22242cb0-eaf4-407e-a678-d551876ce436 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:42.549419 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-22242cb0-eaf4-407e-a678-d551876ce436 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.162055 Aug 04 23:46:42.550001 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1147/2266] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:42 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:42.827263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-33d9b765-e4e1-4b9f-9ec9-0a8870743499 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:42.827876 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-33d9b765-e4e1-4b9f-9ec9-0a8870743499 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:42.835451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33d9b765-e4e1-4b9f-9ec9-0a8870743499 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:42.835966 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33d9b765-e4e1-4b9f-9ec9-0a8870743499 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:42.836392 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33d9b765-e4e1-4b9f-9ec9-0a8870743499 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:42.837218 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33d9b765-e4e1-4b9f-9ec9-0a8870743499 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:42.837792 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33d9b765-e4e1-4b9f-9ec9-0a8870743499 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:42.838209 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-33d9b765-e4e1-4b9f-9ec9-0a8870743499 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:42.904591 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-33d9b765-e4e1-4b9f-9ec9-0a8870743499 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:42.913656 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-33d9b765-e4e1-4b9f-9ec9-0a8870743499 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.090901 Aug 04 23:46:42.914159 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1120/2267] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:42 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:43.571176 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6aff1dd5-ccb9-4c1a-b10e-53960ef9f48c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:43.571784 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6aff1dd5-ccb9-4c1a-b10e-53960ef9f48c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:43.579110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6aff1dd5-ccb9-4c1a-b10e-53960ef9f48c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:43.579588 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6aff1dd5-ccb9-4c1a-b10e-53960ef9f48c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:43.580020 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6aff1dd5-ccb9-4c1a-b10e-53960ef9f48c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:43.580714 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6aff1dd5-ccb9-4c1a-b10e-53960ef9f48c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:43.581162 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6aff1dd5-ccb9-4c1a-b10e-53960ef9f48c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:43.581584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6aff1dd5-ccb9-4c1a-b10e-53960ef9f48c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:43.732358 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6aff1dd5-ccb9-4c1a-b10e-53960ef9f48c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:43.740581 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6aff1dd5-ccb9-4c1a-b10e-53960ef9f48c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.173206 Aug 04 23:46:43.741174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1148/2268] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:43 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:43.935864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-075dbac2-2ecb-4206-981d-4dadb40cf63b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:43.936482 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-075dbac2-2ecb-4206-981d-4dadb40cf63b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:43.942891 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-075dbac2-2ecb-4206-981d-4dadb40cf63b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:43.943369 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-075dbac2-2ecb-4206-981d-4dadb40cf63b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:43.943799 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-075dbac2-2ecb-4206-981d-4dadb40cf63b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:43.944485 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-075dbac2-2ecb-4206-981d-4dadb40cf63b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:43.944928 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-075dbac2-2ecb-4206-981d-4dadb40cf63b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:43.945345 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-075dbac2-2ecb-4206-981d-4dadb40cf63b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:44.007950 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-075dbac2-2ecb-4206-981d-4dadb40cf63b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:44.015578 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-075dbac2-2ecb-4206-981d-4dadb40cf63b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084137 Aug 04 23:46:44.016161 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1121/2269] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:43 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:44.763303 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ea621e69-7ad2-4ca2-9557-a8b71a0f83c7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:44.763909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ea621e69-7ad2-4ca2-9557-a8b71a0f83c7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:44.770652 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ea621e69-7ad2-4ca2-9557-a8b71a0f83c7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:44.771133 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ea621e69-7ad2-4ca2-9557-a8b71a0f83c7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:44.771574 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ea621e69-7ad2-4ca2-9557-a8b71a0f83c7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:44.772257 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ea621e69-7ad2-4ca2-9557-a8b71a0f83c7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:44.772709 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ea621e69-7ad2-4ca2-9557-a8b71a0f83c7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:44.773134 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ea621e69-7ad2-4ca2-9557-a8b71a0f83c7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:44.910430 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ea621e69-7ad2-4ca2-9557-a8b71a0f83c7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:44.920623 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ea621e69-7ad2-4ca2-9557-a8b71a0f83c7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.161788 Aug 04 23:46:44.921275 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1149/2270] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:44 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:45.035894 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-eea129f0-08ee-4b31-8b4a-b524faa034e1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:45.036741 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-eea129f0-08ee-4b31-8b4a-b524faa034e1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:45.043636 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eea129f0-08ee-4b31-8b4a-b524faa034e1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:45.044201 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eea129f0-08ee-4b31-8b4a-b524faa034e1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:45.044632 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eea129f0-08ee-4b31-8b4a-b524faa034e1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:45.045318 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eea129f0-08ee-4b31-8b4a-b524faa034e1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:45.045763 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eea129f0-08ee-4b31-8b4a-b524faa034e1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:45.046181 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eea129f0-08ee-4b31-8b4a-b524faa034e1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:45.113951 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-eea129f0-08ee-4b31-8b4a-b524faa034e1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:45.123318 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-eea129f0-08ee-4b31-8b4a-b524faa034e1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.091238 Aug 04 23:46:45.123885 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1122/2271] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:45 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:45.945201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4e3ca2fb-4468-4700-a473-10c5d4822c36 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:45.945767 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4e3ca2fb-4468-4700-a473-10c5d4822c36 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:45.952962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e3ca2fb-4468-4700-a473-10c5d4822c36 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:45.953508 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e3ca2fb-4468-4700-a473-10c5d4822c36 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:45.953948 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e3ca2fb-4468-4700-a473-10c5d4822c36 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:45.954803 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e3ca2fb-4468-4700-a473-10c5d4822c36 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:45.955344 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e3ca2fb-4468-4700-a473-10c5d4822c36 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:45.955769 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e3ca2fb-4468-4700-a473-10c5d4822c36 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:46.100884 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4e3ca2fb-4468-4700-a473-10c5d4822c36 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:46.111512 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4e3ca2fb-4468-4700-a473-10c5d4822c36 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.170282 Aug 04 23:46:46.112226 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1150/2272] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:45 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:46.145227 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1b674845-ba2b-4c50-8a29-2aa067b75ef3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:46.145854 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1b674845-ba2b-4c50-8a29-2aa067b75ef3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:46.153065 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b674845-ba2b-4c50-8a29-2aa067b75ef3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:46.153597 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b674845-ba2b-4c50-8a29-2aa067b75ef3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:46.154035 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b674845-ba2b-4c50-8a29-2aa067b75ef3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:46.154778 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b674845-ba2b-4c50-8a29-2aa067b75ef3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:46.155232 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b674845-ba2b-4c50-8a29-2aa067b75ef3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:46.155650 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b674845-ba2b-4c50-8a29-2aa067b75ef3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:46.218322 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1b674845-ba2b-4c50-8a29-2aa067b75ef3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:46.225973 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1b674845-ba2b-4c50-8a29-2aa067b75ef3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085084 Aug 04 23:46:46.226558 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1123/2273] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:46 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:47.133621 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0fd25180-9364-4c83-aa94-8389e8a756c0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:47.134215 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0fd25180-9364-4c83-aa94-8389e8a756c0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:47.140739 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0fd25180-9364-4c83-aa94-8389e8a756c0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:47.141232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0fd25180-9364-4c83-aa94-8389e8a756c0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:47.141672 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0fd25180-9364-4c83-aa94-8389e8a756c0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:47.142385 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0fd25180-9364-4c83-aa94-8389e8a756c0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:47.142841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0fd25180-9364-4c83-aa94-8389e8a756c0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:47.143269 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0fd25180-9364-4c83-aa94-8389e8a756c0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:47.247120 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1c18c23e-f946-432f-a896-d1b420b91139 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:47.247857 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1c18c23e-f946-432f-a896-d1b420b91139 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:47.254020 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1c18c23e-f946-432f-a896-d1b420b91139 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:47.254598 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1c18c23e-f946-432f-a896-d1b420b91139 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:47.255093 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1c18c23e-f946-432f-a896-d1b420b91139 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:47.255787 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1c18c23e-f946-432f-a896-d1b420b91139 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:47.256342 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1c18c23e-f946-432f-a896-d1b420b91139 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:47.256759 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1c18c23e-f946-432f-a896-d1b420b91139 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:47.276157 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0fd25180-9364-4c83-aa94-8389e8a756c0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:47.284777 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0fd25180-9364-4c83-aa94-8389e8a756c0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.155060 Aug 04 23:46:47.285348 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1151/2274] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:47 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:47.318839 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1c18c23e-f946-432f-a896-d1b420b91139 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:47.326828 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1c18c23e-f946-432f-a896-d1b420b91139 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083714 Aug 04 23:46:47.327401 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1124/2275] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:47 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:46:48.306763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-bedbb597-e4b7-471b-a4f1-4727b6886777 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:48.307405 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-bedbb597-e4b7-471b-a4f1-4727b6886777 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:48.314181 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bedbb597-e4b7-471b-a4f1-4727b6886777 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:48.314682 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bedbb597-e4b7-471b-a4f1-4727b6886777 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:48.315112 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bedbb597-e4b7-471b-a4f1-4727b6886777 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:48.315797 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bedbb597-e4b7-471b-a4f1-4727b6886777 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:48.316240 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bedbb597-e4b7-471b-a4f1-4727b6886777 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:48.316658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bedbb597-e4b7-471b-a4f1-4727b6886777 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:48.348203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3b0c74ae-407f-4bbd-ae69-e361a884c470 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:48.348933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3b0c74ae-407f-4bbd-ae69-e361a884c470 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:48.355338 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3b0c74ae-407f-4bbd-ae69-e361a884c470 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:48.355817 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3b0c74ae-407f-4bbd-ae69-e361a884c470 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:48.357560 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3b0c74ae-407f-4bbd-ae69-e361a884c470 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:48.358286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3b0c74ae-407f-4bbd-ae69-e361a884c470 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:48.358779 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3b0c74ae-407f-4bbd-ae69-e361a884c470 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:48.359203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3b0c74ae-407f-4bbd-ae69-e361a884c470 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:48.432629 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3b0c74ae-407f-4bbd-ae69-e361a884c470 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:48.440397 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3b0c74ae-407f-4bbd-ae69-e361a884c470 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.095978 Aug 04 23:46:48.440969 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1125/2276] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:48 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:46:48.468942 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-bedbb597-e4b7-471b-a4f1-4727b6886777 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:48.476872 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-bedbb597-e4b7-471b-a4f1-4727b6886777 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.173985 Aug 04 23:46:48.477433 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1152/2277] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:48 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:49.461417 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-eb78fae7-e6c0-40cc-9c3d-3cd32b15cc35 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:49.462037 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-eb78fae7-e6c0-40cc-9c3d-3cd32b15cc35 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:49.469131 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eb78fae7-e6c0-40cc-9c3d-3cd32b15cc35 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:49.469606 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eb78fae7-e6c0-40cc-9c3d-3cd32b15cc35 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:49.470030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eb78fae7-e6c0-40cc-9c3d-3cd32b15cc35 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:49.470748 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eb78fae7-e6c0-40cc-9c3d-3cd32b15cc35 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:49.471196 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eb78fae7-e6c0-40cc-9c3d-3cd32b15cc35 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:49.471608 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eb78fae7-e6c0-40cc-9c3d-3cd32b15cc35 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:49.499821 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-43663d63-7601-4405-b2ca-fd8136311f15 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:49.500412 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-43663d63-7601-4405-b2ca-fd8136311f15 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:49.507067 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-43663d63-7601-4405-b2ca-fd8136311f15 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:49.507556 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-43663d63-7601-4405-b2ca-fd8136311f15 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:49.508004 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-43663d63-7601-4405-b2ca-fd8136311f15 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:49.508699 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-43663d63-7601-4405-b2ca-fd8136311f15 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:49.509158 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-43663d63-7601-4405-b2ca-fd8136311f15 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:49.509645 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-43663d63-7601-4405-b2ca-fd8136311f15 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:49.538083 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-eb78fae7-e6c0-40cc-9c3d-3cd32b15cc35 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:49.546390 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-eb78fae7-e6c0-40cc-9c3d-3cd32b15cc35 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.088674 Aug 04 23:46:49.547015 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1126/2278] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:49 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:49.641094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-43663d63-7601-4405-b2ca-fd8136311f15 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:49.649177 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-43663d63-7601-4405-b2ca-fd8136311f15 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.153770 Aug 04 23:46:49.649739 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1153/2279] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:49 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:46:50.569124 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e1b098ce-3b97-4711-933c-c7cb5d4112f8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:50.569766 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e1b098ce-3b97-4711-933c-c7cb5d4112f8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:50.576692 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1b098ce-3b97-4711-933c-c7cb5d4112f8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:50.577162 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1b098ce-3b97-4711-933c-c7cb5d4112f8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:50.577591 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1b098ce-3b97-4711-933c-c7cb5d4112f8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:50.578272 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1b098ce-3b97-4711-933c-c7cb5d4112f8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:50.578750 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1b098ce-3b97-4711-933c-c7cb5d4112f8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:50.579165 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e1b098ce-3b97-4711-933c-c7cb5d4112f8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:50.640460 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e1b098ce-3b97-4711-933c-c7cb5d4112f8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:50.648042 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e1b098ce-3b97-4711-933c-c7cb5d4112f8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.082884 Aug 04 23:46:50.648610 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1127/2280] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:50 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:50.671099 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-fd832a1a-83b7-43a8-bd8b-a94d9e185e3c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:50.671718 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-fd832a1a-83b7-43a8-bd8b-a94d9e185e3c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:50.678146 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fd832a1a-83b7-43a8-bd8b-a94d9e185e3c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:50.678674 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fd832a1a-83b7-43a8-bd8b-a94d9e185e3c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:50.679114 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fd832a1a-83b7-43a8-bd8b-a94d9e185e3c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:50.679811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fd832a1a-83b7-43a8-bd8b-a94d9e185e3c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:50.680546 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fd832a1a-83b7-43a8-bd8b-a94d9e185e3c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:50.680982 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fd832a1a-83b7-43a8-bd8b-a94d9e185e3c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:50.817218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-fd832a1a-83b7-43a8-bd8b-a94d9e185e3c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:50.825946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-fd832a1a-83b7-43a8-bd8b-a94d9e185e3c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.158272 Aug 04 23:46:50.826672 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1154/2281] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:50 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:51.669623 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6cb20952-fe1b-4aa4-b750-87f0802396b4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:51.670666 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6cb20952-fe1b-4aa4-b750-87f0802396b4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:51.677306 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6cb20952-fe1b-4aa4-b750-87f0802396b4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:51.677792 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6cb20952-fe1b-4aa4-b750-87f0802396b4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:51.678228 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6cb20952-fe1b-4aa4-b750-87f0802396b4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:51.678948 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6cb20952-fe1b-4aa4-b750-87f0802396b4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:51.679409 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6cb20952-fe1b-4aa4-b750-87f0802396b4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:51.679834 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6cb20952-fe1b-4aa4-b750-87f0802396b4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:51.682501 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:46:51.743501 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6cb20952-fe1b-4aa4-b750-87f0802396b4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:51.751869 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6cb20952-fe1b-4aa4-b750-87f0802396b4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086699 Aug 04 23:46:51.752500 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1128/2282] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:51 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:46:51.847917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4e8f9cfc-fcfa-46d4-b106-73b41449fc89 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:51.848535 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4e8f9cfc-fcfa-46d4-b106-73b41449fc89 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:51.854975 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e8f9cfc-fcfa-46d4-b106-73b41449fc89 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:51.855453 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e8f9cfc-fcfa-46d4-b106-73b41449fc89 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:51.855888 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e8f9cfc-fcfa-46d4-b106-73b41449fc89 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:51.856573 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e8f9cfc-fcfa-46d4-b106-73b41449fc89 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:51.857749 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e8f9cfc-fcfa-46d4-b106-73b41449fc89 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:51.858179 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4e8f9cfc-fcfa-46d4-b106-73b41449fc89 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:51.993656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4e8f9cfc-fcfa-46d4-b106-73b41449fc89 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:52.003404 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4e8f9cfc-fcfa-46d4-b106-73b41449fc89 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.159183 Aug 04 23:46:52.004187 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1155/2283] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:51 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:52.772641 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7fc2802e-ffb7-41cf-858a-65e0be7eed00 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:52.773246 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7fc2802e-ffb7-41cf-858a-65e0be7eed00 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:52.775110 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=56 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:46:52.780908 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7fc2802e-ffb7-41cf-858a-65e0be7eed00 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:52.781395 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7fc2802e-ffb7-41cf-858a-65e0be7eed00 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:52.781832 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7fc2802e-ffb7-41cf-858a-65e0be7eed00 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:52.782590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7fc2802e-ffb7-41cf-858a-65e0be7eed00 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:52.783076 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7fc2802e-ffb7-41cf-858a-65e0be7eed00 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:52.783503 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7fc2802e-ffb7-41cf-858a-65e0be7eed00 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:52.849853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7fc2802e-ffb7-41cf-858a-65e0be7eed00 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:52.858486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7fc2802e-ffb7-41cf-858a-65e0be7eed00 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.089520 Aug 04 23:46:52.859068 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1129/2284] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:52 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:53.024979 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0b94c87e-efbe-45bf-8fb5-1df7dc7c44a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:53.025574 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0b94c87e-efbe-45bf-8fb5-1df7dc7c44a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:53.032268 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0b94c87e-efbe-45bf-8fb5-1df7dc7c44a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:53.032744 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0b94c87e-efbe-45bf-8fb5-1df7dc7c44a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:53.033171 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0b94c87e-efbe-45bf-8fb5-1df7dc7c44a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:53.033861 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0b94c87e-efbe-45bf-8fb5-1df7dc7c44a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:53.034301 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0b94c87e-efbe-45bf-8fb5-1df7dc7c44a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:53.034744 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0b94c87e-efbe-45bf-8fb5-1df7dc7c44a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:53.167609 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0b94c87e-efbe-45bf-8fb5-1df7dc7c44a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:53.176196 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0b94c87e-efbe-45bf-8fb5-1df7dc7c44a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.155200 Aug 04 23:46:53.176758 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1156/2285] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:53 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:53.879496 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-23d1b1f4-652a-4127-9c12-8d3453336e38 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:53.880084 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-23d1b1f4-652a-4127-9c12-8d3453336e38 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:53.886401 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23d1b1f4-652a-4127-9c12-8d3453336e38 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:53.886868 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23d1b1f4-652a-4127-9c12-8d3453336e38 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:53.887295 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23d1b1f4-652a-4127-9c12-8d3453336e38 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:53.887965 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23d1b1f4-652a-4127-9c12-8d3453336e38 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:53.888409 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23d1b1f4-652a-4127-9c12-8d3453336e38 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:53.889344 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-23d1b1f4-652a-4127-9c12-8d3453336e38 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:53.953423 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-23d1b1f4-652a-4127-9c12-8d3453336e38 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:53.960903 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-23d1b1f4-652a-4127-9c12-8d3453336e38 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085347 Aug 04 23:46:53.961464 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1130/2286] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:53 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:54.197330 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-654365e1-5d65-4799-bc6d-2348f7ad2ff7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:54.197936 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-654365e1-5d65-4799-bc6d-2348f7ad2ff7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:54.199956 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=52 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:46:54.205509 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-654365e1-5d65-4799-bc6d-2348f7ad2ff7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:54.205982 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-654365e1-5d65-4799-bc6d-2348f7ad2ff7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:54.206433 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-654365e1-5d65-4799-bc6d-2348f7ad2ff7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:54.207115 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-654365e1-5d65-4799-bc6d-2348f7ad2ff7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:54.207563 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-654365e1-5d65-4799-bc6d-2348f7ad2ff7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:54.207977 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-654365e1-5d65-4799-bc6d-2348f7ad2ff7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:54.342654 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-654365e1-5d65-4799-bc6d-2348f7ad2ff7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:54.350864 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-654365e1-5d65-4799-bc6d-2348f7ad2ff7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.157341 Aug 04 23:46:54.351433 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1157/2287] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:54 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:54.982490 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3f79f197-2b3f-409b-b682-968cc1a29ccc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:54.984169 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3f79f197-2b3f-409b-b682-968cc1a29ccc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:54.990563 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3f79f197-2b3f-409b-b682-968cc1a29ccc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:54.991038 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3f79f197-2b3f-409b-b682-968cc1a29ccc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:54.991462 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3f79f197-2b3f-409b-b682-968cc1a29ccc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:54.992138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3f79f197-2b3f-409b-b682-968cc1a29ccc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:54.992586 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3f79f197-2b3f-409b-b682-968cc1a29ccc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:54.993001 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3f79f197-2b3f-409b-b682-968cc1a29ccc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:55.056868 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3f79f197-2b3f-409b-b682-968cc1a29ccc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:55.065091 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3f79f197-2b3f-409b-b682-968cc1a29ccc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086487 Aug 04 23:46:55.065653 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1131/2288] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:54 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:46:55.372677 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7a239343-515e-4a2b-ab1b-c64e94ccda87 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:55.373890 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7a239343-515e-4a2b-ab1b-c64e94ccda87 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:55.380435 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a239343-515e-4a2b-ab1b-c64e94ccda87 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:55.380910 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a239343-515e-4a2b-ab1b-c64e94ccda87 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:55.381342 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a239343-515e-4a2b-ab1b-c64e94ccda87 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:55.382026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a239343-515e-4a2b-ab1b-c64e94ccda87 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:55.382506 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a239343-515e-4a2b-ab1b-c64e94ccda87 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:55.382926 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a239343-515e-4a2b-ab1b-c64e94ccda87 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:55.514101 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7a239343-515e-4a2b-ab1b-c64e94ccda87 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:55.516310 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:46:55.523785 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7a239343-515e-4a2b-ab1b-c64e94ccda87 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.154946 Aug 04 23:46:55.524356 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1158/2289] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:55 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:56.087258 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-62bb61a5-dbc3-47f6-85ca-35078db65842 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:56.087823 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-62bb61a5-dbc3-47f6-85ca-35078db65842 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:56.095895 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62bb61a5-dbc3-47f6-85ca-35078db65842 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:56.096343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62bb61a5-dbc3-47f6-85ca-35078db65842 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:56.096787 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62bb61a5-dbc3-47f6-85ca-35078db65842 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:56.097452 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62bb61a5-dbc3-47f6-85ca-35078db65842 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:56.097893 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62bb61a5-dbc3-47f6-85ca-35078db65842 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:56.098310 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62bb61a5-dbc3-47f6-85ca-35078db65842 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:56.164653 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-62bb61a5-dbc3-47f6-85ca-35078db65842 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:56.172659 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-62bb61a5-dbc3-47f6-85ca-35078db65842 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.089576 Aug 04 23:46:56.173220 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1132/2290] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:56 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:56.545251 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ee285c03-8b91-4614-912b-270110ae397e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:56.546075 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ee285c03-8b91-4614-912b-270110ae397e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:56.552734 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee285c03-8b91-4614-912b-270110ae397e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:56.553220 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee285c03-8b91-4614-912b-270110ae397e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:56.553660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee285c03-8b91-4614-912b-270110ae397e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:56.554354 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee285c03-8b91-4614-912b-270110ae397e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:56.554833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee285c03-8b91-4614-912b-270110ae397e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:56.555263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee285c03-8b91-4614-912b-270110ae397e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:56.684959 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ee285c03-8b91-4614-912b-270110ae397e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:56.694269 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ee285c03-8b91-4614-912b-270110ae397e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.152956 Aug 04 23:46:56.694894 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1159/2291] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:56 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:57.192446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1cba8b18-d124-430c-90df-65dec2399115 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:57.193088 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1cba8b18-d124-430c-90df-65dec2399115 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:57.199501 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1cba8b18-d124-430c-90df-65dec2399115 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:57.199964 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1cba8b18-d124-430c-90df-65dec2399115 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:57.200402 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1cba8b18-d124-430c-90df-65dec2399115 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:57.201093 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1cba8b18-d124-430c-90df-65dec2399115 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:57.201605 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1cba8b18-d124-430c-90df-65dec2399115 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:57.202033 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1cba8b18-d124-430c-90df-65dec2399115 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:57.263169 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1cba8b18-d124-430c-90df-65dec2399115 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:57.270969 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1cba8b18-d124-430c-90df-65dec2399115 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.082382 Aug 04 23:46:57.271525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1133/2292] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:57 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:57.715733 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-60637b33-878d-4826-b9f8-8b447afbe4b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:57.716327 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-60637b33-878d-4826-b9f8-8b447afbe4b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:57.723120 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60637b33-878d-4826-b9f8-8b447afbe4b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:57.723610 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60637b33-878d-4826-b9f8-8b447afbe4b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:57.724049 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60637b33-878d-4826-b9f8-8b447afbe4b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:57.724745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60637b33-878d-4826-b9f8-8b447afbe4b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:57.725196 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60637b33-878d-4826-b9f8-8b447afbe4b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:57.725623 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-60637b33-878d-4826-b9f8-8b447afbe4b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:57.858931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-60637b33-878d-4826-b9f8-8b447afbe4b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:57.866946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-60637b33-878d-4826-b9f8-8b447afbe4b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.155097 Aug 04 23:46:57.867521 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1160/2293] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:57 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:58.292477 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6caaad00-3e4e-4a1e-9c64-33c7670dec56 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:58.293013 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6caaad00-3e4e-4a1e-9c64-33c7670dec56 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:58.299977 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6caaad00-3e4e-4a1e-9c64-33c7670dec56 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:58.300463 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6caaad00-3e4e-4a1e-9c64-33c7670dec56 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:58.300900 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6caaad00-3e4e-4a1e-9c64-33c7670dec56 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:58.301595 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6caaad00-3e4e-4a1e-9c64-33c7670dec56 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:58.302046 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6caaad00-3e4e-4a1e-9c64-33c7670dec56 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:58.302503 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6caaad00-3e4e-4a1e-9c64-33c7670dec56 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:58.364369 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6caaad00-3e4e-4a1e-9c64-33c7670dec56 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:58.371933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6caaad00-3e4e-4a1e-9c64-33c7670dec56 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083724 Aug 04 23:46:58.372496 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1134/2294] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:58 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:58.890010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5ba26958-e216-4115-a2b1-00a901d3bc55 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:58.890933 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5ba26958-e216-4115-a2b1-00a901d3bc55 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:58.897115 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5ba26958-e216-4115-a2b1-00a901d3bc55 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:58.897595 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5ba26958-e216-4115-a2b1-00a901d3bc55 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:58.898036 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5ba26958-e216-4115-a2b1-00a901d3bc55 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:58.898748 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5ba26958-e216-4115-a2b1-00a901d3bc55 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:58.899201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5ba26958-e216-4115-a2b1-00a901d3bc55 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:58.899626 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5ba26958-e216-4115-a2b1-00a901d3bc55 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:59.026203 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5ba26958-e216-4115-a2b1-00a901d3bc55 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:59.035172 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5ba26958-e216-4115-a2b1-00a901d3bc55 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.149721 Aug 04 23:46:59.035736 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1161/2295] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:58 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:46:59.393976 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2a79215e-ec8a-4b34-a487-2360ce43bbb5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:46:59.394694 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2a79215e-ec8a-4b34-a487-2360ce43bbb5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:46:59.401115 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a79215e-ec8a-4b34-a487-2360ce43bbb5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:59.401595 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a79215e-ec8a-4b34-a487-2360ce43bbb5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:59.402032 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a79215e-ec8a-4b34-a487-2360ce43bbb5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:59.402767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a79215e-ec8a-4b34-a487-2360ce43bbb5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:46:59.403220 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a79215e-ec8a-4b34-a487-2360ce43bbb5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:46:59.403642 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a79215e-ec8a-4b34-a487-2360ce43bbb5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:46:59.470830 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2a79215e-ec8a-4b34-a487-2360ce43bbb5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:46:59.478707 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2a79215e-ec8a-4b34-a487-2360ce43bbb5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.089194 Aug 04 23:46:59.479283 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1135/2296] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:46:59 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:00.057413 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9a8636fd-76eb-4236-88d4-b0b6f1c57a01 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:00.058346 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9a8636fd-76eb-4236-88d4-b0b6f1c57a01 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:00.068978 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a8636fd-76eb-4236-88d4-b0b6f1c57a01 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:00.069738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a8636fd-76eb-4236-88d4-b0b6f1c57a01 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:00.070181 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a8636fd-76eb-4236-88d4-b0b6f1c57a01 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:00.070911 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a8636fd-76eb-4236-88d4-b0b6f1c57a01 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:00.071359 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a8636fd-76eb-4236-88d4-b0b6f1c57a01 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:00.071776 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9a8636fd-76eb-4236-88d4-b0b6f1c57a01 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:00.238969 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9a8636fd-76eb-4236-88d4-b0b6f1c57a01 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:00.247024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9a8636fd-76eb-4236-88d4-b0b6f1c57a01 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.193894 Aug 04 23:47:00.247824 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1162/2297] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:00 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:00.499877 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1f533a57-12e0-4cdb-ba61-15ebca5c879f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:00.500443 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1f533a57-12e0-4cdb-ba61-15ebca5c879f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:00.507665 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f533a57-12e0-4cdb-ba61-15ebca5c879f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:00.508147 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f533a57-12e0-4cdb-ba61-15ebca5c879f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:00.508578 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f533a57-12e0-4cdb-ba61-15ebca5c879f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:00.509270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f533a57-12e0-4cdb-ba61-15ebca5c879f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:00.509718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f533a57-12e0-4cdb-ba61-15ebca5c879f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:00.510137 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1f533a57-12e0-4cdb-ba61-15ebca5c879f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:00.574016 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1f533a57-12e0-4cdb-ba61-15ebca5c879f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:00.582085 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1f533a57-12e0-4cdb-ba61-15ebca5c879f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086138 Aug 04 23:47:00.582702 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1136/2298] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:00 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:01.281224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-804e0bd8-e78c-4e0b-8611-586e0b19ad08 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:01.281868 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-804e0bd8-e78c-4e0b-8611-586e0b19ad08 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:01.288515 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-804e0bd8-e78c-4e0b-8611-586e0b19ad08 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:01.288983 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-804e0bd8-e78c-4e0b-8611-586e0b19ad08 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:01.289419 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-804e0bd8-e78c-4e0b-8611-586e0b19ad08 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:01.290091 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-804e0bd8-e78c-4e0b-8611-586e0b19ad08 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:01.290568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-804e0bd8-e78c-4e0b-8611-586e0b19ad08 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:01.290990 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-804e0bd8-e78c-4e0b-8611-586e0b19ad08 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:01.425571 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-804e0bd8-e78c-4e0b-8611-586e0b19ad08 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:01.433650 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-804e0bd8-e78c-4e0b-8611-586e0b19ad08 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.157443 Aug 04 23:47:01.434213 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1163/2299] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:01 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:01.603429 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4cd4fe77-7a6f-4865-8ea4-e0a68ac16207 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:01.603980 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4cd4fe77-7a6f-4865-8ea4-e0a68ac16207 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:01.610514 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4cd4fe77-7a6f-4865-8ea4-e0a68ac16207 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:01.610992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4cd4fe77-7a6f-4865-8ea4-e0a68ac16207 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:01.611423 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4cd4fe77-7a6f-4865-8ea4-e0a68ac16207 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:01.612103 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4cd4fe77-7a6f-4865-8ea4-e0a68ac16207 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:01.612553 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4cd4fe77-7a6f-4865-8ea4-e0a68ac16207 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:01.612972 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4cd4fe77-7a6f-4865-8ea4-e0a68ac16207 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:01.674380 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4cd4fe77-7a6f-4865-8ea4-e0a68ac16207 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:01.682117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4cd4fe77-7a6f-4865-8ea4-e0a68ac16207 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.082638 Aug 04 23:47:01.682712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1137/2300] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:01 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:02.455205 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9d640141-399d-4f73-ae94-1e9a411fdc78 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:02.455841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9d640141-399d-4f73-ae94-1e9a411fdc78 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:02.462274 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d640141-399d-4f73-ae94-1e9a411fdc78 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:02.462789 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d640141-399d-4f73-ae94-1e9a411fdc78 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:02.463228 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d640141-399d-4f73-ae94-1e9a411fdc78 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:02.463918 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d640141-399d-4f73-ae94-1e9a411fdc78 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:02.464397 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d640141-399d-4f73-ae94-1e9a411fdc78 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:02.464797 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d640141-399d-4f73-ae94-1e9a411fdc78 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:02.594668 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9d640141-399d-4f73-ae94-1e9a411fdc78 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:02.602614 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9d640141-399d-4f73-ae94-1e9a411fdc78 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.151278 Aug 04 23:47:02.603175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1164/2301] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:02 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:02.703959 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-97132a17-c160-4028-8a96-7310c1a8174f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:02.704571 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-97132a17-c160-4028-8a96-7310c1a8174f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:02.711009 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97132a17-c160-4028-8a96-7310c1a8174f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:02.711423 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97132a17-c160-4028-8a96-7310c1a8174f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:02.711848 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97132a17-c160-4028-8a96-7310c1a8174f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:02.712521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97132a17-c160-4028-8a96-7310c1a8174f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:02.712970 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97132a17-c160-4028-8a96-7310c1a8174f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:02.713383 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-97132a17-c160-4028-8a96-7310c1a8174f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:02.781646 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-97132a17-c160-4028-8a96-7310c1a8174f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:02.789947 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-97132a17-c160-4028-8a96-7310c1a8174f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.090689 Aug 04 23:47:02.790551 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1138/2302] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:02 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:03.623734 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3a9c7470-3b77-4583-8c5d-86576ae911a7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:03.625031 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3a9c7470-3b77-4583-8c5d-86576ae911a7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:03.631375 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a9c7470-3b77-4583-8c5d-86576ae911a7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:03.631867 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a9c7470-3b77-4583-8c5d-86576ae911a7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:03.632307 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a9c7470-3b77-4583-8c5d-86576ae911a7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:03.632998 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a9c7470-3b77-4583-8c5d-86576ae911a7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:03.633450 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a9c7470-3b77-4583-8c5d-86576ae911a7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:03.633878 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a9c7470-3b77-4583-8c5d-86576ae911a7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:03.768060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3a9c7470-3b77-4583-8c5d-86576ae911a7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:03.776308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3a9c7470-3b77-4583-8c5d-86576ae911a7 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.156506 Aug 04 23:47:03.776865 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1165/2303] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:03 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:03.812377 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6eb425c3-9ee2-41ae-8c0e-e421fee5c70d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:03.813043 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6eb425c3-9ee2-41ae-8c0e-e421fee5c70d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:03.819624 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6eb425c3-9ee2-41ae-8c0e-e421fee5c70d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:03.820105 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6eb425c3-9ee2-41ae-8c0e-e421fee5c70d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:03.820540 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6eb425c3-9ee2-41ae-8c0e-e421fee5c70d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:03.821238 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6eb425c3-9ee2-41ae-8c0e-e421fee5c70d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:03.821687 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6eb425c3-9ee2-41ae-8c0e-e421fee5c70d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:03.822110 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6eb425c3-9ee2-41ae-8c0e-e421fee5c70d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:03.883428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6eb425c3-9ee2-41ae-8c0e-e421fee5c70d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:03.891114 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6eb425c3-9ee2-41ae-8c0e-e421fee5c70d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.082824 Aug 04 23:47:03.891677 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1139/2304] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:03 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:04.798568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-badb54cf-2b80-428d-8635-86f73e896367 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:04.799180 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-badb54cf-2b80-428d-8635-86f73e896367 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:04.806543 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-badb54cf-2b80-428d-8635-86f73e896367 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:04.807032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-badb54cf-2b80-428d-8635-86f73e896367 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:04.807472 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-badb54cf-2b80-428d-8635-86f73e896367 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:04.808166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-badb54cf-2b80-428d-8635-86f73e896367 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:04.809299 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-badb54cf-2b80-428d-8635-86f73e896367 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:04.809731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-badb54cf-2b80-428d-8635-86f73e896367 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:04.912468 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9fd9c337-b302-4b02-852d-a1dd687e78cd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:04.913088 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9fd9c337-b302-4b02-852d-a1dd687e78cd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:04.919756 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9fd9c337-b302-4b02-852d-a1dd687e78cd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:04.920242 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9fd9c337-b302-4b02-852d-a1dd687e78cd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:04.920680 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9fd9c337-b302-4b02-852d-a1dd687e78cd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:04.921372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9fd9c337-b302-4b02-852d-a1dd687e78cd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:04.921830 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9fd9c337-b302-4b02-852d-a1dd687e78cd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:04.922290 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9fd9c337-b302-4b02-852d-a1dd687e78cd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:04.944320 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-badb54cf-2b80-428d-8635-86f73e896367 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:04.952329 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-badb54cf-2b80-428d-8635-86f73e896367 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.157616 Aug 04 23:47:04.952899 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1166/2305] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:04 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:04.985688 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9fd9c337-b302-4b02-852d-a1dd687e78cd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:04.993233 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9fd9c337-b302-4b02-852d-a1dd687e78cd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084627 Aug 04 23:47:04.993793 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1140/2306] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:04 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:05.974835 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-642d9afc-f993-4e12-acd2-190166121a1b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:05.975444 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-642d9afc-f993-4e12-acd2-190166121a1b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:05.981992 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-642d9afc-f993-4e12-acd2-190166121a1b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:05.982495 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-642d9afc-f993-4e12-acd2-190166121a1b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:05.982925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-642d9afc-f993-4e12-acd2-190166121a1b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:05.983612 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-642d9afc-f993-4e12-acd2-190166121a1b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:05.984061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-642d9afc-f993-4e12-acd2-190166121a1b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:05.984481 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-642d9afc-f993-4e12-acd2-190166121a1b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:06.013825 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-25d68f10-b55d-4321-8b20-235047def0d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:06.014529 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-25d68f10-b55d-4321-8b20-235047def0d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:06.021132 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-25d68f10-b55d-4321-8b20-235047def0d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:06.021610 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-25d68f10-b55d-4321-8b20-235047def0d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:06.022048 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-25d68f10-b55d-4321-8b20-235047def0d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:06.022765 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-25d68f10-b55d-4321-8b20-235047def0d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:06.023216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-25d68f10-b55d-4321-8b20-235047def0d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:06.023636 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-25d68f10-b55d-4321-8b20-235047def0d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:06.101114 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-25d68f10-b55d-4321-8b20-235047def0d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:06.108663 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-25d68f10-b55d-4321-8b20-235047def0d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.098675 Aug 04 23:47:06.109233 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1141/2307] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:06 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:06.145126 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-642d9afc-f993-4e12-acd2-190166121a1b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:06.153391 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-642d9afc-f993-4e12-acd2-190166121a1b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.182426 Aug 04 23:47:06.153956 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1167/2308] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:05 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:07.128968 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-24104fbe-d295-4c78-9719-c2b06597814c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:07.129520 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-24104fbe-d295-4c78-9719-c2b06597814c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:07.136022 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24104fbe-d295-4c78-9719-c2b06597814c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:07.136501 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24104fbe-d295-4c78-9719-c2b06597814c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:07.136937 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24104fbe-d295-4c78-9719-c2b06597814c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:07.137613 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24104fbe-d295-4c78-9719-c2b06597814c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:07.138061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24104fbe-d295-4c78-9719-c2b06597814c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:07.138592 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24104fbe-d295-4c78-9719-c2b06597814c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:07.175086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-32e5cf84-c625-4bbd-b748-cb5c0f96d61a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:07.175705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-32e5cf84-c625-4bbd-b748-cb5c0f96d61a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:07.182983 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32e5cf84-c625-4bbd-b748-cb5c0f96d61a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:07.182983 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32e5cf84-c625-4bbd-b748-cb5c0f96d61a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:07.182983 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32e5cf84-c625-4bbd-b748-cb5c0f96d61a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:07.183441 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32e5cf84-c625-4bbd-b748-cb5c0f96d61a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:07.183905 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32e5cf84-c625-4bbd-b748-cb5c0f96d61a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:07.184336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32e5cf84-c625-4bbd-b748-cb5c0f96d61a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:07.201870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-24104fbe-d295-4c78-9719-c2b06597814c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:07.210444 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-24104fbe-d295-4c78-9719-c2b06597814c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085299 Aug 04 23:47:07.211008 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1142/2309] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:07 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:07.319724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-32e5cf84-c625-4bbd-b748-cb5c0f96d61a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:07.327887 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-32e5cf84-c625-4bbd-b748-cb5c0f96d61a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.157201 Aug 04 23:47:07.329059 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1168/2310] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:07 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:08.232923 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-517f5a4a-4e71-4a7b-9684-2de48fe7cbe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:08.233545 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-517f5a4a-4e71-4a7b-9684-2de48fe7cbe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:08.240863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-517f5a4a-4e71-4a7b-9684-2de48fe7cbe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:08.241378 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-517f5a4a-4e71-4a7b-9684-2de48fe7cbe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:08.241821 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-517f5a4a-4e71-4a7b-9684-2de48fe7cbe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:08.242550 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-517f5a4a-4e71-4a7b-9684-2de48fe7cbe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:08.243007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-517f5a4a-4e71-4a7b-9684-2de48fe7cbe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:08.243433 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-517f5a4a-4e71-4a7b-9684-2de48fe7cbe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:08.308206 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-517f5a4a-4e71-4a7b-9684-2de48fe7cbe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:08.316003 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-517f5a4a-4e71-4a7b-9684-2de48fe7cbe6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086984 Aug 04 23:47:08.316554 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1143/2311] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:08 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:08.349728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7cec2ffa-5600-4109-a5ac-4f60b39c9269 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:08.350248 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7cec2ffa-5600-4109-a5ac-4f60b39c9269 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:08.356637 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7cec2ffa-5600-4109-a5ac-4f60b39c9269 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:08.357112 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7cec2ffa-5600-4109-a5ac-4f60b39c9269 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:08.357534 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7cec2ffa-5600-4109-a5ac-4f60b39c9269 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:08.358209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7cec2ffa-5600-4109-a5ac-4f60b39c9269 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:08.358687 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7cec2ffa-5600-4109-a5ac-4f60b39c9269 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:08.359101 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7cec2ffa-5600-4109-a5ac-4f60b39c9269 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:08.715381 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7cec2ffa-5600-4109-a5ac-4f60b39c9269 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:08.724421 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7cec2ffa-5600-4109-a5ac-4f60b39c9269 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.378531 Aug 04 23:47:08.724980 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1169/2312] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:08 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:09.337006 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1b589ecb-ce18-4626-8fb7-e58176ba8925 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:09.337625 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1b589ecb-ce18-4626-8fb7-e58176ba8925 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:09.343974 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b589ecb-ce18-4626-8fb7-e58176ba8925 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:09.345915 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b589ecb-ce18-4626-8fb7-e58176ba8925 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:09.346352 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b589ecb-ce18-4626-8fb7-e58176ba8925 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:09.347072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b589ecb-ce18-4626-8fb7-e58176ba8925 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:09.347520 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b589ecb-ce18-4626-8fb7-e58176ba8925 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:09.347937 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1b589ecb-ce18-4626-8fb7-e58176ba8925 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:09.410202 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1b589ecb-ce18-4626-8fb7-e58176ba8925 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:09.412508 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:47:09.419398 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1b589ecb-ce18-4626-8fb7-e58176ba8925 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086202 Aug 04 23:47:09.419977 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1144/2313] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:09 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:09.549068 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:47:09.549332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:47:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:47:09.745224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-fb7f22ca-c14b-4309-a350-05cfd90046c2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:09.745844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-fb7f22ca-c14b-4309-a350-05cfd90046c2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:09.753451 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fb7f22ca-c14b-4309-a350-05cfd90046c2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:09.753931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fb7f22ca-c14b-4309-a350-05cfd90046c2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:09.754383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fb7f22ca-c14b-4309-a350-05cfd90046c2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:09.755071 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fb7f22ca-c14b-4309-a350-05cfd90046c2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:09.755522 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fb7f22ca-c14b-4309-a350-05cfd90046c2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:09.755948 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-fb7f22ca-c14b-4309-a350-05cfd90046c2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:09.889808 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-fb7f22ca-c14b-4309-a350-05cfd90046c2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:09.898549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-fb7f22ca-c14b-4309-a350-05cfd90046c2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.157202 Aug 04 23:47:09.899107 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1170/2314] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:09 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:10.441084 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f984e15d-c30d-4717-90f8-bd7e2b57d640 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:10.441751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f984e15d-c30d-4717-90f8-bd7e2b57d640 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:10.448900 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f984e15d-c30d-4717-90f8-bd7e2b57d640 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:10.449458 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f984e15d-c30d-4717-90f8-bd7e2b57d640 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:10.450062 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f984e15d-c30d-4717-90f8-bd7e2b57d640 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:10.450805 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f984e15d-c30d-4717-90f8-bd7e2b57d640 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:10.451263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f984e15d-c30d-4717-90f8-bd7e2b57d640 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:10.451686 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f984e15d-c30d-4717-90f8-bd7e2b57d640 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:10.516070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f984e15d-c30d-4717-90f8-bd7e2b57d640 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:10.524244 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f984e15d-c30d-4717-90f8-bd7e2b57d640 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.088104 Aug 04 23:47:10.524819 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1145/2315] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:10 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:10.920902 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-915be3e2-462b-4b2d-8176-7d9357e8a0da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:10.921515 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-915be3e2-462b-4b2d-8176-7d9357e8a0da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:10.928568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-915be3e2-462b-4b2d-8176-7d9357e8a0da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:10.929048 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-915be3e2-462b-4b2d-8176-7d9357e8a0da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:10.929480 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-915be3e2-462b-4b2d-8176-7d9357e8a0da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:10.930169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-915be3e2-462b-4b2d-8176-7d9357e8a0da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:10.930644 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-915be3e2-462b-4b2d-8176-7d9357e8a0da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:10.931067 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-915be3e2-462b-4b2d-8176-7d9357e8a0da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:11.060444 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-915be3e2-462b-4b2d-8176-7d9357e8a0da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:11.068704 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-915be3e2-462b-4b2d-8176-7d9357e8a0da tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.153355 Aug 04 23:47:11.069300 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1171/2316] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:10 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:11.545286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4e065c1b-4318-44c8-a231-afc77f18e3be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:11.545912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4e065c1b-4318-44c8-a231-afc77f18e3be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:11.553169 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4e065c1b-4318-44c8-a231-afc77f18e3be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:11.553654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4e065c1b-4318-44c8-a231-afc77f18e3be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:11.554086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4e065c1b-4318-44c8-a231-afc77f18e3be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:11.554875 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4e065c1b-4318-44c8-a231-afc77f18e3be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:11.555332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4e065c1b-4318-44c8-a231-afc77f18e3be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:11.555751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4e065c1b-4318-44c8-a231-afc77f18e3be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:11.620040 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4e065c1b-4318-44c8-a231-afc77f18e3be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:11.627735 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4e065c1b-4318-44c8-a231-afc77f18e3be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086283 Aug 04 23:47:11.628297 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1146/2317] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:11 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:12.090902 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c0d902f6-245a-411c-82af-d08dc8919dd3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:12.091446 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c0d902f6-245a-411c-82af-d08dc8919dd3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:12.098089 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0d902f6-245a-411c-82af-d08dc8919dd3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:12.098618 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0d902f6-245a-411c-82af-d08dc8919dd3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:12.099045 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0d902f6-245a-411c-82af-d08dc8919dd3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:12.099718 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0d902f6-245a-411c-82af-d08dc8919dd3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:12.100163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0d902f6-245a-411c-82af-d08dc8919dd3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:12.100579 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c0d902f6-245a-411c-82af-d08dc8919dd3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:12.230795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c0d902f6-245a-411c-82af-d08dc8919dd3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:12.239005 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c0d902f6-245a-411c-82af-d08dc8919dd3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.152021 Aug 04 23:47:12.239569 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1172/2318] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:12 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:12.648733 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-20d2544f-8ee5-494a-ac04-d456d49c5c20 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:12.649410 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-20d2544f-8ee5-494a-ac04-d456d49c5c20 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:12.655783 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20d2544f-8ee5-494a-ac04-d456d49c5c20 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:12.656257 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20d2544f-8ee5-494a-ac04-d456d49c5c20 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:12.656682 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20d2544f-8ee5-494a-ac04-d456d49c5c20 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:12.657355 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20d2544f-8ee5-494a-ac04-d456d49c5c20 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:12.657795 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20d2544f-8ee5-494a-ac04-d456d49c5c20 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:12.659288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20d2544f-8ee5-494a-ac04-d456d49c5c20 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:12.720261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-20d2544f-8ee5-494a-ac04-d456d49c5c20 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:12.730566 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-20d2544f-8ee5-494a-ac04-d456d49c5c20 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085489 Aug 04 23:47:12.731390 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1147/2319] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:12 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:13.261073 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2c1fb34d-b775-4eef-a1c0-c5e4557befc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:13.261686 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2c1fb34d-b775-4eef-a1c0-c5e4557befc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:13.268764 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c1fb34d-b775-4eef-a1c0-c5e4557befc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:13.269246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c1fb34d-b775-4eef-a1c0-c5e4557befc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:13.269678 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c1fb34d-b775-4eef-a1c0-c5e4557befc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:13.270384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c1fb34d-b775-4eef-a1c0-c5e4557befc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:13.270865 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c1fb34d-b775-4eef-a1c0-c5e4557befc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:13.271287 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c1fb34d-b775-4eef-a1c0-c5e4557befc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:13.402766 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2c1fb34d-b775-4eef-a1c0-c5e4557befc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:13.411496 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2c1fb34d-b775-4eef-a1c0-c5e4557befc0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.154268 Aug 04 23:47:13.412054 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1173/2320] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:13 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:13.752445 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f1454314-15fe-4bc4-8ad1-51e38aea304b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:13.753092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f1454314-15fe-4bc4-8ad1-51e38aea304b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:13.759573 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f1454314-15fe-4bc4-8ad1-51e38aea304b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:13.760053 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f1454314-15fe-4bc4-8ad1-51e38aea304b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:13.760485 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f1454314-15fe-4bc4-8ad1-51e38aea304b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:13.761205 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f1454314-15fe-4bc4-8ad1-51e38aea304b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:13.761655 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f1454314-15fe-4bc4-8ad1-51e38aea304b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:13.762122 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f1454314-15fe-4bc4-8ad1-51e38aea304b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:13.824431 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f1454314-15fe-4bc4-8ad1-51e38aea304b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:13.832547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f1454314-15fe-4bc4-8ad1-51e38aea304b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084071 Aug 04 23:47:13.833332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1148/2321] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:13 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:14.432861 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-28671f67-2a61-4148-b880-e855e1e2dce0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:14.433591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-28671f67-2a61-4148-b880-e855e1e2dce0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:14.440554 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-28671f67-2a61-4148-b880-e855e1e2dce0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:14.441035 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-28671f67-2a61-4148-b880-e855e1e2dce0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:14.441471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-28671f67-2a61-4148-b880-e855e1e2dce0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:14.442165 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-28671f67-2a61-4148-b880-e855e1e2dce0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:14.443150 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-28671f67-2a61-4148-b880-e855e1e2dce0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:14.443150 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-28671f67-2a61-4148-b880-e855e1e2dce0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:14.577356 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-28671f67-2a61-4148-b880-e855e1e2dce0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:14.585373 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-28671f67-2a61-4148-b880-e855e1e2dce0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.156713 Aug 04 23:47:14.585944 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1174/2322] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:14 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:14.853130 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1a364291-cec2-4ec7-910f-d3f448ea87d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:14.853864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1a364291-cec2-4ec7-910f-d3f448ea87d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:14.860313 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a364291-cec2-4ec7-910f-d3f448ea87d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:14.860802 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a364291-cec2-4ec7-910f-d3f448ea87d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:14.861777 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a364291-cec2-4ec7-910f-d3f448ea87d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:14.862526 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a364291-cec2-4ec7-910f-d3f448ea87d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:14.862984 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a364291-cec2-4ec7-910f-d3f448ea87d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:14.863437 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1a364291-cec2-4ec7-910f-d3f448ea87d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:14.928588 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1a364291-cec2-4ec7-910f-d3f448ea87d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:14.936054 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1a364291-cec2-4ec7-910f-d3f448ea87d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086759 Aug 04 23:47:14.936881 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1149/2323] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:14 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:15.606758 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-29184a77-406d-4719-932a-6dc542078b7a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:15.607318 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-29184a77-406d-4719-932a-6dc542078b7a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:15.613859 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-29184a77-406d-4719-932a-6dc542078b7a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:15.614337 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-29184a77-406d-4719-932a-6dc542078b7a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:15.614803 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-29184a77-406d-4719-932a-6dc542078b7a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:15.615498 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-29184a77-406d-4719-932a-6dc542078b7a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:15.615944 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-29184a77-406d-4719-932a-6dc542078b7a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:15.616368 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-29184a77-406d-4719-932a-6dc542078b7a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:15.633508 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:47:15.751830 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-29184a77-406d-4719-932a-6dc542078b7a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:15.760636 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-29184a77-406d-4719-932a-6dc542078b7a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.157769 Aug 04 23:47:15.761205 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1175/2324] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:15 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:15.958309 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-16e5268c-6028-4f3a-8d14-1ba019a18345 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:15.958940 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-16e5268c-6028-4f3a-8d14-1ba019a18345 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:15.965282 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-16e5268c-6028-4f3a-8d14-1ba019a18345 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:15.965751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-16e5268c-6028-4f3a-8d14-1ba019a18345 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:15.966178 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-16e5268c-6028-4f3a-8d14-1ba019a18345 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:15.966876 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-16e5268c-6028-4f3a-8d14-1ba019a18345 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:15.967324 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-16e5268c-6028-4f3a-8d14-1ba019a18345 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:15.967738 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-16e5268c-6028-4f3a-8d14-1ba019a18345 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:16.028038 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-16e5268c-6028-4f3a-8d14-1ba019a18345 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:16.036646 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-16e5268c-6028-4f3a-8d14-1ba019a18345 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.082818 Aug 04 23:47:16.037203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1150/2325] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:15 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:16.782170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7a028012-daa5-49dd-8ef3-4256f1c560ea tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:16.782826 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7a028012-daa5-49dd-8ef3-4256f1c560ea tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:16.789398 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a028012-daa5-49dd-8ef3-4256f1c560ea tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:16.790141 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a028012-daa5-49dd-8ef3-4256f1c560ea tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:16.790612 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a028012-daa5-49dd-8ef3-4256f1c560ea tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:16.791304 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a028012-daa5-49dd-8ef3-4256f1c560ea tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:16.791766 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a028012-daa5-49dd-8ef3-4256f1c560ea tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:16.792183 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7a028012-daa5-49dd-8ef3-4256f1c560ea tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:16.927382 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7a028012-daa5-49dd-8ef3-4256f1c560ea tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:16.935317 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7a028012-daa5-49dd-8ef3-4256f1c560ea tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.156983 Aug 04 23:47:16.935879 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1176/2326] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:16 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:17.058786 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e864dc54-3ae2-4c10-b32e-9e066034728b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:17.059351 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e864dc54-3ae2-4c10-b32e-9e066034728b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:17.066515 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e864dc54-3ae2-4c10-b32e-9e066034728b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:17.067006 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e864dc54-3ae2-4c10-b32e-9e066034728b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:17.067441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e864dc54-3ae2-4c10-b32e-9e066034728b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:17.068132 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e864dc54-3ae2-4c10-b32e-9e066034728b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:17.068587 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e864dc54-3ae2-4c10-b32e-9e066034728b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:17.069010 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e864dc54-3ae2-4c10-b32e-9e066034728b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:17.132372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e864dc54-3ae2-4c10-b32e-9e066034728b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:17.139834 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e864dc54-3ae2-4c10-b32e-9e066034728b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085266 Aug 04 23:47:17.140387 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1151/2327] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:17 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:17.958032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6b2584a2-ef87-4b4d-bcfc-8b8691b0af8a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:17.958664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6b2584a2-ef87-4b4d-bcfc-8b8691b0af8a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:17.965036 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b2584a2-ef87-4b4d-bcfc-8b8691b0af8a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:17.965505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b2584a2-ef87-4b4d-bcfc-8b8691b0af8a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:17.965937 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b2584a2-ef87-4b4d-bcfc-8b8691b0af8a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:17.966653 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b2584a2-ef87-4b4d-bcfc-8b8691b0af8a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:17.967098 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b2584a2-ef87-4b4d-bcfc-8b8691b0af8a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:17.967514 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6b2584a2-ef87-4b4d-bcfc-8b8691b0af8a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:18.098087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6b2584a2-ef87-4b4d-bcfc-8b8691b0af8a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:18.105950 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6b2584a2-ef87-4b4d-bcfc-8b8691b0af8a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.152415 Aug 04 23:47:18.106559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1177/2328] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:17 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:18.161355 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2e6abc18-d879-4b6f-94c2-5e29ccd0f18e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:18.161957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2e6abc18-d879-4b6f-94c2-5e29ccd0f18e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:18.168535 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2e6abc18-d879-4b6f-94c2-5e29ccd0f18e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:18.169006 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2e6abc18-d879-4b6f-94c2-5e29ccd0f18e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:18.169423 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2e6abc18-d879-4b6f-94c2-5e29ccd0f18e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:18.170095 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2e6abc18-d879-4b6f-94c2-5e29ccd0f18e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:18.170572 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2e6abc18-d879-4b6f-94c2-5e29ccd0f18e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:18.170990 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2e6abc18-d879-4b6f-94c2-5e29ccd0f18e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:18.236059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2e6abc18-d879-4b6f-94c2-5e29ccd0f18e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:18.244508 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2e6abc18-d879-4b6f-94c2-5e29ccd0f18e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087437 Aug 04 23:47:18.245092 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1152/2329] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:18 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:19.130275 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7d8664e7-b55f-4181-b7ef-e7c20b44aebd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:19.131023 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7d8664e7-b55f-4181-b7ef-e7c20b44aebd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:19.138329 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d8664e7-b55f-4181-b7ef-e7c20b44aebd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:19.138843 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d8664e7-b55f-4181-b7ef-e7c20b44aebd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:19.139272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d8664e7-b55f-4181-b7ef-e7c20b44aebd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:19.139959 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d8664e7-b55f-4181-b7ef-e7c20b44aebd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:19.140404 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d8664e7-b55f-4181-b7ef-e7c20b44aebd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:19.140819 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7d8664e7-b55f-4181-b7ef-e7c20b44aebd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:19.266427 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c2730a96-c42b-44cc-b25c-c9b06db54183 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:19.267206 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c2730a96-c42b-44cc-b25c-c9b06db54183 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:19.275559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7d8664e7-b55f-4181-b7ef-e7c20b44aebd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:19.275861 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2730a96-c42b-44cc-b25c-c9b06db54183 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:19.276347 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2730a96-c42b-44cc-b25c-c9b06db54183 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:19.276776 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2730a96-c42b-44cc-b25c-c9b06db54183 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:19.277468 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2730a96-c42b-44cc-b25c-c9b06db54183 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:19.277915 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2730a96-c42b-44cc-b25c-c9b06db54183 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:19.278332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2730a96-c42b-44cc-b25c-c9b06db54183 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:19.285232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7d8664e7-b55f-4181-b7ef-e7c20b44aebd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.161391 Aug 04 23:47:19.285814 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1178/2330] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:19 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:19.341812 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c2730a96-c42b-44cc-b25c-c9b06db54183 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:19.349866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c2730a96-c42b-44cc-b25c-c9b06db54183 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087425 Aug 04 23:47:19.350437 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1153/2331] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:19 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:20.306482 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-50af8c53-0101-40b3-b1ac-63be986c3fbb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:20.307123 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-50af8c53-0101-40b3-b1ac-63be986c3fbb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:20.313570 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-50af8c53-0101-40b3-b1ac-63be986c3fbb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:20.314051 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-50af8c53-0101-40b3-b1ac-63be986c3fbb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:20.314508 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-50af8c53-0101-40b3-b1ac-63be986c3fbb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:20.315920 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-50af8c53-0101-40b3-b1ac-63be986c3fbb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:20.316376 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-50af8c53-0101-40b3-b1ac-63be986c3fbb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:20.316797 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-50af8c53-0101-40b3-b1ac-63be986c3fbb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:20.370585 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-02dbcec4-e1ec-45c9-9857-a04039cba7d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:20.371954 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-02dbcec4-e1ec-45c9-9857-a04039cba7d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:20.379148 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02dbcec4-e1ec-45c9-9857-a04039cba7d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:20.379917 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02dbcec4-e1ec-45c9-9857-a04039cba7d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:20.380531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02dbcec4-e1ec-45c9-9857-a04039cba7d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:20.381537 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02dbcec4-e1ec-45c9-9857-a04039cba7d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:20.381997 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02dbcec4-e1ec-45c9-9857-a04039cba7d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:20.382452 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02dbcec4-e1ec-45c9-9857-a04039cba7d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:20.466681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-02dbcec4-e1ec-45c9-9857-a04039cba7d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:20.475704 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-02dbcec4-e1ec-45c9-9857-a04039cba7d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.108949 Aug 04 23:47:20.476587 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1154/2332] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:20 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:20.485486 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-50af8c53-0101-40b3-b1ac-63be986c3fbb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:20.495094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-50af8c53-0101-40b3-b1ac-63be986c3fbb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1559 microversion: 2.1 time: 0.192496 Aug 04 23:47:20.495657 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1179/2333] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:20 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1559 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:20.725011 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [req-84dcd9dd-e819-4d51-9466-cb262f65c3ea req-8dcdad6d-e4bf-4c12-b98e-9631c81871fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c786164b-4aee-4a6a-9208-29f6ae31f247", "name": "network-vif-deleted", "tag": "ca8dff39-0739-4a70-8fc8-bb6e5c88a496"}]} {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 23:47:20.737611 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-84dcd9dd-e819-4d51-9466-cb262f65c3ea req-8dcdad6d-e4bf-4c12-b98e-9631c81871fb service nova] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:20.738030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-84dcd9dd-e819-4d51-9466-cb262f65c3ea req-8dcdad6d-e4bf-4c12-b98e-9631c81871fb service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:20.738488 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [req-84dcd9dd-e819-4d51-9466-cb262f65c3ea req-8dcdad6d-e4bf-4c12-b98e-9631c81871fb service nova] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:20.751708 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.compute.server_external_events [req-84dcd9dd-e819-4d51-9466-cb262f65c3ea req-8dcdad6d-e4bf-4c12-b98e-9631c81871fb service nova] Creating event network-vif-deleted:ca8dff39-0739-4a70-8fc8-bb6e5c88a496 for instance c786164b-4aee-4a6a-9208-29f6ae31f247 on hv-cinder-85221 Aug 04 23:47:20.758295 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [req-84dcd9dd-e819-4d51-9466-cb262f65c3ea req-8dcdad6d-e4bf-4c12-b98e-9631c81871fb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037303 Aug 04 23:47:20.758914 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1155/2334] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Aug 4 23:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 23:47:21.496659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ad91a945-2618-46ae-82b9-4d0b99e17903 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:21.497272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ad91a945-2618-46ae-82b9-4d0b99e17903 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:21.504546 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad91a945-2618-46ae-82b9-4d0b99e17903 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:21.505060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad91a945-2618-46ae-82b9-4d0b99e17903 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:21.505467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad91a945-2618-46ae-82b9-4d0b99e17903 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:21.506158 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad91a945-2618-46ae-82b9-4d0b99e17903 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:21.506639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad91a945-2618-46ae-82b9-4d0b99e17903 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:21.507067 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ad91a945-2618-46ae-82b9-4d0b99e17903 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:21.517502 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d6174079-93b3-4fea-b2e5-1235ba3d87e0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:21.518551 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d6174079-93b3-4fea-b2e5-1235ba3d87e0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:21.524437 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d6174079-93b3-4fea-b2e5-1235ba3d87e0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:21.524913 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d6174079-93b3-4fea-b2e5-1235ba3d87e0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:21.525370 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d6174079-93b3-4fea-b2e5-1235ba3d87e0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:21.526052 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d6174079-93b3-4fea-b2e5-1235ba3d87e0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:21.526525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d6174079-93b3-4fea-b2e5-1235ba3d87e0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:21.526944 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d6174079-93b3-4fea-b2e5-1235ba3d87e0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:21.578890 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ad91a945-2618-46ae-82b9-4d0b99e17903 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:21.586653 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ad91a945-2618-46ae-82b9-4d0b99e17903 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.093746 Aug 04 23:47:21.587214 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1180/2335] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:21 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:21.598739 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d6174079-93b3-4fea-b2e5-1235ba3d87e0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:21.606675 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d6174079-93b3-4fea-b2e5-1235ba3d87e0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.093846 Aug 04 23:47:21.607230 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1156/2336] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:21 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:22.607505 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1647496e-c4f2-4240-8093-b988623a8683 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:22.608120 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1647496e-c4f2-4240-8093-b988623a8683 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:22.615245 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1647496e-c4f2-4240-8093-b988623a8683 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:22.615721 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1647496e-c4f2-4240-8093-b988623a8683 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:22.616152 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1647496e-c4f2-4240-8093-b988623a8683 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:22.616827 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1647496e-c4f2-4240-8093-b988623a8683 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:22.617272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1647496e-c4f2-4240-8093-b988623a8683 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:22.617685 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1647496e-c4f2-4240-8093-b988623a8683 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:22.628373 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f7f22356-7dcd-41aa-bd71-2cdbec69e42a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:22.628990 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f7f22356-7dcd-41aa-bd71-2cdbec69e42a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:22.635100 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7f22356-7dcd-41aa-bd71-2cdbec69e42a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:22.635580 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7f22356-7dcd-41aa-bd71-2cdbec69e42a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:22.636061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7f22356-7dcd-41aa-bd71-2cdbec69e42a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:22.636870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7f22356-7dcd-41aa-bd71-2cdbec69e42a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:22.637348 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7f22356-7dcd-41aa-bd71-2cdbec69e42a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:22.637796 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f7f22356-7dcd-41aa-bd71-2cdbec69e42a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:22.683983 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1647496e-c4f2-4240-8093-b988623a8683 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:22.692467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1647496e-c4f2-4240-8093-b988623a8683 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.088958 Aug 04 23:47:22.693044 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1181/2337] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:22 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:22.713193 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f7f22356-7dcd-41aa-bd71-2cdbec69e42a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:22.721849 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f7f22356-7dcd-41aa-bd71-2cdbec69e42a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.097083 Aug 04 23:47:22.722473 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1157/2338] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:22 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:23.713026 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a084760f-5d6e-4c4e-baf9-e374522fc9dd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:23.713647 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a084760f-5d6e-4c4e-baf9-e374522fc9dd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:23.720145 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a084760f-5d6e-4c4e-baf9-e374522fc9dd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:23.720627 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a084760f-5d6e-4c4e-baf9-e374522fc9dd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:23.721066 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a084760f-5d6e-4c4e-baf9-e374522fc9dd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:23.721801 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a084760f-5d6e-4c4e-baf9-e374522fc9dd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:23.722387 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a084760f-5d6e-4c4e-baf9-e374522fc9dd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:23.722814 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a084760f-5d6e-4c4e-baf9-e374522fc9dd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:23.743195 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2730ea79-b606-490a-9afc-f5507dd7ee15 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:23.743799 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2730ea79-b606-490a-9afc-f5507dd7ee15 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:23.747346 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=58 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:47:23.751291 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2730ea79-b606-490a-9afc-f5507dd7ee15 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:23.751763 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2730ea79-b606-490a-9afc-f5507dd7ee15 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:23.752193 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2730ea79-b606-490a-9afc-f5507dd7ee15 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:23.753597 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2730ea79-b606-490a-9afc-f5507dd7ee15 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:23.754046 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2730ea79-b606-490a-9afc-f5507dd7ee15 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:23.754559 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2730ea79-b606-490a-9afc-f5507dd7ee15 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:23.787761 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a084760f-5d6e-4c4e-baf9-e374522fc9dd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:23.796308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a084760f-5d6e-4c4e-baf9-e374522fc9dd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087061 Aug 04 23:47:23.796878 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1182/2339] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:23 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:23.819358 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2730ea79-b606-490a-9afc-f5507dd7ee15 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:23.827412 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2730ea79-b606-490a-9afc-f5507dd7ee15 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.088306 Aug 04 23:47:23.827975 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1158/2340] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:23 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:24.818682 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-10f9a385-c97e-4a89-ac33-0a11680ff9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:24.819287 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-10f9a385-c97e-4a89-ac33-0a11680ff9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:24.821559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=52 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:47:24.827273 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10f9a385-c97e-4a89-ac33-0a11680ff9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:24.827756 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10f9a385-c97e-4a89-ac33-0a11680ff9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:24.828192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10f9a385-c97e-4a89-ac33-0a11680ff9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:24.828889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10f9a385-c97e-4a89-ac33-0a11680ff9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:24.829340 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10f9a385-c97e-4a89-ac33-0a11680ff9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:24.829764 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10f9a385-c97e-4a89-ac33-0a11680ff9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:24.848493 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4f386f92-505c-4871-bebe-149e05a27e33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:24.849200 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4f386f92-505c-4871-bebe-149e05a27e33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:24.855560 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f386f92-505c-4871-bebe-149e05a27e33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:24.856041 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f386f92-505c-4871-bebe-149e05a27e33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:24.856474 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f386f92-505c-4871-bebe-149e05a27e33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:24.857168 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f386f92-505c-4871-bebe-149e05a27e33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:24.857619 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f386f92-505c-4871-bebe-149e05a27e33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:24.858035 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4f386f92-505c-4871-bebe-149e05a27e33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:24.897005 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-10f9a385-c97e-4a89-ac33-0a11680ff9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:24.906148 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-10f9a385-c97e-4a89-ac33-0a11680ff9bb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.092283 Aug 04 23:47:24.907151 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1183/2341] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:24 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:25.085146 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4f386f92-505c-4871-bebe-149e05a27e33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:25.093117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4f386f92-505c-4871-bebe-149e05a27e33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.248583 Aug 04 23:47:25.093672 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1159/2342] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:24 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:25.927357 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f84ead32-6c82-48f2-9195-622d6108b9c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:25.928032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f84ead32-6c82-48f2-9195-622d6108b9c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:25.934273 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f84ead32-6c82-48f2-9195-622d6108b9c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:25.934780 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f84ead32-6c82-48f2-9195-622d6108b9c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:25.935207 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f84ead32-6c82-48f2-9195-622d6108b9c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:25.935882 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f84ead32-6c82-48f2-9195-622d6108b9c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:25.936325 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f84ead32-6c82-48f2-9195-622d6108b9c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:25.936761 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f84ead32-6c82-48f2-9195-622d6108b9c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:25.999071 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f84ead32-6c82-48f2-9195-622d6108b9c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:26.007129 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f84ead32-6c82-48f2-9195-622d6108b9c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084107 Aug 04 23:47:26.007685 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1184/2343] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:25 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:26.114312 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-35965187-941b-4a2a-a15a-5a477df32015 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:26.114864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-35965187-941b-4a2a-a15a-5a477df32015 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:26.121264 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35965187-941b-4a2a-a15a-5a477df32015 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:26.121746 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35965187-941b-4a2a-a15a-5a477df32015 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:26.122180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35965187-941b-4a2a-a15a-5a477df32015 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:26.122897 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35965187-941b-4a2a-a15a-5a477df32015 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:26.123352 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35965187-941b-4a2a-a15a-5a477df32015 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:26.123777 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-35965187-941b-4a2a-a15a-5a477df32015 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:26.185715 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-35965187-941b-4a2a-a15a-5a477df32015 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:26.194446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-35965187-941b-4a2a-a15a-5a477df32015 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.084025 Aug 04 23:47:26.195000 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1160/2344] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:26 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:27.027758 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b904180d-9296-4f0d-93c7-e5b4111cc18c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:27.028324 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b904180d-9296-4f0d-93c7-e5b4111cc18c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:27.034854 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b904180d-9296-4f0d-93c7-e5b4111cc18c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:27.035335 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b904180d-9296-4f0d-93c7-e5b4111cc18c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:27.035773 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b904180d-9296-4f0d-93c7-e5b4111cc18c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:27.036494 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b904180d-9296-4f0d-93c7-e5b4111cc18c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:27.036951 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b904180d-9296-4f0d-93c7-e5b4111cc18c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:27.037378 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b904180d-9296-4f0d-93c7-e5b4111cc18c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:27.100932 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b904180d-9296-4f0d-93c7-e5b4111cc18c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:27.108793 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b904180d-9296-4f0d-93c7-e5b4111cc18c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084971 Aug 04 23:47:27.109375 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1185/2345] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:27 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:27.215861 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-09117003-94dc-4b0c-878d-5f4272ec60c9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:27.216459 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-09117003-94dc-4b0c-878d-5f4272ec60c9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:27.223240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-09117003-94dc-4b0c-878d-5f4272ec60c9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:27.223712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-09117003-94dc-4b0c-878d-5f4272ec60c9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:27.224139 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-09117003-94dc-4b0c-878d-5f4272ec60c9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:27.224811 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-09117003-94dc-4b0c-878d-5f4272ec60c9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:27.225251 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-09117003-94dc-4b0c-878d-5f4272ec60c9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:27.225672 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-09117003-94dc-4b0c-878d-5f4272ec60c9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:27.290167 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-09117003-94dc-4b0c-878d-5f4272ec60c9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:27.298289 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-09117003-94dc-4b0c-878d-5f4272ec60c9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.086294 Aug 04 23:47:27.298863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1161/2346] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:27 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:28.129904 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-74c34205-ad4f-4c81-a27f-5be5d788f51b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:28.130480 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-74c34205-ad4f-4c81-a27f-5be5d788f51b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:28.136954 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-74c34205-ad4f-4c81-a27f-5be5d788f51b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:28.137432 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-74c34205-ad4f-4c81-a27f-5be5d788f51b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:28.137864 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-74c34205-ad4f-4c81-a27f-5be5d788f51b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:28.138580 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-74c34205-ad4f-4c81-a27f-5be5d788f51b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:28.139029 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-74c34205-ad4f-4c81-a27f-5be5d788f51b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:28.139473 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-74c34205-ad4f-4c81-a27f-5be5d788f51b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:28.201979 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-74c34205-ad4f-4c81-a27f-5be5d788f51b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:28.209967 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-74c34205-ad4f-4c81-a27f-5be5d788f51b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084738 Aug 04 23:47:28.210568 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1186/2347] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:28 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:28.320650 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-cc308150-4d80-45f6-8e05-beef7c8e33b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:28.321262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-cc308150-4d80-45f6-8e05-beef7c8e33b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:28.327621 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc308150-4d80-45f6-8e05-beef7c8e33b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:28.328098 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc308150-4d80-45f6-8e05-beef7c8e33b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:28.328523 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc308150-4d80-45f6-8e05-beef7c8e33b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:28.329204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc308150-4d80-45f6-8e05-beef7c8e33b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:28.329646 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc308150-4d80-45f6-8e05-beef7c8e33b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:28.330063 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-cc308150-4d80-45f6-8e05-beef7c8e33b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:28.332584 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:47:28.395175 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-cc308150-4d80-45f6-8e05-beef7c8e33b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:28.403193 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-cc308150-4d80-45f6-8e05-beef7c8e33b3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.087204 Aug 04 23:47:28.403751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1162/2348] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:28 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:29.230723 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1f9f2a26-b02b-4fb5-98b0-4751ef48c5f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:29.231340 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1f9f2a26-b02b-4fb5-98b0-4751ef48c5f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:29.238465 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1f9f2a26-b02b-4fb5-98b0-4751ef48c5f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:29.238957 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1f9f2a26-b02b-4fb5-98b0-4751ef48c5f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:29.239398 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1f9f2a26-b02b-4fb5-98b0-4751ef48c5f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:29.240100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1f9f2a26-b02b-4fb5-98b0-4751ef48c5f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:29.240558 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1f9f2a26-b02b-4fb5-98b0-4751ef48c5f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:29.240990 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1f9f2a26-b02b-4fb5-98b0-4751ef48c5f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:29.306448 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1f9f2a26-b02b-4fb5-98b0-4751ef48c5f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:29.313986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1f9f2a26-b02b-4fb5-98b0-4751ef48c5f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087229 Aug 04 23:47:29.314582 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1187/2349] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:29 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:29.424704 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ea7a8d51-d7c9-449a-825e-3cbf5a0591ce tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:29.427188 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ea7a8d51-d7c9-449a-825e-3cbf5a0591ce tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:29.433557 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea7a8d51-d7c9-449a-825e-3cbf5a0591ce tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:29.434029 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea7a8d51-d7c9-449a-825e-3cbf5a0591ce tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:29.434483 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea7a8d51-d7c9-449a-825e-3cbf5a0591ce tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:29.435164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea7a8d51-d7c9-449a-825e-3cbf5a0591ce tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:29.435606 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea7a8d51-d7c9-449a-825e-3cbf5a0591ce tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:29.436023 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea7a8d51-d7c9-449a-825e-3cbf5a0591ce tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:29.500999 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ea7a8d51-d7c9-449a-825e-3cbf5a0591ce tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:29.509513 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ea7a8d51-d7c9-449a-825e-3cbf5a0591ce tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.088683 Aug 04 23:47:29.510080 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1163/2350] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:29 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:30.335089 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7cb0f77a-481d-4461-8654-306b7b0d5d86 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:30.335697 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7cb0f77a-481d-4461-8654-306b7b0d5d86 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:30.342191 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7cb0f77a-481d-4461-8654-306b7b0d5d86 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:30.342699 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7cb0f77a-481d-4461-8654-306b7b0d5d86 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:30.343131 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7cb0f77a-481d-4461-8654-306b7b0d5d86 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:30.343802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7cb0f77a-481d-4461-8654-306b7b0d5d86 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:30.344246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7cb0f77a-481d-4461-8654-306b7b0d5d86 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:30.344663 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7cb0f77a-481d-4461-8654-306b7b0d5d86 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:30.406056 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7cb0f77a-481d-4461-8654-306b7b0d5d86 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:30.414635 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7cb0f77a-481d-4461-8654-306b7b0d5d86 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083789 Aug 04 23:47:30.415206 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1188/2351] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:30 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:30.530800 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7cc57d74-4e81-41c6-8503-e28486d61d08 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:30.531520 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7cc57d74-4e81-41c6-8503-e28486d61d08 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:30.538326 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7cc57d74-4e81-41c6-8503-e28486d61d08 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:30.538827 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7cc57d74-4e81-41c6-8503-e28486d61d08 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:30.539250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7cc57d74-4e81-41c6-8503-e28486d61d08 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:30.539927 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7cc57d74-4e81-41c6-8503-e28486d61d08 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:30.540370 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7cc57d74-4e81-41c6-8503-e28486d61d08 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:30.541105 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7cc57d74-4e81-41c6-8503-e28486d61d08 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:30.605332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7cc57d74-4e81-41c6-8503-e28486d61d08 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:30.613785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7cc57d74-4e81-41c6-8503-e28486d61d08 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.086886 Aug 04 23:47:30.614332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1164/2352] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:30 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:31.436986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-68b5749e-427b-4b6d-a7a9-faea023a8c30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:31.437584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-68b5749e-427b-4b6d-a7a9-faea023a8c30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:31.444444 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-68b5749e-427b-4b6d-a7a9-faea023a8c30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:31.444927 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-68b5749e-427b-4b6d-a7a9-faea023a8c30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:31.445362 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-68b5749e-427b-4b6d-a7a9-faea023a8c30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:31.446051 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-68b5749e-427b-4b6d-a7a9-faea023a8c30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:31.446535 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-68b5749e-427b-4b6d-a7a9-faea023a8c30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:31.446961 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-68b5749e-427b-4b6d-a7a9-faea023a8c30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:31.508556 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-68b5749e-427b-4b6d-a7a9-faea023a8c30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:31.516043 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-68b5749e-427b-4b6d-a7a9-faea023a8c30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.082892 Aug 04 23:47:31.516609 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1189/2353] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:31 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:31.635154 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-aa10a70a-3e5c-4c27-b6e9-1333ec30650e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:31.635764 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-aa10a70a-3e5c-4c27-b6e9-1333ec30650e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:31.642143 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa10a70a-3e5c-4c27-b6e9-1333ec30650e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:31.642647 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa10a70a-3e5c-4c27-b6e9-1333ec30650e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:31.643080 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa10a70a-3e5c-4c27-b6e9-1333ec30650e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:31.643764 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa10a70a-3e5c-4c27-b6e9-1333ec30650e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:31.644870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa10a70a-3e5c-4c27-b6e9-1333ec30650e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:31.647767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-aa10a70a-3e5c-4c27-b6e9-1333ec30650e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:31.713990 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-aa10a70a-3e5c-4c27-b6e9-1333ec30650e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:31.722000 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-aa10a70a-3e5c-4c27-b6e9-1333ec30650e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.090802 Aug 04 23:47:31.723509 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1165/2354] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:31 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:32.537696 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4f7cf174-db71-4948-9d4e-7a7ee4649e2c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:32.538306 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4f7cf174-db71-4948-9d4e-7a7ee4649e2c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:32.544969 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f7cf174-db71-4948-9d4e-7a7ee4649e2c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:32.545447 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f7cf174-db71-4948-9d4e-7a7ee4649e2c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:32.545880 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f7cf174-db71-4948-9d4e-7a7ee4649e2c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:32.546596 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f7cf174-db71-4948-9d4e-7a7ee4649e2c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:32.547047 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f7cf174-db71-4948-9d4e-7a7ee4649e2c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:32.547467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4f7cf174-db71-4948-9d4e-7a7ee4649e2c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:32.609459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4f7cf174-db71-4948-9d4e-7a7ee4649e2c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:32.617382 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4f7cf174-db71-4948-9d4e-7a7ee4649e2c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084340 Aug 04 23:47:32.617941 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1190/2355] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:32 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:32.743753 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0b2aaf34-1283-4254-9574-82c459e52064 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:32.745743 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0b2aaf34-1283-4254-9574-82c459e52064 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:32.752013 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0b2aaf34-1283-4254-9574-82c459e52064 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:32.752491 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0b2aaf34-1283-4254-9574-82c459e52064 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:32.752924 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0b2aaf34-1283-4254-9574-82c459e52064 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:32.754116 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0b2aaf34-1283-4254-9574-82c459e52064 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:32.754605 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0b2aaf34-1283-4254-9574-82c459e52064 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:32.755026 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0b2aaf34-1283-4254-9574-82c459e52064 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:32.816660 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0b2aaf34-1283-4254-9574-82c459e52064 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:32.824920 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0b2aaf34-1283-4254-9574-82c459e52064 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.085749 Aug 04 23:47:32.825475 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1166/2356] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:32 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:33.638962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8c4a5892-0d8f-4216-81e0-a60021fc9d72 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:33.639615 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8c4a5892-0d8f-4216-81e0-a60021fc9d72 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:33.647303 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c4a5892-0d8f-4216-81e0-a60021fc9d72 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:33.647786 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c4a5892-0d8f-4216-81e0-a60021fc9d72 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:33.648214 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c4a5892-0d8f-4216-81e0-a60021fc9d72 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:33.648915 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c4a5892-0d8f-4216-81e0-a60021fc9d72 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:33.649359 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c4a5892-0d8f-4216-81e0-a60021fc9d72 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:33.649779 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c4a5892-0d8f-4216-81e0-a60021fc9d72 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:33.715102 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8c4a5892-0d8f-4216-81e0-a60021fc9d72 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:33.723183 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8c4a5892-0d8f-4216-81e0-a60021fc9d72 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087701 Aug 04 23:47:33.723606 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1191/2357] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:33 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:33.848256 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ce4095ec-a9f6-4e43-9553-d879dbec5799 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:33.848866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ce4095ec-a9f6-4e43-9553-d879dbec5799 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:33.855585 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce4095ec-a9f6-4e43-9553-d879dbec5799 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:33.856066 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce4095ec-a9f6-4e43-9553-d879dbec5799 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:33.856493 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce4095ec-a9f6-4e43-9553-d879dbec5799 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:33.857179 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce4095ec-a9f6-4e43-9553-d879dbec5799 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:33.857621 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce4095ec-a9f6-4e43-9553-d879dbec5799 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:33.858032 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce4095ec-a9f6-4e43-9553-d879dbec5799 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:33.929078 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ce4095ec-a9f6-4e43-9553-d879dbec5799 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:33.936524 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ce4095ec-a9f6-4e43-9553-d879dbec5799 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.092221 Aug 04 23:47:33.937074 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1167/2358] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:33 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:34.745100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4d4083c0-9c88-47d6-be93-2d2f14493efc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:34.745974 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4d4083c0-9c88-47d6-be93-2d2f14493efc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:34.753697 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4d4083c0-9c88-47d6-be93-2d2f14493efc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:34.754855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4d4083c0-9c88-47d6-be93-2d2f14493efc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:34.755325 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4d4083c0-9c88-47d6-be93-2d2f14493efc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:34.756037 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4d4083c0-9c88-47d6-be93-2d2f14493efc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:34.756486 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4d4083c0-9c88-47d6-be93-2d2f14493efc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:34.756904 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4d4083c0-9c88-47d6-be93-2d2f14493efc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:34.759938 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:47:34.848683 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4d4083c0-9c88-47d6-be93-2d2f14493efc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:34.858240 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4d4083c0-9c88-47d6-be93-2d2f14493efc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.116977 Aug 04 23:47:34.858859 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1192/2359] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:34 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:34.959063 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c9ac9850-156f-420d-be38-259d3f38c088 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:34.959663 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c9ac9850-156f-420d-be38-259d3f38c088 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:34.966401 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c9ac9850-156f-420d-be38-259d3f38c088 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:34.966896 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c9ac9850-156f-420d-be38-259d3f38c088 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:34.967329 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c9ac9850-156f-420d-be38-259d3f38c088 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:34.968025 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c9ac9850-156f-420d-be38-259d3f38c088 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:34.968476 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c9ac9850-156f-420d-be38-259d3f38c088 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:34.968894 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c9ac9850-156f-420d-be38-259d3f38c088 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:35.037491 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c9ac9850-156f-420d-be38-259d3f38c088 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:35.046129 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c9ac9850-156f-420d-be38-259d3f38c088 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.091556 Aug 04 23:47:35.046777 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1168/2360] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:34 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:35.879846 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-abeaa461-53f0-44cf-8371-3c180478c38e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:35.880481 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-abeaa461-53f0-44cf-8371-3c180478c38e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:35.887340 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-abeaa461-53f0-44cf-8371-3c180478c38e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:35.887854 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-abeaa461-53f0-44cf-8371-3c180478c38e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:35.888289 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-abeaa461-53f0-44cf-8371-3c180478c38e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:35.889013 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-abeaa461-53f0-44cf-8371-3c180478c38e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:35.889485 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-abeaa461-53f0-44cf-8371-3c180478c38e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:35.889955 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-abeaa461-53f0-44cf-8371-3c180478c38e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:35.954916 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-abeaa461-53f0-44cf-8371-3c180478c38e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:35.963137 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-abeaa461-53f0-44cf-8371-3c180478c38e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087770 Aug 04 23:47:35.963720 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1193/2361] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:35 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:36.068040 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5412138e-e96a-42ea-bdda-19110403f550 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:36.068637 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5412138e-e96a-42ea-bdda-19110403f550 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:36.075533 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5412138e-e96a-42ea-bdda-19110403f550 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:36.076030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5412138e-e96a-42ea-bdda-19110403f550 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:36.076452 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5412138e-e96a-42ea-bdda-19110403f550 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:36.077139 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5412138e-e96a-42ea-bdda-19110403f550 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:36.077582 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5412138e-e96a-42ea-bdda-19110403f550 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:36.078590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5412138e-e96a-42ea-bdda-19110403f550 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:36.146215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5412138e-e96a-42ea-bdda-19110403f550 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:36.154287 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5412138e-e96a-42ea-bdda-19110403f550 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.090518 Aug 04 23:47:36.154874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1169/2362] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:36 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:36.984898 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-17d6b286-fd2d-4fb3-9985-7c69a55c517c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:36.985504 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-17d6b286-fd2d-4fb3-9985-7c69a55c517c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:36.992903 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17d6b286-fd2d-4fb3-9985-7c69a55c517c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:36.993397 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17d6b286-fd2d-4fb3-9985-7c69a55c517c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:36.993824 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17d6b286-fd2d-4fb3-9985-7c69a55c517c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:36.994573 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17d6b286-fd2d-4fb3-9985-7c69a55c517c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:36.995025 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17d6b286-fd2d-4fb3-9985-7c69a55c517c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:36.995444 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-17d6b286-fd2d-4fb3-9985-7c69a55c517c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:37.063974 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-17d6b286-fd2d-4fb3-9985-7c69a55c517c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:37.073770 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-17d6b286-fd2d-4fb3-9985-7c69a55c517c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.092732 Aug 04 23:47:37.074352 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1194/2363] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:36 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:37.176401 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-caf7a343-b03e-4b9a-9cce-532eeba276b8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:37.177012 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-caf7a343-b03e-4b9a-9cce-532eeba276b8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:37.184279 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-caf7a343-b03e-4b9a-9cce-532eeba276b8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:37.184751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-caf7a343-b03e-4b9a-9cce-532eeba276b8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:37.185181 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-caf7a343-b03e-4b9a-9cce-532eeba276b8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:37.185854 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-caf7a343-b03e-4b9a-9cce-532eeba276b8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:37.186297 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-caf7a343-b03e-4b9a-9cce-532eeba276b8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:37.186735 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-caf7a343-b03e-4b9a-9cce-532eeba276b8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:37.251084 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-caf7a343-b03e-4b9a-9cce-532eeba276b8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:37.260350 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-caf7a343-b03e-4b9a-9cce-532eeba276b8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.087994 Aug 04 23:47:37.260918 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1170/2364] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:37 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:38.097128 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1af843d2-9cc1-40db-9a8e-12382996a96d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:38.097739 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1af843d2-9cc1-40db-9a8e-12382996a96d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:38.104207 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1af843d2-9cc1-40db-9a8e-12382996a96d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:38.104683 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1af843d2-9cc1-40db-9a8e-12382996a96d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:38.105111 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1af843d2-9cc1-40db-9a8e-12382996a96d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:38.105794 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1af843d2-9cc1-40db-9a8e-12382996a96d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:38.106240 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1af843d2-9cc1-40db-9a8e-12382996a96d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:38.106686 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1af843d2-9cc1-40db-9a8e-12382996a96d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:38.169421 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1af843d2-9cc1-40db-9a8e-12382996a96d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:38.177525 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1af843d2-9cc1-40db-9a8e-12382996a96d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084301 Aug 04 23:47:38.178087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1195/2365] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:38 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:38.281979 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-db7dc5a9-65a1-4bf0-b87e-f72f794bf037 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:38.282608 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-db7dc5a9-65a1-4bf0-b87e-f72f794bf037 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:38.289483 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-db7dc5a9-65a1-4bf0-b87e-f72f794bf037 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:38.289948 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-db7dc5a9-65a1-4bf0-b87e-f72f794bf037 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:38.290405 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-db7dc5a9-65a1-4bf0-b87e-f72f794bf037 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:38.291090 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-db7dc5a9-65a1-4bf0-b87e-f72f794bf037 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:38.291540 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-db7dc5a9-65a1-4bf0-b87e-f72f794bf037 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:38.292223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-db7dc5a9-65a1-4bf0-b87e-f72f794bf037 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:38.362250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-db7dc5a9-65a1-4bf0-b87e-f72f794bf037 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:38.371100 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-db7dc5a9-65a1-4bf0-b87e-f72f794bf037 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.092928 Aug 04 23:47:38.371685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1171/2366] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:38 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:39.197589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6911a2ae-4fb1-4175-a654-442de698ad67 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:39.198213 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6911a2ae-4fb1-4175-a654-442de698ad67 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:39.205033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6911a2ae-4fb1-4175-a654-442de698ad67 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:39.209108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6911a2ae-4fb1-4175-a654-442de698ad67 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:39.209108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6911a2ae-4fb1-4175-a654-442de698ad67 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:39.209108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6911a2ae-4fb1-4175-a654-442de698ad67 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:39.209108 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6911a2ae-4fb1-4175-a654-442de698ad67 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:39.209569 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6911a2ae-4fb1-4175-a654-442de698ad67 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:39.271801 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6911a2ae-4fb1-4175-a654-442de698ad67 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:39.279427 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6911a2ae-4fb1-4175-a654-442de698ad67 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085696 Aug 04 23:47:39.279990 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1196/2367] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:39 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:39.392215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-024f5856-4b7d-40d6-b02c-dac712d8f998 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:39.392827 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-024f5856-4b7d-40d6-b02c-dac712d8f998 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:39.400218 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-024f5856-4b7d-40d6-b02c-dac712d8f998 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:39.400696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-024f5856-4b7d-40d6-b02c-dac712d8f998 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:39.401125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-024f5856-4b7d-40d6-b02c-dac712d8f998 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:39.401814 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-024f5856-4b7d-40d6-b02c-dac712d8f998 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:39.402262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-024f5856-4b7d-40d6-b02c-dac712d8f998 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:39.402703 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-024f5856-4b7d-40d6-b02c-dac712d8f998 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:39.468751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-024f5856-4b7d-40d6-b02c-dac712d8f998 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:39.477186 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-024f5856-4b7d-40d6-b02c-dac712d8f998 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.088827 Aug 04 23:47:39.477756 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1172/2368] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:39 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:40.301603 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5bee26b4-3432-4994-a435-eabe1228c307 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:40.302212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5bee26b4-3432-4994-a435-eabe1228c307 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:40.308889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5bee26b4-3432-4994-a435-eabe1228c307 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:40.309385 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5bee26b4-3432-4994-a435-eabe1228c307 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:40.309825 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5bee26b4-3432-4994-a435-eabe1228c307 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:40.310567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5bee26b4-3432-4994-a435-eabe1228c307 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:40.311027 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5bee26b4-3432-4994-a435-eabe1228c307 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:40.311451 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5bee26b4-3432-4994-a435-eabe1228c307 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:40.373712 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5bee26b4-3432-4994-a435-eabe1228c307 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:40.382419 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5bee26b4-3432-4994-a435-eabe1228c307 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085055 Aug 04 23:47:40.383004 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1197/2369] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:40 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:40.498099 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-68350389-01b3-4ead-a5ae-d3f5248f1256 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:40.498733 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-68350389-01b3-4ead-a5ae-d3f5248f1256 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:40.506130 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68350389-01b3-4ead-a5ae-d3f5248f1256 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:40.506639 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68350389-01b3-4ead-a5ae-d3f5248f1256 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:40.507068 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68350389-01b3-4ead-a5ae-d3f5248f1256 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:40.507750 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68350389-01b3-4ead-a5ae-d3f5248f1256 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:40.508193 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68350389-01b3-4ead-a5ae-d3f5248f1256 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:40.508607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-68350389-01b3-4ead-a5ae-d3f5248f1256 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:40.576829 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-68350389-01b3-4ead-a5ae-d3f5248f1256 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:40.585859 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-68350389-01b3-4ead-a5ae-d3f5248f1256 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.092362 Aug 04 23:47:40.586459 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1173/2370] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:40 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:41.403675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0327c1eb-cc7b-44b1-ac6e-cc4cd2d5c1d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:41.404549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0327c1eb-cc7b-44b1-ac6e-cc4cd2d5c1d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:41.412335 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0327c1eb-cc7b-44b1-ac6e-cc4cd2d5c1d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:41.412811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0327c1eb-cc7b-44b1-ac6e-cc4cd2d5c1d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:41.413241 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0327c1eb-cc7b-44b1-ac6e-cc4cd2d5c1d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:41.413950 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0327c1eb-cc7b-44b1-ac6e-cc4cd2d5c1d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:41.414417 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0327c1eb-cc7b-44b1-ac6e-cc4cd2d5c1d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:41.414842 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0327c1eb-cc7b-44b1-ac6e-cc4cd2d5c1d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:41.482911 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0327c1eb-cc7b-44b1-ac6e-cc4cd2d5c1d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:41.492008 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0327c1eb-cc7b-44b1-ac6e-cc4cd2d5c1d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.092186 Aug 04 23:47:41.492574 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1198/2371] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:41 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:41.607328 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a36ac8c9-bae5-4f9c-b417-f45fdb1bed33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:41.607953 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a36ac8c9-bae5-4f9c-b417-f45fdb1bed33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:41.615202 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a36ac8c9-bae5-4f9c-b417-f45fdb1bed33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:41.615719 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a36ac8c9-bae5-4f9c-b417-f45fdb1bed33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:41.616163 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a36ac8c9-bae5-4f9c-b417-f45fdb1bed33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:41.616861 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a36ac8c9-bae5-4f9c-b417-f45fdb1bed33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:41.617311 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a36ac8c9-bae5-4f9c-b417-f45fdb1bed33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:41.617737 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a36ac8c9-bae5-4f9c-b417-f45fdb1bed33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:41.683838 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a36ac8c9-bae5-4f9c-b417-f45fdb1bed33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:41.692141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a36ac8c9-bae5-4f9c-b417-f45fdb1bed33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.088613 Aug 04 23:47:41.692842 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1174/2372] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:41 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:42.513750 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9d65a184-e25f-474b-a02a-2200141a7ea7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:42.514474 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9d65a184-e25f-474b-a02a-2200141a7ea7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:42.522284 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d65a184-e25f-474b-a02a-2200141a7ea7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:42.522830 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d65a184-e25f-474b-a02a-2200141a7ea7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:42.523282 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d65a184-e25f-474b-a02a-2200141a7ea7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:42.524022 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d65a184-e25f-474b-a02a-2200141a7ea7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:42.524484 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d65a184-e25f-474b-a02a-2200141a7ea7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:42.524910 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9d65a184-e25f-474b-a02a-2200141a7ea7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:42.616147 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9d65a184-e25f-474b-a02a-2200141a7ea7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:42.623933 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9d65a184-e25f-474b-a02a-2200141a7ea7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.114310 Aug 04 23:47:42.624495 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1199/2373] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:42 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:42.714414 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b8f48f6e-731b-4c2b-bed3-bc01b5d76b3c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:42.715062 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b8f48f6e-731b-4c2b-bed3-bc01b5d76b3c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:42.721544 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b8f48f6e-731b-4c2b-bed3-bc01b5d76b3c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:42.722021 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b8f48f6e-731b-4c2b-bed3-bc01b5d76b3c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:42.722546 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b8f48f6e-731b-4c2b-bed3-bc01b5d76b3c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:42.723973 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b8f48f6e-731b-4c2b-bed3-bc01b5d76b3c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:42.725103 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b8f48f6e-731b-4c2b-bed3-bc01b5d76b3c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:42.725522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b8f48f6e-731b-4c2b-bed3-bc01b5d76b3c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:42.795229 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b8f48f6e-731b-4c2b-bed3-bc01b5d76b3c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:42.804314 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b8f48f6e-731b-4c2b-bed3-bc01b5d76b3c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.093724 Aug 04 23:47:42.804880 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1175/2374] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:42 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:43.646411 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-160074b8-6add-4a9f-88b8-5f07909e9800 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:43.647064 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-160074b8-6add-4a9f-88b8-5f07909e9800 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:43.654038 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-160074b8-6add-4a9f-88b8-5f07909e9800 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:43.654588 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-160074b8-6add-4a9f-88b8-5f07909e9800 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:43.655021 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-160074b8-6add-4a9f-88b8-5f07909e9800 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:43.655730 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-160074b8-6add-4a9f-88b8-5f07909e9800 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:43.656180 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-160074b8-6add-4a9f-88b8-5f07909e9800 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:43.656604 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-160074b8-6add-4a9f-88b8-5f07909e9800 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:43.724353 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-160074b8-6add-4a9f-88b8-5f07909e9800 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:43.732723 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-160074b8-6add-4a9f-88b8-5f07909e9800 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.090278 Aug 04 23:47:43.733303 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1200/2375] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:43 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:43.825329 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9cf6c8ba-6283-4f56-ba85-8f574930d195 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:43.825990 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9cf6c8ba-6283-4f56-ba85-8f574930d195 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:43.834307 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9cf6c8ba-6283-4f56-ba85-8f574930d195 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:43.834826 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9cf6c8ba-6283-4f56-ba85-8f574930d195 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:43.835269 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9cf6c8ba-6283-4f56-ba85-8f574930d195 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:43.835993 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9cf6c8ba-6283-4f56-ba85-8f574930d195 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:43.836448 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9cf6c8ba-6283-4f56-ba85-8f574930d195 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:43.837288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9cf6c8ba-6283-4f56-ba85-8f574930d195 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:43.918687 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9cf6c8ba-6283-4f56-ba85-8f574930d195 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:43.928124 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9cf6c8ba-6283-4f56-ba85-8f574930d195 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.106675 Aug 04 23:47:43.928702 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1176/2376] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:43 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:44.755433 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-87402dbb-a04c-4c08-8380-5e2b9275f754 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:44.756110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-87402dbb-a04c-4c08-8380-5e2b9275f754 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:44.763315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87402dbb-a04c-4c08-8380-5e2b9275f754 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:44.763852 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87402dbb-a04c-4c08-8380-5e2b9275f754 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:44.764318 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87402dbb-a04c-4c08-8380-5e2b9275f754 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:44.765069 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87402dbb-a04c-4c08-8380-5e2b9275f754 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:44.765560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87402dbb-a04c-4c08-8380-5e2b9275f754 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:44.766020 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-87402dbb-a04c-4c08-8380-5e2b9275f754 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:44.843075 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-87402dbb-a04c-4c08-8380-5e2b9275f754 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:44.851067 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-87402dbb-a04c-4c08-8380-5e2b9275f754 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.100548 Aug 04 23:47:44.851660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1201/2377] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:44 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:44.949771 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e178630e-3c6e-409f-a796-c3a027661ad5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:44.950429 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e178630e-3c6e-409f-a796-c3a027661ad5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:44.957104 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e178630e-3c6e-409f-a796-c3a027661ad5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:44.957585 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e178630e-3c6e-409f-a796-c3a027661ad5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:44.958019 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e178630e-3c6e-409f-a796-c3a027661ad5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:44.958933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e178630e-3c6e-409f-a796-c3a027661ad5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:44.959389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e178630e-3c6e-409f-a796-c3a027661ad5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:44.959814 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e178630e-3c6e-409f-a796-c3a027661ad5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:45.030027 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e178630e-3c6e-409f-a796-c3a027661ad5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:45.038849 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e178630e-3c6e-409f-a796-c3a027661ad5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.092774 Aug 04 23:47:45.039433 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1177/2378] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:44 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:45.872261 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-444e310f-eb1b-4fe2-b21b-b0e80bd79199 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:45.872895 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-444e310f-eb1b-4fe2-b21b-b0e80bd79199 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:45.879353 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-444e310f-eb1b-4fe2-b21b-b0e80bd79199 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:45.879884 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-444e310f-eb1b-4fe2-b21b-b0e80bd79199 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:45.880319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-444e310f-eb1b-4fe2-b21b-b0e80bd79199 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:45.881002 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-444e310f-eb1b-4fe2-b21b-b0e80bd79199 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:45.881447 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-444e310f-eb1b-4fe2-b21b-b0e80bd79199 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:45.881864 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-444e310f-eb1b-4fe2-b21b-b0e80bd79199 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:45.948747 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-444e310f-eb1b-4fe2-b21b-b0e80bd79199 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:45.956429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-444e310f-eb1b-4fe2-b21b-b0e80bd79199 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087976 Aug 04 23:47:45.956987 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1202/2379] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:45 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:46.060761 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3e8aba0c-4b07-4733-adaf-9dfc6c8cab25 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:46.061380 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3e8aba0c-4b07-4733-adaf-9dfc6c8cab25 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:46.068726 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e8aba0c-4b07-4733-adaf-9dfc6c8cab25 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:46.069209 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e8aba0c-4b07-4733-adaf-9dfc6c8cab25 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:46.069671 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e8aba0c-4b07-4733-adaf-9dfc6c8cab25 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:46.070399 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e8aba0c-4b07-4733-adaf-9dfc6c8cab25 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:46.070845 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e8aba0c-4b07-4733-adaf-9dfc6c8cab25 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:46.071266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e8aba0c-4b07-4733-adaf-9dfc6c8cab25 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:46.137111 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3e8aba0c-4b07-4733-adaf-9dfc6c8cab25 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:46.139317 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:47:46.148038 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3e8aba0c-4b07-4733-adaf-9dfc6c8cab25 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.091052 Aug 04 23:47:46.148723 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1178/2380] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:46 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:46.979544 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-bcedf7b4-f85e-4d8d-973e-ca736e9710c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:46.980282 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-bcedf7b4-f85e-4d8d-973e-ca736e9710c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:46.987480 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bcedf7b4-f85e-4d8d-973e-ca736e9710c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:46.987962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bcedf7b4-f85e-4d8d-973e-ca736e9710c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:46.988393 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bcedf7b4-f85e-4d8d-973e-ca736e9710c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:46.989777 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bcedf7b4-f85e-4d8d-973e-ca736e9710c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:46.990608 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bcedf7b4-f85e-4d8d-973e-ca736e9710c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:46.991066 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bcedf7b4-f85e-4d8d-973e-ca736e9710c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:47.062209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-bcedf7b4-f85e-4d8d-973e-ca736e9710c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:47.070715 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-bcedf7b4-f85e-4d8d-973e-ca736e9710c2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.095137 Aug 04 23:47:47.071346 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1203/2381] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:46 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:47.168999 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-928f8bfd-775b-4543-8096-ee5bd1d7201b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:47.169627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-928f8bfd-775b-4543-8096-ee5bd1d7201b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:47.176448 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-928f8bfd-775b-4543-8096-ee5bd1d7201b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:47.177160 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-928f8bfd-775b-4543-8096-ee5bd1d7201b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:47.177767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-928f8bfd-775b-4543-8096-ee5bd1d7201b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:47.178517 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-928f8bfd-775b-4543-8096-ee5bd1d7201b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:47.178967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-928f8bfd-775b-4543-8096-ee5bd1d7201b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:47.179383 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-928f8bfd-775b-4543-8096-ee5bd1d7201b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:47.246889 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-928f8bfd-775b-4543-8096-ee5bd1d7201b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:47.260353 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-928f8bfd-775b-4543-8096-ee5bd1d7201b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.095030 Aug 04 23:47:47.261407 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1179/2382] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:47 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:48.091715 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d899d70e-2309-4114-8fbb-d40311f92010 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:48.092539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d899d70e-2309-4114-8fbb-d40311f92010 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:48.099527 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d899d70e-2309-4114-8fbb-d40311f92010 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:48.100011 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d899d70e-2309-4114-8fbb-d40311f92010 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:48.100452 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d899d70e-2309-4114-8fbb-d40311f92010 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:48.101150 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d899d70e-2309-4114-8fbb-d40311f92010 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:48.101592 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d899d70e-2309-4114-8fbb-d40311f92010 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:48.102024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d899d70e-2309-4114-8fbb-d40311f92010 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:48.167023 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d899d70e-2309-4114-8fbb-d40311f92010 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:48.175084 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d899d70e-2309-4114-8fbb-d40311f92010 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087180 Aug 04 23:47:48.175660 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1204/2383] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:48 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:48.284261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-778992a5-cd48-473d-aef0-a5a07866ec84 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:48.284892 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-778992a5-cd48-473d-aef0-a5a07866ec84 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:48.293350 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-778992a5-cd48-473d-aef0-a5a07866ec84 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:48.293832 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-778992a5-cd48-473d-aef0-a5a07866ec84 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:48.294263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-778992a5-cd48-473d-aef0-a5a07866ec84 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:48.294989 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-778992a5-cd48-473d-aef0-a5a07866ec84 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:48.295443 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-778992a5-cd48-473d-aef0-a5a07866ec84 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:48.295866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-778992a5-cd48-473d-aef0-a5a07866ec84 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:48.360505 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-778992a5-cd48-473d-aef0-a5a07866ec84 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:48.369994 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-778992a5-cd48-473d-aef0-a5a07866ec84 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.089529 Aug 04 23:47:48.370616 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1180/2384] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:48 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:49.196765 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3e0b2016-f89d-430f-9a54-d74d62f96385 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:49.197376 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3e0b2016-f89d-430f-9a54-d74d62f96385 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:49.204325 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e0b2016-f89d-430f-9a54-d74d62f96385 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:49.204823 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e0b2016-f89d-430f-9a54-d74d62f96385 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:49.205259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e0b2016-f89d-430f-9a54-d74d62f96385 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:49.205973 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e0b2016-f89d-430f-9a54-d74d62f96385 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:49.206449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e0b2016-f89d-430f-9a54-d74d62f96385 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:49.206906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3e0b2016-f89d-430f-9a54-d74d62f96385 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:49.274308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3e0b2016-f89d-430f-9a54-d74d62f96385 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:49.285497 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3e0b2016-f89d-430f-9a54-d74d62f96385 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.092677 Aug 04 23:47:49.286822 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1205/2385] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:49 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:49.393785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a3a24bc8-17d9-425c-b2bd-d02e2324e6cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:49.394504 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a3a24bc8-17d9-425c-b2bd-d02e2324e6cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:49.401182 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3a24bc8-17d9-425c-b2bd-d02e2324e6cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:49.401664 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3a24bc8-17d9-425c-b2bd-d02e2324e6cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:49.402100 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3a24bc8-17d9-425c-b2bd-d02e2324e6cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:49.402824 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3a24bc8-17d9-425c-b2bd-d02e2324e6cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:49.403283 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3a24bc8-17d9-425c-b2bd-d02e2324e6cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:49.403710 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a3a24bc8-17d9-425c-b2bd-d02e2324e6cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:49.470036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a3a24bc8-17d9-425c-b2bd-d02e2324e6cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:49.479980 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a3a24bc8-17d9-425c-b2bd-d02e2324e6cb tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.091322 Aug 04 23:47:49.480547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1181/2386] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:49 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:50.308477 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-149f567f-031c-44e0-9e18-3df8e1eeda8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:50.309142 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-149f567f-031c-44e0-9e18-3df8e1eeda8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:50.315678 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-149f567f-031c-44e0-9e18-3df8e1eeda8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:50.316157 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-149f567f-031c-44e0-9e18-3df8e1eeda8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:50.316586 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-149f567f-031c-44e0-9e18-3df8e1eeda8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:50.317281 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-149f567f-031c-44e0-9e18-3df8e1eeda8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:50.318694 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-149f567f-031c-44e0-9e18-3df8e1eeda8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:50.319132 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-149f567f-031c-44e0-9e18-3df8e1eeda8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:50.385236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-149f567f-031c-44e0-9e18-3df8e1eeda8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:50.392929 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-149f567f-031c-44e0-9e18-3df8e1eeda8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.088304 Aug 04 23:47:50.393552 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1206/2387] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:50 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:50.501276 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1ee3de4b-de84-403c-8ff6-23f8512c0260 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:50.501877 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1ee3de4b-de84-403c-8ff6-23f8512c0260 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:50.508730 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ee3de4b-de84-403c-8ff6-23f8512c0260 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:50.509388 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ee3de4b-de84-403c-8ff6-23f8512c0260 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:50.509644 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ee3de4b-de84-403c-8ff6-23f8512c0260 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:50.510333 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ee3de4b-de84-403c-8ff6-23f8512c0260 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:50.510826 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ee3de4b-de84-403c-8ff6-23f8512c0260 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:50.511336 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1ee3de4b-de84-403c-8ff6-23f8512c0260 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:50.541668 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:47:50.541994 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:47:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:47:50.578681 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1ee3de4b-de84-403c-8ff6-23f8512c0260 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:50.587955 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1ee3de4b-de84-403c-8ff6-23f8512c0260 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.090650 Aug 04 23:47:50.588519 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1182/2388] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:50 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:51.415664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-40a1d9fc-f688-4cde-b3fe-45107f0b0fc4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:51.416309 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-40a1d9fc-f688-4cde-b3fe-45107f0b0fc4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:51.423448 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-40a1d9fc-f688-4cde-b3fe-45107f0b0fc4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:51.423940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-40a1d9fc-f688-4cde-b3fe-45107f0b0fc4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:51.424407 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-40a1d9fc-f688-4cde-b3fe-45107f0b0fc4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:51.425139 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-40a1d9fc-f688-4cde-b3fe-45107f0b0fc4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:51.425564 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-40a1d9fc-f688-4cde-b3fe-45107f0b0fc4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:51.425984 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-40a1d9fc-f688-4cde-b3fe-45107f0b0fc4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:51.493089 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-40a1d9fc-f688-4cde-b3fe-45107f0b0fc4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:51.501085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-40a1d9fc-f688-4cde-b3fe-45107f0b0fc4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.090503 Aug 04 23:47:51.501657 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1207/2389] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:51 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:51.609187 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fd9ed11c-0db7-4992-ac9e-c117a15accc4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:51.609806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-fd9ed11c-0db7-4992-ac9e-c117a15accc4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:51.616966 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fd9ed11c-0db7-4992-ac9e-c117a15accc4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:51.617451 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fd9ed11c-0db7-4992-ac9e-c117a15accc4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:51.617879 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fd9ed11c-0db7-4992-ac9e-c117a15accc4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:51.618620 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fd9ed11c-0db7-4992-ac9e-c117a15accc4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:51.619061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fd9ed11c-0db7-4992-ac9e-c117a15accc4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:51.619474 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fd9ed11c-0db7-4992-ac9e-c117a15accc4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:51.688592 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fd9ed11c-0db7-4992-ac9e-c117a15accc4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:51.697628 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-fd9ed11c-0db7-4992-ac9e-c117a15accc4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.092326 Aug 04 23:47:51.698207 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1183/2390] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:51 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:52.522459 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0449fd5d-c97e-44b0-98e6-c356e79288f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:52.523099 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0449fd5d-c97e-44b0-98e6-c356e79288f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:52.530349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0449fd5d-c97e-44b0-98e6-c356e79288f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:52.530870 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0449fd5d-c97e-44b0-98e6-c356e79288f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:52.531309 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0449fd5d-c97e-44b0-98e6-c356e79288f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:52.532007 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0449fd5d-c97e-44b0-98e6-c356e79288f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:52.532457 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0449fd5d-c97e-44b0-98e6-c356e79288f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:52.532882 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0449fd5d-c97e-44b0-98e6-c356e79288f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:52.597798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0449fd5d-c97e-44b0-98e6-c356e79288f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:52.600731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:47:52.607751 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0449fd5d-c97e-44b0-98e6-c356e79288f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.089172 Aug 04 23:47:52.608338 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1208/2391] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:52 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:52.719695 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-1e46ba0b-8949-428b-96f7-fa2417731985 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:52.720303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-1e46ba0b-8949-428b-96f7-fa2417731985 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:52.727157 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1e46ba0b-8949-428b-96f7-fa2417731985 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:52.727623 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1e46ba0b-8949-428b-96f7-fa2417731985 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:52.728054 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1e46ba0b-8949-428b-96f7-fa2417731985 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:52.728766 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1e46ba0b-8949-428b-96f7-fa2417731985 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:52.729246 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1e46ba0b-8949-428b-96f7-fa2417731985 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:52.729656 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-1e46ba0b-8949-428b-96f7-fa2417731985 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:52.803077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-1e46ba0b-8949-428b-96f7-fa2417731985 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:52.811435 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-1e46ba0b-8949-428b-96f7-fa2417731985 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.095698 Aug 04 23:47:52.812029 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1184/2392] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:52 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:53.632832 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b8e71c2c-2d6d-4e37-af32-d773ded32009 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:53.633967 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b8e71c2c-2d6d-4e37-af32-d773ded32009 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:53.646348 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8e71c2c-2d6d-4e37-af32-d773ded32009 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:53.647273 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8e71c2c-2d6d-4e37-af32-d773ded32009 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:53.648071 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8e71c2c-2d6d-4e37-af32-d773ded32009 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:53.649365 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8e71c2c-2d6d-4e37-af32-d773ded32009 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:53.650217 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8e71c2c-2d6d-4e37-af32-d773ded32009 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:53.651056 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8e71c2c-2d6d-4e37-af32-d773ded32009 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:53.737315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b8e71c2c-2d6d-4e37-af32-d773ded32009 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:53.746206 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b8e71c2c-2d6d-4e37-af32-d773ded32009 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.120226 Aug 04 23:47:53.746833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1209/2393] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:53 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:53.833522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0013d5c3-2006-43c1-8484-ed9fd701d555 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:53.835007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0013d5c3-2006-43c1-8484-ed9fd701d555 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:53.837226 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=54 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:47:53.842842 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0013d5c3-2006-43c1-8484-ed9fd701d555 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:53.843322 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0013d5c3-2006-43c1-8484-ed9fd701d555 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:53.843748 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0013d5c3-2006-43c1-8484-ed9fd701d555 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:53.844444 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0013d5c3-2006-43c1-8484-ed9fd701d555 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:53.844909 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0013d5c3-2006-43c1-8484-ed9fd701d555 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:53.845308 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0013d5c3-2006-43c1-8484-ed9fd701d555 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:53.918280 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0013d5c3-2006-43c1-8484-ed9fd701d555 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:53.926583 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0013d5c3-2006-43c1-8484-ed9fd701d555 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.097188 Aug 04 23:47:53.928103 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1185/2394] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:53 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:54.769105 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-64cec39e-70c1-4ffb-9ea8-a1ee437ccebd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:54.769815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-64cec39e-70c1-4ffb-9ea8-a1ee437ccebd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:54.776446 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64cec39e-70c1-4ffb-9ea8-a1ee437ccebd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:54.777007 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64cec39e-70c1-4ffb-9ea8-a1ee437ccebd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:54.777452 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64cec39e-70c1-4ffb-9ea8-a1ee437ccebd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:54.778166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64cec39e-70c1-4ffb-9ea8-a1ee437ccebd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:54.778652 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64cec39e-70c1-4ffb-9ea8-a1ee437ccebd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:54.779135 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64cec39e-70c1-4ffb-9ea8-a1ee437ccebd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:54.848330 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-64cec39e-70c1-4ffb-9ea8-a1ee437ccebd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:54.857140 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-64cec39e-70c1-4ffb-9ea8-a1ee437ccebd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.092072 Aug 04 23:47:54.857727 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1210/2395] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:54 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:54.949277 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6f051de2-4ce6-4fd9-890e-16cf619c3f82 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:54.949913 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6f051de2-4ce6-4fd9-890e-16cf619c3f82 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:54.956858 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f051de2-4ce6-4fd9-890e-16cf619c3f82 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:54.957340 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f051de2-4ce6-4fd9-890e-16cf619c3f82 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:54.958313 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f051de2-4ce6-4fd9-890e-16cf619c3f82 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:54.959888 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f051de2-4ce6-4fd9-890e-16cf619c3f82 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:54.960366 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f051de2-4ce6-4fd9-890e-16cf619c3f82 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:54.960843 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f051de2-4ce6-4fd9-890e-16cf619c3f82 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:55.030546 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6f051de2-4ce6-4fd9-890e-16cf619c3f82 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:55.042599 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6f051de2-4ce6-4fd9-890e-16cf619c3f82 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.096661 Aug 04 23:47:55.043834 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1186/2396] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:54 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:55.886750 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ac91d3bc-b9ad-4fb8-9186-00ffce6f387e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:55.887384 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ac91d3bc-b9ad-4fb8-9186-00ffce6f387e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:55.889887 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=56 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:47:55.895490 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac91d3bc-b9ad-4fb8-9186-00ffce6f387e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:55.895981 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac91d3bc-b9ad-4fb8-9186-00ffce6f387e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:55.896421 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac91d3bc-b9ad-4fb8-9186-00ffce6f387e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:55.897133 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac91d3bc-b9ad-4fb8-9186-00ffce6f387e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:55.897585 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac91d3bc-b9ad-4fb8-9186-00ffce6f387e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:55.898007 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac91d3bc-b9ad-4fb8-9186-00ffce6f387e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:55.967635 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ac91d3bc-b9ad-4fb8-9186-00ffce6f387e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:55.975520 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ac91d3bc-b9ad-4fb8-9186-00ffce6f387e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.092769 Aug 04 23:47:55.976110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1211/2397] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:55 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:56.065971 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d80fb446-8391-4bed-af45-4fc7b49a9fad tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:56.066611 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d80fb446-8391-4bed-af45-4fc7b49a9fad tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:56.074799 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d80fb446-8391-4bed-af45-4fc7b49a9fad tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:56.075283 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d80fb446-8391-4bed-af45-4fc7b49a9fad tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:56.075718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d80fb446-8391-4bed-af45-4fc7b49a9fad tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:56.076417 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d80fb446-8391-4bed-af45-4fc7b49a9fad tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:56.076863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d80fb446-8391-4bed-af45-4fc7b49a9fad tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:56.077288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d80fb446-8391-4bed-af45-4fc7b49a9fad tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:56.147817 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d80fb446-8391-4bed-af45-4fc7b49a9fad tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:56.156523 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d80fb446-8391-4bed-af45-4fc7b49a9fad tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.094321 Aug 04 23:47:56.157109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1187/2398] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:56 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:56.998661 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-44416dc3-97b1-4ff0-9e65-4aa0592e3581 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:56.999276 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-44416dc3-97b1-4ff0-9e65-4aa0592e3581 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:57.006886 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44416dc3-97b1-4ff0-9e65-4aa0592e3581 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:57.007376 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44416dc3-97b1-4ff0-9e65-4aa0592e3581 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:57.007822 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44416dc3-97b1-4ff0-9e65-4aa0592e3581 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:57.008541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44416dc3-97b1-4ff0-9e65-4aa0592e3581 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:57.009001 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44416dc3-97b1-4ff0-9e65-4aa0592e3581 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:57.009425 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-44416dc3-97b1-4ff0-9e65-4aa0592e3581 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:57.078073 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-44416dc3-97b1-4ff0-9e65-4aa0592e3581 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:57.086818 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-44416dc3-97b1-4ff0-9e65-4aa0592e3581 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.092005 Aug 04 23:47:57.087419 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1212/2399] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:56 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:57.178341 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-51734a59-a7c7-4221-a0ab-ef21900e65e4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:57.178986 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-51734a59-a7c7-4221-a0ab-ef21900e65e4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:57.186292 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51734a59-a7c7-4221-a0ab-ef21900e65e4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:57.186898 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51734a59-a7c7-4221-a0ab-ef21900e65e4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:57.187338 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51734a59-a7c7-4221-a0ab-ef21900e65e4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:57.188056 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51734a59-a7c7-4221-a0ab-ef21900e65e4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:57.188509 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51734a59-a7c7-4221-a0ab-ef21900e65e4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:57.188936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-51734a59-a7c7-4221-a0ab-ef21900e65e4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:57.256854 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-51734a59-a7c7-4221-a0ab-ef21900e65e4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:57.265370 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-51734a59-a7c7-4221-a0ab-ef21900e65e4 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.090944 Aug 04 23:47:57.265953 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1188/2400] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:57 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:47:58.107712 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ee29293f-c7b6-4d14-a316-3cbb782512ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:58.108338 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ee29293f-c7b6-4d14-a316-3cbb782512ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:58.115957 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee29293f-c7b6-4d14-a316-3cbb782512ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:58.116534 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee29293f-c7b6-4d14-a316-3cbb782512ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:58.116974 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee29293f-c7b6-4d14-a316-3cbb782512ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:58.117690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee29293f-c7b6-4d14-a316-3cbb782512ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:58.118142 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee29293f-c7b6-4d14-a316-3cbb782512ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:58.118592 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ee29293f-c7b6-4d14-a316-3cbb782512ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:58.207456 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ee29293f-c7b6-4d14-a316-3cbb782512ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:58.216182 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ee29293f-c7b6-4d14-a316-3cbb782512ba tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.112674 Aug 04 23:47:58.216779 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1213/2401] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:58 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:58.288383 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a751e7c9-4f50-41f5-adfe-03159f7caf02 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:58.289007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a751e7c9-4f50-41f5-adfe-03159f7caf02 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:58.296103 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a751e7c9-4f50-41f5-adfe-03159f7caf02 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:58.296584 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a751e7c9-4f50-41f5-adfe-03159f7caf02 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:58.297012 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a751e7c9-4f50-41f5-adfe-03159f7caf02 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:58.297712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a751e7c9-4f50-41f5-adfe-03159f7caf02 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:58.298159 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a751e7c9-4f50-41f5-adfe-03159f7caf02 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:58.298606 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a751e7c9-4f50-41f5-adfe-03159f7caf02 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:58.372704 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a751e7c9-4f50-41f5-adfe-03159f7caf02 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:58.382586 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a751e7c9-4f50-41f5-adfe-03159f7caf02 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.099260 Aug 04 23:47:58.383358 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1189/2402] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:58 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:59.250462 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2dbfdf1d-ad55-480a-997b-f465a31b480a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:59.251166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2dbfdf1d-ad55-480a-997b-f465a31b480a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:59.259202 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2dbfdf1d-ad55-480a-997b-f465a31b480a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:59.259848 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2dbfdf1d-ad55-480a-997b-f465a31b480a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:59.260388 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2dbfdf1d-ad55-480a-997b-f465a31b480a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:59.261216 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2dbfdf1d-ad55-480a-997b-f465a31b480a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:59.261770 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2dbfdf1d-ad55-480a-997b-f465a31b480a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:59.262312 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2dbfdf1d-ad55-480a-997b-f465a31b480a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:59.333414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2dbfdf1d-ad55-480a-997b-f465a31b480a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:59.341850 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2dbfdf1d-ad55-480a-997b-f465a31b480a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.095504 Aug 04 23:47:59.342481 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1214/2403] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:59 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:47:59.404610 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-00348ef2-04d2-4ba2-a11d-6da521b9c2b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:47:59.405283 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-00348ef2-04d2-4ba2-a11d-6da521b9c2b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:47:59.412769 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-00348ef2-04d2-4ba2-a11d-6da521b9c2b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:59.413260 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-00348ef2-04d2-4ba2-a11d-6da521b9c2b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:59.413826 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-00348ef2-04d2-4ba2-a11d-6da521b9c2b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:59.414593 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-00348ef2-04d2-4ba2-a11d-6da521b9c2b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:47:59.415071 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-00348ef2-04d2-4ba2-a11d-6da521b9c2b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:47:59.415491 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-00348ef2-04d2-4ba2-a11d-6da521b9c2b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:47:59.483577 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-00348ef2-04d2-4ba2-a11d-6da521b9c2b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:47:59.492987 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-00348ef2-04d2-4ba2-a11d-6da521b9c2b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.092272 Aug 04 23:47:59.493588 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1190/2404] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:47:59 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:00.364515 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-cde06d72-2f64-44ca-91f1-7d8d8887e34a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:00.365293 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-cde06d72-2f64-44ca-91f1-7d8d8887e34a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:00.372534 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cde06d72-2f64-44ca-91f1-7d8d8887e34a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:00.373030 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cde06d72-2f64-44ca-91f1-7d8d8887e34a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:00.373468 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cde06d72-2f64-44ca-91f1-7d8d8887e34a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:00.374178 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cde06d72-2f64-44ca-91f1-7d8d8887e34a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:00.374674 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cde06d72-2f64-44ca-91f1-7d8d8887e34a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:00.375104 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cde06d72-2f64-44ca-91f1-7d8d8887e34a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:00.448356 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-cde06d72-2f64-44ca-91f1-7d8d8887e34a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:00.456502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-cde06d72-2f64-44ca-91f1-7d8d8887e34a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.095952 Aug 04 23:48:00.457091 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1215/2405] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:00 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:00.514687 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-57b916af-96a6-4706-9d7c-ca0133b87980 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:00.515295 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-57b916af-96a6-4706-9d7c-ca0133b87980 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:00.523035 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-57b916af-96a6-4706-9d7c-ca0133b87980 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:00.523517 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-57b916af-96a6-4706-9d7c-ca0133b87980 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:00.523946 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-57b916af-96a6-4706-9d7c-ca0133b87980 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:00.524649 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-57b916af-96a6-4706-9d7c-ca0133b87980 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:00.525090 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-57b916af-96a6-4706-9d7c-ca0133b87980 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:00.525508 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-57b916af-96a6-4706-9d7c-ca0133b87980 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:00.602650 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-57b916af-96a6-4706-9d7c-ca0133b87980 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:00.611163 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-57b916af-96a6-4706-9d7c-ca0133b87980 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.100353 Aug 04 23:48:00.611867 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1191/2406] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:00 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:01.485317 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c3ae89ec-5387-4118-9f79-000bff0dc1d6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:01.485939 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c3ae89ec-5387-4118-9f79-000bff0dc1d6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:01.492967 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3ae89ec-5387-4118-9f79-000bff0dc1d6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:01.493453 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3ae89ec-5387-4118-9f79-000bff0dc1d6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:01.493891 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3ae89ec-5387-4118-9f79-000bff0dc1d6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:01.494635 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3ae89ec-5387-4118-9f79-000bff0dc1d6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:01.495086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3ae89ec-5387-4118-9f79-000bff0dc1d6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:01.495512 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3ae89ec-5387-4118-9f79-000bff0dc1d6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:01.562306 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c3ae89ec-5387-4118-9f79-000bff0dc1d6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:01.571628 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c3ae89ec-5387-4118-9f79-000bff0dc1d6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.090247 Aug 04 23:48:01.572716 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1216/2407] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:01 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:01.635138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5ac589fa-97d0-4c7a-ba07-15087bd1b086 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:01.635752 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5ac589fa-97d0-4c7a-ba07-15087bd1b086 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:01.642336 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ac589fa-97d0-4c7a-ba07-15087bd1b086 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:01.642856 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ac589fa-97d0-4c7a-ba07-15087bd1b086 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:01.643288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ac589fa-97d0-4c7a-ba07-15087bd1b086 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:01.643993 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ac589fa-97d0-4c7a-ba07-15087bd1b086 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:01.644439 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ac589fa-97d0-4c7a-ba07-15087bd1b086 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:01.644858 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ac589fa-97d0-4c7a-ba07-15087bd1b086 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:01.720436 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5ac589fa-97d0-4c7a-ba07-15087bd1b086 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:01.729418 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5ac589fa-97d0-4c7a-ba07-15087bd1b086 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.098818 Aug 04 23:48:01.730005 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1192/2408] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:01 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:02.606233 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-56a441ce-e19a-459a-b6e7-4c4f154cd237 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:02.606880 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-56a441ce-e19a-459a-b6e7-4c4f154cd237 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:02.613379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-56a441ce-e19a-459a-b6e7-4c4f154cd237 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:02.613862 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-56a441ce-e19a-459a-b6e7-4c4f154cd237 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:02.614302 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-56a441ce-e19a-459a-b6e7-4c4f154cd237 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:02.615030 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-56a441ce-e19a-459a-b6e7-4c4f154cd237 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:02.615702 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-56a441ce-e19a-459a-b6e7-4c4f154cd237 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:02.616288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-56a441ce-e19a-459a-b6e7-4c4f154cd237 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:02.680304 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-56a441ce-e19a-459a-b6e7-4c4f154cd237 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:02.688072 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-56a441ce-e19a-459a-b6e7-4c4f154cd237 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085986 Aug 04 23:48:02.688646 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1217/2409] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:02 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:02.752866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ea438960-c5f9-4170-9d11-f52e15455d33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:02.753477 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ea438960-c5f9-4170-9d11-f52e15455d33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:02.760178 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea438960-c5f9-4170-9d11-f52e15455d33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:02.760658 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea438960-c5f9-4170-9d11-f52e15455d33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:02.761096 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea438960-c5f9-4170-9d11-f52e15455d33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:02.761796 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea438960-c5f9-4170-9d11-f52e15455d33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:02.762242 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea438960-c5f9-4170-9d11-f52e15455d33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:02.762694 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ea438960-c5f9-4170-9d11-f52e15455d33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:02.840190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ea438960-c5f9-4170-9d11-f52e15455d33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:02.848739 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ea438960-c5f9-4170-9d11-f52e15455d33 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.099683 Aug 04 23:48:02.849326 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1193/2410] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:02 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:03.453934 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:48:03.454204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:48:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:48:03.709140 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-805b8266-6788-42c9-a679-46c67adc1396 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:03.709751 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-805b8266-6788-42c9-a679-46c67adc1396 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:03.716254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-805b8266-6788-42c9-a679-46c67adc1396 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:03.716729 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-805b8266-6788-42c9-a679-46c67adc1396 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:03.717176 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-805b8266-6788-42c9-a679-46c67adc1396 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:03.717833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-805b8266-6788-42c9-a679-46c67adc1396 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:03.718276 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-805b8266-6788-42c9-a679-46c67adc1396 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:03.718745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-805b8266-6788-42c9-a679-46c67adc1396 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:03.784379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-805b8266-6788-42c9-a679-46c67adc1396 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:03.792899 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-805b8266-6788-42c9-a679-46c67adc1396 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087874 Aug 04 23:48:03.793476 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1218/2411] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:03 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:03.874826 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7f26089f-7f74-475e-acb1-1dc51421ee18 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:03.875428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7f26089f-7f74-475e-acb1-1dc51421ee18 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:03.882476 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7f26089f-7f74-475e-acb1-1dc51421ee18 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:03.882931 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7f26089f-7f74-475e-acb1-1dc51421ee18 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:03.883383 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7f26089f-7f74-475e-acb1-1dc51421ee18 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:03.884062 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7f26089f-7f74-475e-acb1-1dc51421ee18 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:03.884502 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7f26089f-7f74-475e-acb1-1dc51421ee18 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:03.884917 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7f26089f-7f74-475e-acb1-1dc51421ee18 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:03.948167 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7f26089f-7f74-475e-acb1-1dc51421ee18 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:03.960561 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7f26089f-7f74-475e-acb1-1dc51421ee18 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.089480 Aug 04 23:48:03.961058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1194/2412] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:03 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:04.814844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-40e788c4-2570-40d0-885d-ea606846b1a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:04.815484 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-40e788c4-2570-40d0-885d-ea606846b1a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:04.823152 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-40e788c4-2570-40d0-885d-ea606846b1a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:04.823644 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-40e788c4-2570-40d0-885d-ea606846b1a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:04.824086 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-40e788c4-2570-40d0-885d-ea606846b1a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:04.824806 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-40e788c4-2570-40d0-885d-ea606846b1a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:04.825263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-40e788c4-2570-40d0-885d-ea606846b1a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:04.825697 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-40e788c4-2570-40d0-885d-ea606846b1a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:04.895429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-40e788c4-2570-40d0-885d-ea606846b1a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:04.904116 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-40e788c4-2570-40d0-885d-ea606846b1a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.093238 Aug 04 23:48:04.904704 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1219/2413] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:04 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:04.982525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5ebea07d-3242-4692-b359-c8c50f0ee908 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:04.983527 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5ebea07d-3242-4692-b359-c8c50f0ee908 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:04.990606 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ebea07d-3242-4692-b359-c8c50f0ee908 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:04.992501 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ebea07d-3242-4692-b359-c8c50f0ee908 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:04.993116 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ebea07d-3242-4692-b359-c8c50f0ee908 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:04.993953 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ebea07d-3242-4692-b359-c8c50f0ee908 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:04.994570 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ebea07d-3242-4692-b359-c8c50f0ee908 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:04.995095 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ebea07d-3242-4692-b359-c8c50f0ee908 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:05.013502 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:48:05.066500 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5ebea07d-3242-4692-b359-c8c50f0ee908 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:05.075416 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5ebea07d-3242-4692-b359-c8c50f0ee908 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.097165 Aug 04 23:48:05.075999 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1195/2414] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:04 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:05.925557 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-054a7001-99fe-4570-8fa1-f04061d2e56d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:05.926244 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-054a7001-99fe-4570-8fa1-f04061d2e56d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:05.933433 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-054a7001-99fe-4570-8fa1-f04061d2e56d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:05.933922 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-054a7001-99fe-4570-8fa1-f04061d2e56d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:05.934378 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-054a7001-99fe-4570-8fa1-f04061d2e56d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:05.935085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-054a7001-99fe-4570-8fa1-f04061d2e56d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:05.935538 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-054a7001-99fe-4570-8fa1-f04061d2e56d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:05.935977 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-054a7001-99fe-4570-8fa1-f04061d2e56d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:06.001433 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-054a7001-99fe-4570-8fa1-f04061d2e56d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:06.009797 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-054a7001-99fe-4570-8fa1-f04061d2e56d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.088106 Aug 04 23:48:06.010563 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1220/2415] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:05 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:06.097381 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-82249fc3-1232-4eb6-9917-2a820b61cec3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:06.098075 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-82249fc3-1232-4eb6-9917-2a820b61cec3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:06.104830 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82249fc3-1232-4eb6-9917-2a820b61cec3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:06.105313 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82249fc3-1232-4eb6-9917-2a820b61cec3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:06.105751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82249fc3-1232-4eb6-9917-2a820b61cec3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:06.106479 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82249fc3-1232-4eb6-9917-2a820b61cec3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:06.106934 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82249fc3-1232-4eb6-9917-2a820b61cec3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:06.107358 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-82249fc3-1232-4eb6-9917-2a820b61cec3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:06.168360 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-82249fc3-1232-4eb6-9917-2a820b61cec3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:06.176617 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-82249fc3-1232-4eb6-9917-2a820b61cec3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.083923 Aug 04 23:48:06.177185 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1196/2416] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:06 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:07.031114 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4a9f3665-844e-4ea7-844e-3e10d925e711 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:07.031715 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4a9f3665-844e-4ea7-844e-3e10d925e711 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:07.038847 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4a9f3665-844e-4ea7-844e-3e10d925e711 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:07.039344 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4a9f3665-844e-4ea7-844e-3e10d925e711 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:07.039770 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4a9f3665-844e-4ea7-844e-3e10d925e711 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:07.040467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4a9f3665-844e-4ea7-844e-3e10d925e711 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:07.040915 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4a9f3665-844e-4ea7-844e-3e10d925e711 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:07.041339 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4a9f3665-844e-4ea7-844e-3e10d925e711 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:07.105352 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4a9f3665-844e-4ea7-844e-3e10d925e711 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:07.113047 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4a9f3665-844e-4ea7-844e-3e10d925e711 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085756 Aug 04 23:48:07.113706 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1221/2417] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:07 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:07.197097 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ae50c734-23d4-42ea-9788-5a75cfdd5ef1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:07.197732 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ae50c734-23d4-42ea-9788-5a75cfdd5ef1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:07.204556 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae50c734-23d4-42ea-9788-5a75cfdd5ef1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:07.205045 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae50c734-23d4-42ea-9788-5a75cfdd5ef1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:07.205507 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae50c734-23d4-42ea-9788-5a75cfdd5ef1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:07.206209 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae50c734-23d4-42ea-9788-5a75cfdd5ef1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:07.206691 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae50c734-23d4-42ea-9788-5a75cfdd5ef1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:07.207116 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae50c734-23d4-42ea-9788-5a75cfdd5ef1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:07.275817 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ae50c734-23d4-42ea-9788-5a75cfdd5ef1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:07.283908 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ae50c734-23d4-42ea-9788-5a75cfdd5ef1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.090718 Aug 04 23:48:07.284466 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1197/2418] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:07 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:08.135032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d13945c9-ece3-42bd-86f9-d4e0e96122f7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:08.135642 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d13945c9-ece3-42bd-86f9-d4e0e96122f7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:08.142132 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d13945c9-ece3-42bd-86f9-d4e0e96122f7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:08.142647 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d13945c9-ece3-42bd-86f9-d4e0e96122f7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:08.143090 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d13945c9-ece3-42bd-86f9-d4e0e96122f7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:08.143774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d13945c9-ece3-42bd-86f9-d4e0e96122f7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:08.144222 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d13945c9-ece3-42bd-86f9-d4e0e96122f7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:08.144643 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d13945c9-ece3-42bd-86f9-d4e0e96122f7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:08.206281 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d13945c9-ece3-42bd-86f9-d4e0e96122f7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:08.214056 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d13945c9-ece3-42bd-86f9-d4e0e96122f7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084089 Aug 04 23:48:08.214651 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1222/2419] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:08 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:08.305810 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f49b9217-d3a3-4c5d-a41c-bacd914c36d6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:08.306457 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f49b9217-d3a3-4c5d-a41c-bacd914c36d6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:08.312876 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f49b9217-d3a3-4c5d-a41c-bacd914c36d6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:08.313357 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f49b9217-d3a3-4c5d-a41c-bacd914c36d6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:08.313787 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f49b9217-d3a3-4c5d-a41c-bacd914c36d6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:08.314511 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f49b9217-d3a3-4c5d-a41c-bacd914c36d6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:08.314958 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f49b9217-d3a3-4c5d-a41c-bacd914c36d6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:08.315376 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f49b9217-d3a3-4c5d-a41c-bacd914c36d6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:08.377521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f49b9217-d3a3-4c5d-a41c-bacd914c36d6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:08.385529 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f49b9217-d3a3-4c5d-a41c-bacd914c36d6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.084336 Aug 04 23:48:08.386087 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1198/2420] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:08 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:09.235353 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a62a7c81-49bc-4f28-91e6-431dc0adddd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:09.235971 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a62a7c81-49bc-4f28-91e6-431dc0adddd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:09.243365 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a62a7c81-49bc-4f28-91e6-431dc0adddd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:09.243858 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a62a7c81-49bc-4f28-91e6-431dc0adddd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:09.244295 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a62a7c81-49bc-4f28-91e6-431dc0adddd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:09.244997 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a62a7c81-49bc-4f28-91e6-431dc0adddd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:09.245447 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a62a7c81-49bc-4f28-91e6-431dc0adddd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:09.245869 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a62a7c81-49bc-4f28-91e6-431dc0adddd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:09.309578 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a62a7c81-49bc-4f28-91e6-431dc0adddd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:09.317234 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a62a7c81-49bc-4f28-91e6-431dc0adddd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085696 Aug 04 23:48:09.317800 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1223/2421] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:09 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:09.406842 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-98488675-db9b-47af-87b9-5cf4733484ef tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:09.407489 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-98488675-db9b-47af-87b9-5cf4733484ef tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:09.413982 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98488675-db9b-47af-87b9-5cf4733484ef tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:09.414504 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98488675-db9b-47af-87b9-5cf4733484ef tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:09.414946 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98488675-db9b-47af-87b9-5cf4733484ef tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:09.415633 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98488675-db9b-47af-87b9-5cf4733484ef tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:09.416088 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98488675-db9b-47af-87b9-5cf4733484ef tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:09.416514 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-98488675-db9b-47af-87b9-5cf4733484ef tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:09.481819 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-98488675-db9b-47af-87b9-5cf4733484ef tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:09.489846 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-98488675-db9b-47af-87b9-5cf4733484ef tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.086788 Aug 04 23:48:09.490340 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1199/2422] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:09 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:10.341171 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-14f5a708-1098-4491-922f-71e1151c773a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:10.341838 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-14f5a708-1098-4491-922f-71e1151c773a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:10.348492 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-14f5a708-1098-4491-922f-71e1151c773a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:10.348974 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-14f5a708-1098-4491-922f-71e1151c773a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:10.349410 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-14f5a708-1098-4491-922f-71e1151c773a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:10.350113 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-14f5a708-1098-4491-922f-71e1151c773a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:10.351174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-14f5a708-1098-4491-922f-71e1151c773a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:10.351595 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-14f5a708-1098-4491-922f-71e1151c773a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:10.414142 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-14f5a708-1098-4491-922f-71e1151c773a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:10.424351 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-14f5a708-1098-4491-922f-71e1151c773a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086691 Aug 04 23:48:10.424938 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1224/2423] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:10 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:10.512933 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ec182dac-a3bf-4435-b839-2d0f13b8fed1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:10.513545 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ec182dac-a3bf-4435-b839-2d0f13b8fed1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:10.519958 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ec182dac-a3bf-4435-b839-2d0f13b8fed1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:10.520436 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ec182dac-a3bf-4435-b839-2d0f13b8fed1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:10.520871 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ec182dac-a3bf-4435-b839-2d0f13b8fed1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:10.521555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ec182dac-a3bf-4435-b839-2d0f13b8fed1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:10.522000 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ec182dac-a3bf-4435-b839-2d0f13b8fed1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:10.522521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ec182dac-a3bf-4435-b839-2d0f13b8fed1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:10.588160 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ec182dac-a3bf-4435-b839-2d0f13b8fed1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:10.596094 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ec182dac-a3bf-4435-b839-2d0f13b8fed1 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.088459 Aug 04 23:48:10.596595 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1200/2424] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:10 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:11.446634 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e3cf4dd1-51bf-45c0-ad2d-f41f080655f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:11.447251 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e3cf4dd1-51bf-45c0-ad2d-f41f080655f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:11.453770 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e3cf4dd1-51bf-45c0-ad2d-f41f080655f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:11.454244 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e3cf4dd1-51bf-45c0-ad2d-f41f080655f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:11.454705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e3cf4dd1-51bf-45c0-ad2d-f41f080655f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:11.455396 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e3cf4dd1-51bf-45c0-ad2d-f41f080655f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:11.455836 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e3cf4dd1-51bf-45c0-ad2d-f41f080655f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:11.456252 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e3cf4dd1-51bf-45c0-ad2d-f41f080655f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:11.474225 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:48:11.524750 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e3cf4dd1-51bf-45c0-ad2d-f41f080655f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:11.532681 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e3cf4dd1-51bf-45c0-ad2d-f41f080655f0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.090731 Aug 04 23:48:11.533270 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1225/2425] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:11 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:11.617698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4c0e11e0-6ff9-47d9-8e23-1e8ba938936e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:11.618308 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4c0e11e0-6ff9-47d9-8e23-1e8ba938936e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:11.624695 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4c0e11e0-6ff9-47d9-8e23-1e8ba938936e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:11.625173 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4c0e11e0-6ff9-47d9-8e23-1e8ba938936e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:11.625609 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4c0e11e0-6ff9-47d9-8e23-1e8ba938936e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:11.626298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4c0e11e0-6ff9-47d9-8e23-1e8ba938936e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:11.626809 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4c0e11e0-6ff9-47d9-8e23-1e8ba938936e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:11.627233 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4c0e11e0-6ff9-47d9-8e23-1e8ba938936e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:11.692249 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4c0e11e0-6ff9-47d9-8e23-1e8ba938936e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:11.701215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4c0e11e0-6ff9-47d9-8e23-1e8ba938936e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.087909 Aug 04 23:48:11.701747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1201/2426] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:11 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:12.555437 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5632eeee-b940-4482-9057-7a866664135a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:12.556065 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5632eeee-b940-4482-9057-7a866664135a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:12.562769 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5632eeee-b940-4482-9057-7a866664135a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:12.563253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5632eeee-b940-4482-9057-7a866664135a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:12.563686 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5632eeee-b940-4482-9057-7a866664135a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:12.564389 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5632eeee-b940-4482-9057-7a866664135a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:12.564858 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5632eeee-b940-4482-9057-7a866664135a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:12.565271 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5632eeee-b940-4482-9057-7a866664135a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:12.631216 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5632eeee-b940-4482-9057-7a866664135a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:12.639661 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5632eeee-b940-4482-9057-7a866664135a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.089622 Aug 04 23:48:12.640238 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1226/2427] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:12 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:12.721657 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b5bfbf85-965b-4fdc-93dd-024610c736dc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:12.722262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b5bfbf85-965b-4fdc-93dd-024610c736dc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:12.729878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b5bfbf85-965b-4fdc-93dd-024610c736dc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:12.730431 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b5bfbf85-965b-4fdc-93dd-024610c736dc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:12.731062 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b5bfbf85-965b-4fdc-93dd-024610c736dc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:12.732050 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b5bfbf85-965b-4fdc-93dd-024610c736dc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:12.732713 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b5bfbf85-965b-4fdc-93dd-024610c736dc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:12.733372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b5bfbf85-965b-4fdc-93dd-024610c736dc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:12.800084 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b5bfbf85-965b-4fdc-93dd-024610c736dc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:12.809216 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b5bfbf85-965b-4fdc-93dd-024610c736dc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.091259 Aug 04 23:48:12.809713 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1202/2428] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:12 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:13.660668 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d258f7e1-f944-4591-a8ce-f0f8dabf4d6b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:13.661288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d258f7e1-f944-4591-a8ce-f0f8dabf4d6b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:13.668277 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d258f7e1-f944-4591-a8ce-f0f8dabf4d6b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:13.668750 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d258f7e1-f944-4591-a8ce-f0f8dabf4d6b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:13.669195 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d258f7e1-f944-4591-a8ce-f0f8dabf4d6b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:13.670122 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d258f7e1-f944-4591-a8ce-f0f8dabf4d6b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:13.670657 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d258f7e1-f944-4591-a8ce-f0f8dabf4d6b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:13.671059 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d258f7e1-f944-4591-a8ce-f0f8dabf4d6b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:13.733545 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d258f7e1-f944-4591-a8ce-f0f8dabf4d6b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:13.741943 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d258f7e1-f944-4591-a8ce-f0f8dabf4d6b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084415 Aug 04 23:48:13.742814 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1227/2429] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:13 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:13.830780 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a78c12a1-67b9-46c8-adbd-ab42c8bbcd91 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:13.831486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a78c12a1-67b9-46c8-adbd-ab42c8bbcd91 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:13.839051 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a78c12a1-67b9-46c8-adbd-ab42c8bbcd91 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:13.839542 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a78c12a1-67b9-46c8-adbd-ab42c8bbcd91 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:13.839982 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a78c12a1-67b9-46c8-adbd-ab42c8bbcd91 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:13.840687 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a78c12a1-67b9-46c8-adbd-ab42c8bbcd91 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:13.841141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a78c12a1-67b9-46c8-adbd-ab42c8bbcd91 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:13.841566 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a78c12a1-67b9-46c8-adbd-ab42c8bbcd91 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:13.907486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a78c12a1-67b9-46c8-adbd-ab42c8bbcd91 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:13.917507 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a78c12a1-67b9-46c8-adbd-ab42c8bbcd91 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.090919 Aug 04 23:48:13.918078 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1203/2430] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:13 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:14.763706 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a59201e3-8c08-4265-9e9e-15165a7804a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:14.764315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a59201e3-8c08-4265-9e9e-15165a7804a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:14.770763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a59201e3-8c08-4265-9e9e-15165a7804a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:14.771244 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a59201e3-8c08-4265-9e9e-15165a7804a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:14.771675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a59201e3-8c08-4265-9e9e-15165a7804a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:14.772366 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a59201e3-8c08-4265-9e9e-15165a7804a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:14.772824 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a59201e3-8c08-4265-9e9e-15165a7804a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:14.773252 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a59201e3-8c08-4265-9e9e-15165a7804a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:14.841257 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a59201e3-8c08-4265-9e9e-15165a7804a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:14.849133 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a59201e3-8c08-4265-9e9e-15165a7804a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.089235 Aug 04 23:48:14.849700 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1228/2431] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:14 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:14.938960 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c7a6e73d-af9f-4c64-8053-e33126ca608a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:14.939598 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c7a6e73d-af9f-4c64-8053-e33126ca608a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:14.946978 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c7a6e73d-af9f-4c64-8053-e33126ca608a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:14.947466 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c7a6e73d-af9f-4c64-8053-e33126ca608a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:14.947906 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c7a6e73d-af9f-4c64-8053-e33126ca608a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:14.948616 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c7a6e73d-af9f-4c64-8053-e33126ca608a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:14.949069 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c7a6e73d-af9f-4c64-8053-e33126ca608a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:14.949496 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c7a6e73d-af9f-4c64-8053-e33126ca608a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:15.015626 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c7a6e73d-af9f-4c64-8053-e33126ca608a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:15.025009 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c7a6e73d-af9f-4c64-8053-e33126ca608a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.089828 Aug 04 23:48:15.025582 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1204/2432] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:14 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:15.870146 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-85afe3a8-0ad2-4921-a825-45af286420b5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:15.870781 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-85afe3a8-0ad2-4921-a825-45af286420b5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:15.877525 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85afe3a8-0ad2-4921-a825-45af286420b5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:15.878002 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85afe3a8-0ad2-4921-a825-45af286420b5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:15.878472 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85afe3a8-0ad2-4921-a825-45af286420b5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:15.879166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85afe3a8-0ad2-4921-a825-45af286420b5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:15.879619 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85afe3a8-0ad2-4921-a825-45af286420b5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:15.880043 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85afe3a8-0ad2-4921-a825-45af286420b5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:15.943280 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-85afe3a8-0ad2-4921-a825-45af286420b5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:15.951575 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-85afe3a8-0ad2-4921-a825-45af286420b5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085989 Aug 04 23:48:15.952265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1229/2433] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:15 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:16.046168 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-44774413-3494-4cc5-bace-0aba062e3c7d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:16.046819 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-44774413-3494-4cc5-bace-0aba062e3c7d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:16.053369 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44774413-3494-4cc5-bace-0aba062e3c7d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:16.053865 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44774413-3494-4cc5-bace-0aba062e3c7d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:16.055293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44774413-3494-4cc5-bace-0aba062e3c7d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:16.056224 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44774413-3494-4cc5-bace-0aba062e3c7d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:16.056688 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44774413-3494-4cc5-bace-0aba062e3c7d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:16.057124 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-44774413-3494-4cc5-bace-0aba062e3c7d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:16.124379 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-44774413-3494-4cc5-bace-0aba062e3c7d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:16.132576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-44774413-3494-4cc5-bace-0aba062e3c7d tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.090437 Aug 04 23:48:16.133055 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1205/2434] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:16 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:16.972995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-810e41dc-1bdf-469d-9c2b-3566ddc1759f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:16.973594 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-810e41dc-1bdf-469d-9c2b-3566ddc1759f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:16.980159 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-810e41dc-1bdf-469d-9c2b-3566ddc1759f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:16.980632 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-810e41dc-1bdf-469d-9c2b-3566ddc1759f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:16.981068 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-810e41dc-1bdf-469d-9c2b-3566ddc1759f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:16.981747 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-810e41dc-1bdf-469d-9c2b-3566ddc1759f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:16.982191 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-810e41dc-1bdf-469d-9c2b-3566ddc1759f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:16.982658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-810e41dc-1bdf-469d-9c2b-3566ddc1759f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:17.044690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-810e41dc-1bdf-469d-9c2b-3566ddc1759f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:17.052807 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-810e41dc-1bdf-469d-9c2b-3566ddc1759f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083643 Aug 04 23:48:17.053381 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1230/2435] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:16 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:17.153863 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-709419f7-749c-4347-aef8-8a9de356dbb0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:17.154591 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-709419f7-749c-4347-aef8-8a9de356dbb0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:17.161028 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-709419f7-749c-4347-aef8-8a9de356dbb0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:17.161507 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-709419f7-749c-4347-aef8-8a9de356dbb0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:17.161938 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-709419f7-749c-4347-aef8-8a9de356dbb0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:17.162658 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-709419f7-749c-4347-aef8-8a9de356dbb0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:17.163113 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-709419f7-749c-4347-aef8-8a9de356dbb0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:17.163574 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-709419f7-749c-4347-aef8-8a9de356dbb0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:17.227117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-709419f7-749c-4347-aef8-8a9de356dbb0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:17.235234 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-709419f7-749c-4347-aef8-8a9de356dbb0 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.085218 Aug 04 23:48:17.235784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1206/2436] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:17 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:18.075278 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1a28c86b-7efd-4056-8e26-47d83edd70df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:18.075996 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1a28c86b-7efd-4056-8e26-47d83edd70df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:18.082397 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1a28c86b-7efd-4056-8e26-47d83edd70df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:18.082882 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1a28c86b-7efd-4056-8e26-47d83edd70df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:18.083314 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1a28c86b-7efd-4056-8e26-47d83edd70df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:18.083999 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1a28c86b-7efd-4056-8e26-47d83edd70df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:18.084502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1a28c86b-7efd-4056-8e26-47d83edd70df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:18.084864 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1a28c86b-7efd-4056-8e26-47d83edd70df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:18.147601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1a28c86b-7efd-4056-8e26-47d83edd70df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:18.155527 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1a28c86b-7efd-4056-8e26-47d83edd70df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084116 Aug 04 23:48:18.156107 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1231/2437] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:18 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:18.258328 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b82e1bb0-5cfa-4589-9413-84eaf990fbf6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:18.258965 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b82e1bb0-5cfa-4589-9413-84eaf990fbf6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:18.265381 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b82e1bb0-5cfa-4589-9413-84eaf990fbf6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:18.265868 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b82e1bb0-5cfa-4589-9413-84eaf990fbf6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:18.266304 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b82e1bb0-5cfa-4589-9413-84eaf990fbf6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:18.267020 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b82e1bb0-5cfa-4589-9413-84eaf990fbf6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:18.267473 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b82e1bb0-5cfa-4589-9413-84eaf990fbf6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:18.267899 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b82e1bb0-5cfa-4589-9413-84eaf990fbf6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:18.335036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b82e1bb0-5cfa-4589-9413-84eaf990fbf6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:18.344143 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b82e1bb0-5cfa-4589-9413-84eaf990fbf6 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.090474 Aug 04 23:48:18.344701 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1207/2438] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:18 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:19.177331 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b0e5f59b-22d5-4bd8-bbc0-1020b3786bd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:19.177932 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b0e5f59b-22d5-4bd8-bbc0-1020b3786bd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:19.184872 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0e5f59b-22d5-4bd8-bbc0-1020b3786bd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:19.185347 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0e5f59b-22d5-4bd8-bbc0-1020b3786bd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:19.185774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0e5f59b-22d5-4bd8-bbc0-1020b3786bd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:19.186480 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0e5f59b-22d5-4bd8-bbc0-1020b3786bd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:19.186944 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0e5f59b-22d5-4bd8-bbc0-1020b3786bd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:19.187348 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b0e5f59b-22d5-4bd8-bbc0-1020b3786bd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:19.295630 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b0e5f59b-22d5-4bd8-bbc0-1020b3786bd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:19.303295 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b0e5f59b-22d5-4bd8-bbc0-1020b3786bd3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.129826 Aug 04 23:48:19.303856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1232/2439] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:19 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:19.364734 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5a41015c-4d13-4d8e-bd26-ea22c6cb4d43 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:19.365347 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5a41015c-4d13-4d8e-bd26-ea22c6cb4d43 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:19.371853 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a41015c-4d13-4d8e-bd26-ea22c6cb4d43 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:19.372338 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a41015c-4d13-4d8e-bd26-ea22c6cb4d43 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:19.372772 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a41015c-4d13-4d8e-bd26-ea22c6cb4d43 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:19.373459 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a41015c-4d13-4d8e-bd26-ea22c6cb4d43 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:19.373911 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a41015c-4d13-4d8e-bd26-ea22c6cb4d43 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:19.374339 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a41015c-4d13-4d8e-bd26-ea22c6cb4d43 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:19.434885 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5a41015c-4d13-4d8e-bd26-ea22c6cb4d43 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:19.442691 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5a41015c-4d13-4d8e-bd26-ea22c6cb4d43 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.081813 Aug 04 23:48:19.443239 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1208/2440] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:19 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:20.324455 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-056c9243-38e4-415d-bba9-62c852119135 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:20.325087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-056c9243-38e4-415d-bba9-62c852119135 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:20.331436 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-056c9243-38e4-415d-bba9-62c852119135 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:20.331913 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-056c9243-38e4-415d-bba9-62c852119135 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:20.332344 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-056c9243-38e4-415d-bba9-62c852119135 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:20.333020 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-056c9243-38e4-415d-bba9-62c852119135 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:20.333467 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-056c9243-38e4-415d-bba9-62c852119135 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:20.333887 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-056c9243-38e4-415d-bba9-62c852119135 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:20.397127 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-056c9243-38e4-415d-bba9-62c852119135 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:20.405101 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-056c9243-38e4-415d-bba9-62c852119135 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084972 Aug 04 23:48:20.405649 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1233/2441] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:20 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:20.464329 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9c6d4377-ba59-4eb1-9aa6-8adfeebae87e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:20.464930 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9c6d4377-ba59-4eb1-9aa6-8adfeebae87e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:20.471334 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c6d4377-ba59-4eb1-9aa6-8adfeebae87e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:20.471810 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c6d4377-ba59-4eb1-9aa6-8adfeebae87e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:20.472231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c6d4377-ba59-4eb1-9aa6-8adfeebae87e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:20.472913 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c6d4377-ba59-4eb1-9aa6-8adfeebae87e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:20.473354 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c6d4377-ba59-4eb1-9aa6-8adfeebae87e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:20.473767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9c6d4377-ba59-4eb1-9aa6-8adfeebae87e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:20.588525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9c6d4377-ba59-4eb1-9aa6-8adfeebae87e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:20.596559 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9c6d4377-ba59-4eb1-9aa6-8adfeebae87e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.136260 Aug 04 23:48:20.597114 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1209/2442] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:20 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:21.426813 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-94eaa8b2-8d02-4d60-9518-b4ff2916aafe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:21.427413 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-94eaa8b2-8d02-4d60-9518-b4ff2916aafe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:21.434411 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94eaa8b2-8d02-4d60-9518-b4ff2916aafe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:21.434889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94eaa8b2-8d02-4d60-9518-b4ff2916aafe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:21.435325 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94eaa8b2-8d02-4d60-9518-b4ff2916aafe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:21.436003 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94eaa8b2-8d02-4d60-9518-b4ff2916aafe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:21.436445 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94eaa8b2-8d02-4d60-9518-b4ff2916aafe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:21.436858 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94eaa8b2-8d02-4d60-9518-b4ff2916aafe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:21.618924 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a8802b6b-0968-4811-8364-0257c87082b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:21.619608 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a8802b6b-0968-4811-8364-0257c87082b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:21.626321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8802b6b-0968-4811-8364-0257c87082b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:21.626833 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8802b6b-0968-4811-8364-0257c87082b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:21.627262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8802b6b-0968-4811-8364-0257c87082b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:21.627959 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8802b6b-0968-4811-8364-0257c87082b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:21.628431 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8802b6b-0968-4811-8364-0257c87082b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:21.628846 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a8802b6b-0968-4811-8364-0257c87082b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:21.729058 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-94eaa8b2-8d02-4d60-9518-b4ff2916aafe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:21.737060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-94eaa8b2-8d02-4d60-9518-b4ff2916aafe tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.314058 Aug 04 23:48:21.737488 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1234/2443] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:21 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:21.756542 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a8802b6b-0968-4811-8364-0257c87082b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:21.764846 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a8802b6b-0968-4811-8364-0257c87082b9 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.150519 Aug 04 23:48:21.765406 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1210/2444] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:21 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:22.760090 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4c36780a-1416-4606-9050-d9582123a3ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:22.760724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4c36780a-1416-4606-9050-d9582123a3ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:22.767172 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c36780a-1416-4606-9050-d9582123a3ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:22.767654 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c36780a-1416-4606-9050-d9582123a3ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:22.768097 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c36780a-1416-4606-9050-d9582123a3ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:22.768786 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c36780a-1416-4606-9050-d9582123a3ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:22.769241 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c36780a-1416-4606-9050-d9582123a3ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:22.769672 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c36780a-1416-4606-9050-d9582123a3ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:22.785022 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f92be2ce-89e1-4ec1-9105-6f6a6de2730e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:22.785654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f92be2ce-89e1-4ec1-9105-6f6a6de2730e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:22.792905 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f92be2ce-89e1-4ec1-9105-6f6a6de2730e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:22.793377 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f92be2ce-89e1-4ec1-9105-6f6a6de2730e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:22.793806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f92be2ce-89e1-4ec1-9105-6f6a6de2730e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:22.794514 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f92be2ce-89e1-4ec1-9105-6f6a6de2730e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:22.794958 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f92be2ce-89e1-4ec1-9105-6f6a6de2730e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:22.795637 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f92be2ce-89e1-4ec1-9105-6f6a6de2730e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:22.835262 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4c36780a-1416-4606-9050-d9582123a3ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:22.843540 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4c36780a-1416-4606-9050-d9582123a3ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087453 Aug 04 23:48:22.844123 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1235/2445] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:22 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:22.862180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f92be2ce-89e1-4ec1-9105-6f6a6de2730e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:22.870343 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f92be2ce-89e1-4ec1-9105-6f6a6de2730e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.089197 Aug 04 23:48:22.870942 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1211/2446] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:22 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:23.865479 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0f314c8a-2b8b-4f73-98e9-9536ad8b6601 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:23.866096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0f314c8a-2b8b-4f73-98e9-9536ad8b6601 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:23.872282 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f314c8a-2b8b-4f73-98e9-9536ad8b6601 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:23.872764 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f314c8a-2b8b-4f73-98e9-9536ad8b6601 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:23.873195 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f314c8a-2b8b-4f73-98e9-9536ad8b6601 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:23.873881 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f314c8a-2b8b-4f73-98e9-9536ad8b6601 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:23.874334 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f314c8a-2b8b-4f73-98e9-9536ad8b6601 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:23.874789 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0f314c8a-2b8b-4f73-98e9-9536ad8b6601 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:23.893275 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b1cbc502-65c8-444f-b0af-c37b89237a4c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:23.894016 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b1cbc502-65c8-444f-b0af-c37b89237a4c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:23.896358 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=54 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:48:23.902323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b1cbc502-65c8-444f-b0af-c37b89237a4c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:23.902838 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b1cbc502-65c8-444f-b0af-c37b89237a4c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:23.903277 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b1cbc502-65c8-444f-b0af-c37b89237a4c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:23.903985 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b1cbc502-65c8-444f-b0af-c37b89237a4c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:23.904437 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b1cbc502-65c8-444f-b0af-c37b89237a4c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:23.904864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b1cbc502-65c8-444f-b0af-c37b89237a4c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:23.908027 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:48:23.939248 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0f314c8a-2b8b-4f73-98e9-9536ad8b6601 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:23.948371 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0f314c8a-2b8b-4f73-98e9-9536ad8b6601 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086838 Aug 04 23:48:23.948947 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1236/2447] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:23 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:23.971001 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b1cbc502-65c8-444f-b0af-c37b89237a4c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:23.979562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b1cbc502-65c8-444f-b0af-c37b89237a4c tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.091866 Aug 04 23:48:23.980116 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1212/2448] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:23 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:24.968669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f92d231c-cc59-491b-adf8-2a37e9365c8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:24.969268 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f92d231c-cc59-491b-adf8-2a37e9365c8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:24.975707 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f92d231c-cc59-491b-adf8-2a37e9365c8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:24.976188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f92d231c-cc59-491b-adf8-2a37e9365c8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:24.977330 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f92d231c-cc59-491b-adf8-2a37e9365c8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:24.978017 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f92d231c-cc59-491b-adf8-2a37e9365c8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:24.978488 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f92d231c-cc59-491b-adf8-2a37e9365c8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:24.978910 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f92d231c-cc59-491b-adf8-2a37e9365c8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:25.000603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b361f68a-1fbf-4d7a-ba31-840f2397faea tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:25.001247 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b361f68a-1fbf-4d7a-ba31-840f2397faea tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:25.008231 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b361f68a-1fbf-4d7a-ba31-840f2397faea tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:25.008714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b361f68a-1fbf-4d7a-ba31-840f2397faea tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:25.009149 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b361f68a-1fbf-4d7a-ba31-840f2397faea tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:25.009846 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b361f68a-1fbf-4d7a-ba31-840f2397faea tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:25.010299 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b361f68a-1fbf-4d7a-ba31-840f2397faea tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:25.010747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b361f68a-1fbf-4d7a-ba31-840f2397faea tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:25.050418 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f92d231c-cc59-491b-adf8-2a37e9365c8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:25.059903 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f92d231c-cc59-491b-adf8-2a37e9365c8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.094965 Aug 04 23:48:25.060553 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1237/2449] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:24 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:25.079053 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b361f68a-1fbf-4d7a-ba31-840f2397faea tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:25.088223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b361f68a-1fbf-4d7a-ba31-840f2397faea tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.091380 Aug 04 23:48:25.088713 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1213/2450] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:24 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:26.079930 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2da9c02d-5d60-43af-88fe-3ac0396085c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:26.080473 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2da9c02d-5d60-43af-88fe-3ac0396085c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:26.082789 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=54 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:48:26.088375 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2da9c02d-5d60-43af-88fe-3ac0396085c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:26.088860 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2da9c02d-5d60-43af-88fe-3ac0396085c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:26.089295 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2da9c02d-5d60-43af-88fe-3ac0396085c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:26.089989 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2da9c02d-5d60-43af-88fe-3ac0396085c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:26.090465 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2da9c02d-5d60-43af-88fe-3ac0396085c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:26.090894 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2da9c02d-5d60-43af-88fe-3ac0396085c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:26.109774 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-eb34edb0-db91-4e24-8b9c-3f6c5b8c2b84 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:26.110422 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-eb34edb0-db91-4e24-8b9c-3f6c5b8c2b84 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:26.116808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eb34edb0-db91-4e24-8b9c-3f6c5b8c2b84 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:26.117381 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eb34edb0-db91-4e24-8b9c-3f6c5b8c2b84 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:26.118048 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eb34edb0-db91-4e24-8b9c-3f6c5b8c2b84 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:26.118791 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eb34edb0-db91-4e24-8b9c-3f6c5b8c2b84 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:26.119247 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eb34edb0-db91-4e24-8b9c-3f6c5b8c2b84 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:26.119672 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-eb34edb0-db91-4e24-8b9c-3f6c5b8c2b84 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:26.162435 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2da9c02d-5d60-43af-88fe-3ac0396085c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:26.171304 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2da9c02d-5d60-43af-88fe-3ac0396085c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.095018 Aug 04 23:48:26.171879 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1238/2451] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:26 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:26.190105 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-eb34edb0-db91-4e24-8b9c-3f6c5b8c2b84 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:26.199265 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-eb34edb0-db91-4e24-8b9c-3f6c5b8c2b84 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.093523 Aug 04 23:48:26.199917 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1214/2452] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:26 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:27.192336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2314f798-9591-49e3-8d4f-f5961f7298f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:27.192938 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2314f798-9591-49e3-8d4f-f5961f7298f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:27.200005 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2314f798-9591-49e3-8d4f-f5961f7298f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:27.200477 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2314f798-9591-49e3-8d4f-f5961f7298f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:27.200908 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2314f798-9591-49e3-8d4f-f5961f7298f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:27.201590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2314f798-9591-49e3-8d4f-f5961f7298f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:27.202033 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2314f798-9591-49e3-8d4f-f5961f7298f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:27.202546 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2314f798-9591-49e3-8d4f-f5961f7298f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:27.220789 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-562c4920-5fff-4a5c-a22b-7d85c5d8d992 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:27.221556 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-562c4920-5fff-4a5c-a22b-7d85c5d8d992 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:27.229106 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-562c4920-5fff-4a5c-a22b-7d85c5d8d992 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:27.229583 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-562c4920-5fff-4a5c-a22b-7d85c5d8d992 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:27.230014 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-562c4920-5fff-4a5c-a22b-7d85c5d8d992 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:27.230742 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-562c4920-5fff-4a5c-a22b-7d85c5d8d992 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:27.231229 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-562c4920-5fff-4a5c-a22b-7d85c5d8d992 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:27.231649 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-562c4920-5fff-4a5c-a22b-7d85c5d8d992 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:27.266180 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2314f798-9591-49e3-8d4f-f5961f7298f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:27.274643 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2314f798-9591-49e3-8d4f-f5961f7298f9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086015 Aug 04 23:48:27.275226 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1239/2453] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:27 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:27.295503 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-562c4920-5fff-4a5c-a22b-7d85c5d8d992 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:27.303790 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-562c4920-5fff-4a5c-a22b-7d85c5d8d992 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.086895 Aug 04 23:48:27.304348 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1215/2454] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:27 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:28.294800 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-03a88228-4082-4822-bc65-a8aed3224ae2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:28.295404 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-03a88228-4082-4822-bc65-a8aed3224ae2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:28.302002 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03a88228-4082-4822-bc65-a8aed3224ae2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:28.302516 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03a88228-4082-4822-bc65-a8aed3224ae2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:28.302948 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03a88228-4082-4822-bc65-a8aed3224ae2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:28.303658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03a88228-4082-4822-bc65-a8aed3224ae2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:28.304101 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03a88228-4082-4822-bc65-a8aed3224ae2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:28.304521 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03a88228-4082-4822-bc65-a8aed3224ae2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:28.325613 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-dd9a9c67-2010-43b6-ac1e-07aa9840154a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:28.326282 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-dd9a9c67-2010-43b6-ac1e-07aa9840154a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:28.332688 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd9a9c67-2010-43b6-ac1e-07aa9840154a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:28.333171 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd9a9c67-2010-43b6-ac1e-07aa9840154a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:28.333607 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd9a9c67-2010-43b6-ac1e-07aa9840154a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:28.334301 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd9a9c67-2010-43b6-ac1e-07aa9840154a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:28.334805 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd9a9c67-2010-43b6-ac1e-07aa9840154a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:28.335247 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-dd9a9c67-2010-43b6-ac1e-07aa9840154a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:28.373251 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-03a88228-4082-4822-bc65-a8aed3224ae2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:28.381678 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-03a88228-4082-4822-bc65-a8aed3224ae2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.090683 Aug 04 23:48:28.382431 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1240/2455] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:28 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:28.400619 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-dd9a9c67-2010-43b6-ac1e-07aa9840154a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:28.408504 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-dd9a9c67-2010-43b6-ac1e-07aa9840154a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.086800 Aug 04 23:48:28.409138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1216/2456] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:28 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:29.403697 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-55b5c6b1-2696-465b-9523-d5240f69c2ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:29.404268 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-55b5c6b1-2696-465b-9523-d5240f69c2ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:29.410730 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55b5c6b1-2696-465b-9523-d5240f69c2ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:29.411208 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55b5c6b1-2696-465b-9523-d5240f69c2ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:29.411642 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55b5c6b1-2696-465b-9523-d5240f69c2ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:29.412398 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55b5c6b1-2696-465b-9523-d5240f69c2ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:29.412784 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55b5c6b1-2696-465b-9523-d5240f69c2ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:29.413214 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-55b5c6b1-2696-465b-9523-d5240f69c2ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:29.429701 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a560b6aa-388f-4d5f-b5e7-846e3ec7a080 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:29.430315 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a560b6aa-388f-4d5f-b5e7-846e3ec7a080 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:29.436861 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a560b6aa-388f-4d5f-b5e7-846e3ec7a080 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:29.437338 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a560b6aa-388f-4d5f-b5e7-846e3ec7a080 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:29.437769 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a560b6aa-388f-4d5f-b5e7-846e3ec7a080 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:29.438501 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a560b6aa-388f-4d5f-b5e7-846e3ec7a080 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:29.438953 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a560b6aa-388f-4d5f-b5e7-846e3ec7a080 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:29.439391 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a560b6aa-388f-4d5f-b5e7-846e3ec7a080 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:29.475508 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-55b5c6b1-2696-465b-9523-d5240f69c2ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:29.483573 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-55b5c6b1-2696-465b-9523-d5240f69c2ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084492 Aug 04 23:48:29.484148 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1241/2457] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:29 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:29.504780 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a560b6aa-388f-4d5f-b5e7-846e3ec7a080 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:29.513420 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a560b6aa-388f-4d5f-b5e7-846e3ec7a080 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.088230 Aug 04 23:48:29.513978 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1217/2458] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:29 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:30.504669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-db4fbe03-4a05-4f7a-b258-520d90eb4465 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:30.505282 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-db4fbe03-4a05-4f7a-b258-520d90eb4465 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:30.512429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-db4fbe03-4a05-4f7a-b258-520d90eb4465 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:30.512920 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-db4fbe03-4a05-4f7a-b258-520d90eb4465 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:30.513413 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-db4fbe03-4a05-4f7a-b258-520d90eb4465 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:30.514128 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-db4fbe03-4a05-4f7a-b258-520d90eb4465 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:30.514613 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-db4fbe03-4a05-4f7a-b258-520d90eb4465 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:30.515030 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-db4fbe03-4a05-4f7a-b258-520d90eb4465 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:30.517703 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:48:30.535028 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8b1ef71b-1666-4177-ac62-27a65beb31ad tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:30.535727 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8b1ef71b-1666-4177-ac62-27a65beb31ad tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:30.542945 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8b1ef71b-1666-4177-ac62-27a65beb31ad tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:30.543432 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8b1ef71b-1666-4177-ac62-27a65beb31ad tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:30.543870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8b1ef71b-1666-4177-ac62-27a65beb31ad tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:30.544565 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8b1ef71b-1666-4177-ac62-27a65beb31ad tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:30.545018 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8b1ef71b-1666-4177-ac62-27a65beb31ad tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:30.545441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8b1ef71b-1666-4177-ac62-27a65beb31ad tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:30.583230 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-db4fbe03-4a05-4f7a-b258-520d90eb4465 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:30.591804 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-db4fbe03-4a05-4f7a-b258-520d90eb4465 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.090929 Aug 04 23:48:30.592385 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1242/2459] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:30 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:30.615704 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8b1ef71b-1666-4177-ac62-27a65beb31ad tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:30.624000 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8b1ef71b-1666-4177-ac62-27a65beb31ad tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.093314 Aug 04 23:48:30.624553 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1218/2460] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:30 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:31.613379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-910df80f-0dfa-4066-a568-a0e081d2de39 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:31.613994 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-910df80f-0dfa-4066-a568-a0e081d2de39 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:31.621276 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-910df80f-0dfa-4066-a568-a0e081d2de39 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:31.621752 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-910df80f-0dfa-4066-a568-a0e081d2de39 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:31.622192 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-910df80f-0dfa-4066-a568-a0e081d2de39 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:31.622906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-910df80f-0dfa-4066-a568-a0e081d2de39 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:31.623368 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-910df80f-0dfa-4066-a568-a0e081d2de39 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:31.623794 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-910df80f-0dfa-4066-a568-a0e081d2de39 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:31.644777 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-93e030e3-47a8-429c-9d41-7b2dc8eb1ea5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:31.645431 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-93e030e3-47a8-429c-9d41-7b2dc8eb1ea5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:31.652802 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-93e030e3-47a8-429c-9d41-7b2dc8eb1ea5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:31.653279 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-93e030e3-47a8-429c-9d41-7b2dc8eb1ea5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:31.653712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-93e030e3-47a8-429c-9d41-7b2dc8eb1ea5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:31.654460 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-93e030e3-47a8-429c-9d41-7b2dc8eb1ea5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:31.654913 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-93e030e3-47a8-429c-9d41-7b2dc8eb1ea5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:31.655330 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-93e030e3-47a8-429c-9d41-7b2dc8eb1ea5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:31.686265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-910df80f-0dfa-4066-a568-a0e081d2de39 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:31.693561 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-910df80f-0dfa-4066-a568-a0e081d2de39 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084039 Aug 04 23:48:31.694128 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1243/2461] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:31 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:31.718486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-93e030e3-47a8-429c-9d41-7b2dc8eb1ea5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:31.726302 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-93e030e3-47a8-429c-9d41-7b2dc8eb1ea5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.085355 Aug 04 23:48:31.726882 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1219/2462] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:31 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:32.714780 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d6f71057-a77b-4c59-9e57-feb24beaffa9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:32.715423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d6f71057-a77b-4c59-9e57-feb24beaffa9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:32.722083 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d6f71057-a77b-4c59-9e57-feb24beaffa9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:32.722599 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d6f71057-a77b-4c59-9e57-feb24beaffa9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:32.723035 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d6f71057-a77b-4c59-9e57-feb24beaffa9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:32.723724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d6f71057-a77b-4c59-9e57-feb24beaffa9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:32.724172 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d6f71057-a77b-4c59-9e57-feb24beaffa9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:32.724596 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d6f71057-a77b-4c59-9e57-feb24beaffa9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:32.748304 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-24a280f2-5be7-4503-bf9c-6dcd551adf41 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:32.748918 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-24a280f2-5be7-4503-bf9c-6dcd551adf41 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:32.755316 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24a280f2-5be7-4503-bf9c-6dcd551adf41 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:32.755795 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24a280f2-5be7-4503-bf9c-6dcd551adf41 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:32.756236 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24a280f2-5be7-4503-bf9c-6dcd551adf41 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:32.756931 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24a280f2-5be7-4503-bf9c-6dcd551adf41 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:32.757386 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24a280f2-5be7-4503-bf9c-6dcd551adf41 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:32.757810 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24a280f2-5be7-4503-bf9c-6dcd551adf41 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:32.787187 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d6f71057-a77b-4c59-9e57-feb24beaffa9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:32.795094 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d6f71057-a77b-4c59-9e57-feb24beaffa9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084100 Aug 04 23:48:32.795774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1244/2463] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:32 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:32.823214 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-24a280f2-5be7-4503-bf9c-6dcd551adf41 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:32.832383 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-24a280f2-5be7-4503-bf9c-6dcd551adf41 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.088585 Aug 04 23:48:32.832946 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1220/2464] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:32 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:33.816795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3b079225-804c-4727-9f4d-49270776f847 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:33.817408 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3b079225-804c-4727-9f4d-49270776f847 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:33.824510 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b079225-804c-4727-9f4d-49270776f847 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:33.825039 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b079225-804c-4727-9f4d-49270776f847 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:33.825478 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b079225-804c-4727-9f4d-49270776f847 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:33.826176 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b079225-804c-4727-9f4d-49270776f847 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:33.826658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b079225-804c-4727-9f4d-49270776f847 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:33.827084 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3b079225-804c-4727-9f4d-49270776f847 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:33.852970 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c06660bd-a355-44f6-999f-431e935df144 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:33.853598 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c06660bd-a355-44f6-999f-431e935df144 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:33.862373 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c06660bd-a355-44f6-999f-431e935df144 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:33.863218 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c06660bd-a355-44f6-999f-431e935df144 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:33.864005 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c06660bd-a355-44f6-999f-431e935df144 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:33.865175 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c06660bd-a355-44f6-999f-431e935df144 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:33.865985 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c06660bd-a355-44f6-999f-431e935df144 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:33.866746 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c06660bd-a355-44f6-999f-431e935df144 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:33.896940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3b079225-804c-4727-9f4d-49270776f847 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:33.905172 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3b079225-804c-4727-9f4d-49270776f847 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.092228 Aug 04 23:48:33.905743 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1245/2465] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:33 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:33.932904 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c06660bd-a355-44f6-999f-431e935df144 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:33.941181 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c06660bd-a355-44f6-999f-431e935df144 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.092006 Aug 04 23:48:33.941739 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1221/2466] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:33 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:34.926452 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2f8026d6-27be-4e98-aea3-4b2585f7e959 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:34.927085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2f8026d6-27be-4e98-aea3-4b2585f7e959 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:34.934213 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f8026d6-27be-4e98-aea3-4b2585f7e959 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:34.934741 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f8026d6-27be-4e98-aea3-4b2585f7e959 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:34.935173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f8026d6-27be-4e98-aea3-4b2585f7e959 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:34.935862 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f8026d6-27be-4e98-aea3-4b2585f7e959 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:34.936308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f8026d6-27be-4e98-aea3-4b2585f7e959 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:34.936728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f8026d6-27be-4e98-aea3-4b2585f7e959 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:34.962529 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c59c728d-235a-455d-b443-f4b2775c162f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:34.963119 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c59c728d-235a-455d-b443-f4b2775c162f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:34.970915 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c59c728d-235a-455d-b443-f4b2775c162f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:34.971398 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c59c728d-235a-455d-b443-f4b2775c162f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:34.971836 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c59c728d-235a-455d-b443-f4b2775c162f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:34.972539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c59c728d-235a-455d-b443-f4b2775c162f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:34.972993 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c59c728d-235a-455d-b443-f4b2775c162f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:34.973419 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c59c728d-235a-455d-b443-f4b2775c162f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:35.001769 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2f8026d6-27be-4e98-aea3-4b2585f7e959 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:35.009393 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2f8026d6-27be-4e98-aea3-4b2585f7e959 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087107 Aug 04 23:48:35.009974 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1246/2467] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:34 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:35.038304 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c59c728d-235a-455d-b443-f4b2775c162f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:35.047740 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c59c728d-235a-455d-b443-f4b2775c162f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.089123 Aug 04 23:48:35.048301 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1222/2468] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:34 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:36.030817 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c079edce-ade1-4ee8-b215-8ba297ea2ca7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:36.031411 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c079edce-ade1-4ee8-b215-8ba297ea2ca7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:36.037706 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c079edce-ade1-4ee8-b215-8ba297ea2ca7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:36.038177 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c079edce-ade1-4ee8-b215-8ba297ea2ca7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:36.038626 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c079edce-ade1-4ee8-b215-8ba297ea2ca7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:36.039305 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c079edce-ade1-4ee8-b215-8ba297ea2ca7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:36.039749 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c079edce-ade1-4ee8-b215-8ba297ea2ca7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:36.040162 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c079edce-ade1-4ee8-b215-8ba297ea2ca7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:36.068808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-641cd1c9-c54e-42dc-8811-0feb4516c03a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:36.069396 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-641cd1c9-c54e-42dc-8811-0feb4516c03a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:36.076288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-641cd1c9-c54e-42dc-8811-0feb4516c03a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:36.076764 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-641cd1c9-c54e-42dc-8811-0feb4516c03a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:36.077191 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-641cd1c9-c54e-42dc-8811-0feb4516c03a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:36.077876 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-641cd1c9-c54e-42dc-8811-0feb4516c03a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:36.078318 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-641cd1c9-c54e-42dc-8811-0feb4516c03a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:36.078762 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-641cd1c9-c54e-42dc-8811-0feb4516c03a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:36.105015 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c079edce-ade1-4ee8-b215-8ba297ea2ca7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:36.117805 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c079edce-ade1-4ee8-b215-8ba297ea2ca7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.091137 Aug 04 23:48:36.118591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1247/2469] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:36 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:36.145319 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-641cd1c9-c54e-42dc-8811-0feb4516c03a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:36.153278 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-641cd1c9-c54e-42dc-8811-0feb4516c03a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.088269 Aug 04 23:48:36.153831 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1223/2470] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:36 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:37.139379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0913d77e-85f9-4e3d-b38d-ce1a31c7cdd6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:37.139961 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0913d77e-85f9-4e3d-b38d-ce1a31c7cdd6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:37.146215 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0913d77e-85f9-4e3d-b38d-ce1a31c7cdd6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:37.146719 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0913d77e-85f9-4e3d-b38d-ce1a31c7cdd6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:37.147175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0913d77e-85f9-4e3d-b38d-ce1a31c7cdd6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:37.147850 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0913d77e-85f9-4e3d-b38d-ce1a31c7cdd6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:37.148292 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0913d77e-85f9-4e3d-b38d-ce1a31c7cdd6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:37.148710 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0913d77e-85f9-4e3d-b38d-ce1a31c7cdd6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:37.174472 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-804c9026-b15a-476f-a96a-eb2f5e63dea2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:37.175098 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-804c9026-b15a-476f-a96a-eb2f5e63dea2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:37.181431 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-804c9026-b15a-476f-a96a-eb2f5e63dea2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:37.181912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-804c9026-b15a-476f-a96a-eb2f5e63dea2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:37.182346 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-804c9026-b15a-476f-a96a-eb2f5e63dea2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:37.183142 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-804c9026-b15a-476f-a96a-eb2f5e63dea2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:37.183624 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-804c9026-b15a-476f-a96a-eb2f5e63dea2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:37.184087 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-804c9026-b15a-476f-a96a-eb2f5e63dea2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:37.211372 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0913d77e-85f9-4e3d-b38d-ce1a31c7cdd6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:37.220030 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0913d77e-85f9-4e3d-b38d-ce1a31c7cdd6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085054 Aug 04 23:48:37.220608 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1248/2471] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:37 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:37.248382 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-804c9026-b15a-476f-a96a-eb2f5e63dea2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:37.256268 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-804c9026-b15a-476f-a96a-eb2f5e63dea2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.086042 Aug 04 23:48:37.256820 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1224/2472] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:37 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:38.241024 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e86278a7-9641-42d0-b162-28015a27529d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:38.241666 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e86278a7-9641-42d0-b162-28015a27529d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:38.248870 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e86278a7-9641-42d0-b162-28015a27529d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:38.249350 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e86278a7-9641-42d0-b162-28015a27529d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:38.249786 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e86278a7-9641-42d0-b162-28015a27529d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:38.250509 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e86278a7-9641-42d0-b162-28015a27529d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:38.251007 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e86278a7-9641-42d0-b162-28015a27529d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:38.251416 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e86278a7-9641-42d0-b162-28015a27529d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:38.277027 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e6cd79f5-b522-4456-bd2b-22fdc2828b5f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:38.278180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e6cd79f5-b522-4456-bd2b-22fdc2828b5f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:38.284612 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6cd79f5-b522-4456-bd2b-22fdc2828b5f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:38.285084 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6cd79f5-b522-4456-bd2b-22fdc2828b5f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:38.285507 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6cd79f5-b522-4456-bd2b-22fdc2828b5f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:38.286184 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6cd79f5-b522-4456-bd2b-22fdc2828b5f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:38.286652 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6cd79f5-b522-4456-bd2b-22fdc2828b5f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:38.287068 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e6cd79f5-b522-4456-bd2b-22fdc2828b5f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:38.313763 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e86278a7-9641-42d0-b162-28015a27529d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:38.321327 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e86278a7-9641-42d0-b162-28015a27529d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084108 Aug 04 23:48:38.321891 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1249/2473] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:38 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:38.352494 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e6cd79f5-b522-4456-bd2b-22fdc2828b5f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:38.361598 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e6cd79f5-b522-4456-bd2b-22fdc2828b5f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.088344 Aug 04 23:48:38.362086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1225/2474] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:38 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:39.343209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-31f38bb1-6f4f-4b87-b21e-160bcc2a1ea5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:39.343816 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-31f38bb1-6f4f-4b87-b21e-160bcc2a1ea5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:39.350212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31f38bb1-6f4f-4b87-b21e-160bcc2a1ea5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:39.350733 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31f38bb1-6f4f-4b87-b21e-160bcc2a1ea5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:39.351165 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31f38bb1-6f4f-4b87-b21e-160bcc2a1ea5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:39.351851 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31f38bb1-6f4f-4b87-b21e-160bcc2a1ea5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:39.352301 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31f38bb1-6f4f-4b87-b21e-160bcc2a1ea5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:39.352729 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31f38bb1-6f4f-4b87-b21e-160bcc2a1ea5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:39.382990 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8d71f867-2220-4e44-ab47-5933777cced5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:39.383628 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8d71f867-2220-4e44-ab47-5933777cced5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:39.390973 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8d71f867-2220-4e44-ab47-5933777cced5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:39.391456 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8d71f867-2220-4e44-ab47-5933777cced5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:39.391891 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8d71f867-2220-4e44-ab47-5933777cced5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:39.392600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8d71f867-2220-4e44-ab47-5933777cced5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:39.393051 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8d71f867-2220-4e44-ab47-5933777cced5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:39.393473 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8d71f867-2220-4e44-ab47-5933777cced5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:39.415942 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-31f38bb1-6f4f-4b87-b21e-160bcc2a1ea5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:39.424386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-31f38bb1-6f4f-4b87-b21e-160bcc2a1ea5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085944 Aug 04 23:48:39.424884 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1250/2475] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:39 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:39.457913 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8d71f867-2220-4e44-ab47-5933777cced5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:39.466610 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8d71f867-2220-4e44-ab47-5933777cced5 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.086781 Aug 04 23:48:39.467297 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1226/2476] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:39 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:40.444728 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4b490f6a-fbf9-4590-92c4-706d1b43109b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:40.445340 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4b490f6a-fbf9-4590-92c4-706d1b43109b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:40.452122 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b490f6a-fbf9-4590-92c4-706d1b43109b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:40.452601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b490f6a-fbf9-4590-92c4-706d1b43109b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:40.453036 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b490f6a-fbf9-4590-92c4-706d1b43109b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:40.453718 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b490f6a-fbf9-4590-92c4-706d1b43109b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:40.454166 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b490f6a-fbf9-4590-92c4-706d1b43109b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:40.454620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4b490f6a-fbf9-4590-92c4-706d1b43109b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:40.488240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f4207a39-d09b-4128-a9b4-4c1dd22babdf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:40.488831 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f4207a39-d09b-4128-a9b4-4c1dd22babdf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:40.495045 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f4207a39-d09b-4128-a9b4-4c1dd22babdf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:40.495525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f4207a39-d09b-4128-a9b4-4c1dd22babdf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:40.498696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f4207a39-d09b-4128-a9b4-4c1dd22babdf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:40.498696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f4207a39-d09b-4128-a9b4-4c1dd22babdf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:40.498696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f4207a39-d09b-4128-a9b4-4c1dd22babdf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:40.498696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f4207a39-d09b-4128-a9b4-4c1dd22babdf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:40.517559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4b490f6a-fbf9-4590-92c4-706d1b43109b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:40.526848 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4b490f6a-fbf9-4590-92c4-706d1b43109b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085851 Aug 04 23:48:40.527426 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1251/2477] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:40 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:40.564667 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f4207a39-d09b-4128-a9b4-4c1dd22babdf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:40.573023 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f4207a39-d09b-4128-a9b4-4c1dd22babdf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.088516 Aug 04 23:48:40.573644 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1227/2478] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:40 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:41.549736 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0171e8e4-cd24-4572-8263-d01b6846132c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:41.550433 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0171e8e4-cd24-4572-8263-d01b6846132c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:41.557717 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0171e8e4-cd24-4572-8263-d01b6846132c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:41.558197 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0171e8e4-cd24-4572-8263-d01b6846132c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:41.558657 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0171e8e4-cd24-4572-8263-d01b6846132c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:41.559353 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0171e8e4-cd24-4572-8263-d01b6846132c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:41.559867 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0171e8e4-cd24-4572-8263-d01b6846132c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:41.560424 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0171e8e4-cd24-4572-8263-d01b6846132c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:41.594468 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7b77e258-3229-4a95-9678-bca2acde9a47 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:41.595090 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7b77e258-3229-4a95-9678-bca2acde9a47 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:41.601557 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7b77e258-3229-4a95-9678-bca2acde9a47 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:41.602058 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7b77e258-3229-4a95-9678-bca2acde9a47 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:41.602488 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7b77e258-3229-4a95-9678-bca2acde9a47 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:41.603428 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7b77e258-3229-4a95-9678-bca2acde9a47 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:41.603879 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7b77e258-3229-4a95-9678-bca2acde9a47 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:41.604303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7b77e258-3229-4a95-9678-bca2acde9a47 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:41.623882 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0171e8e4-cd24-4572-8263-d01b6846132c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:41.631424 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0171e8e4-cd24-4572-8263-d01b6846132c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085784 Aug 04 23:48:41.631991 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1252/2479] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:41 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:41.670212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7b77e258-3229-4a95-9678-bca2acde9a47 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:41.672755 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:48:41.680009 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7b77e258-3229-4a95-9678-bca2acde9a47 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.090184 Aug 04 23:48:41.680712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1228/2480] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:41 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:42.652799 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9cb3d5c3-50e8-4681-ac59-c4a694916d17 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:42.653428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9cb3d5c3-50e8-4681-ac59-c4a694916d17 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:42.660717 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cb3d5c3-50e8-4681-ac59-c4a694916d17 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:42.661201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cb3d5c3-50e8-4681-ac59-c4a694916d17 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:42.661638 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cb3d5c3-50e8-4681-ac59-c4a694916d17 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:42.662331 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cb3d5c3-50e8-4681-ac59-c4a694916d17 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:42.662808 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cb3d5c3-50e8-4681-ac59-c4a694916d17 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:42.663230 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9cb3d5c3-50e8-4681-ac59-c4a694916d17 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:42.701219 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-f87f4d5e-3d30-4317-bf2a-713974d3320f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:42.701905 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-f87f4d5e-3d30-4317-bf2a-713974d3320f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:42.708440 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f87f4d5e-3d30-4317-bf2a-713974d3320f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:42.708932 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f87f4d5e-3d30-4317-bf2a-713974d3320f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:42.709369 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f87f4d5e-3d30-4317-bf2a-713974d3320f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:42.710066 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f87f4d5e-3d30-4317-bf2a-713974d3320f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:42.710548 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f87f4d5e-3d30-4317-bf2a-713974d3320f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:42.710975 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-f87f4d5e-3d30-4317-bf2a-713974d3320f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:42.729780 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9cb3d5c3-50e8-4681-ac59-c4a694916d17 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:42.738187 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9cb3d5c3-50e8-4681-ac59-c4a694916d17 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.089150 Aug 04 23:48:42.738929 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1253/2481] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:42 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:42.775864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-f87f4d5e-3d30-4317-bf2a-713974d3320f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:42.784595 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-f87f4d5e-3d30-4317-bf2a-713974d3320f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.087718 Aug 04 23:48:42.785181 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1229/2482] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:42 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:43.760548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3ea2d7da-9858-4009-9cab-ca6103f51c21 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:43.761140 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3ea2d7da-9858-4009-9cab-ca6103f51c21 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:43.767609 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3ea2d7da-9858-4009-9cab-ca6103f51c21 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:43.768084 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3ea2d7da-9858-4009-9cab-ca6103f51c21 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:43.768519 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3ea2d7da-9858-4009-9cab-ca6103f51c21 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:43.769207 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3ea2d7da-9858-4009-9cab-ca6103f51c21 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:43.769658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3ea2d7da-9858-4009-9cab-ca6103f51c21 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:43.770076 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3ea2d7da-9858-4009-9cab-ca6103f51c21 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:43.806469 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-84a2d64c-5f6f-4e8c-8dcd-8fdd6208a351 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:43.807068 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-84a2d64c-5f6f-4e8c-8dcd-8fdd6208a351 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:43.814229 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-84a2d64c-5f6f-4e8c-8dcd-8fdd6208a351 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:43.814755 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-84a2d64c-5f6f-4e8c-8dcd-8fdd6208a351 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:43.815193 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-84a2d64c-5f6f-4e8c-8dcd-8fdd6208a351 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:43.816027 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-84a2d64c-5f6f-4e8c-8dcd-8fdd6208a351 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:43.816356 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-84a2d64c-5f6f-4e8c-8dcd-8fdd6208a351 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:43.816778 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-84a2d64c-5f6f-4e8c-8dcd-8fdd6208a351 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:43.836610 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3ea2d7da-9858-4009-9cab-ca6103f51c21 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:43.845257 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3ea2d7da-9858-4009-9cab-ca6103f51c21 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.088483 Aug 04 23:48:43.845928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1254/2483] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:43 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:43.883937 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-84a2d64c-5f6f-4e8c-8dcd-8fdd6208a351 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:43.892117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-84a2d64c-5f6f-4e8c-8dcd-8fdd6208a351 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.089516 Aug 04 23:48:43.892687 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1230/2484] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:43 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:44.866969 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-bb3731be-8db4-4840-840b-bb923780b432 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:44.867590 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-bb3731be-8db4-4840-840b-bb923780b432 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:44.875322 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb3731be-8db4-4840-840b-bb923780b432 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:44.875773 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb3731be-8db4-4840-840b-bb923780b432 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:44.876612 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb3731be-8db4-4840-840b-bb923780b432 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:44.876902 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb3731be-8db4-4840-840b-bb923780b432 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:44.877355 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb3731be-8db4-4840-840b-bb923780b432 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:44.877783 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bb3731be-8db4-4840-840b-bb923780b432 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:44.912822 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6466b2c1-603b-461d-9c46-0cbf77f17a1b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:44.913500 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6466b2c1-603b-461d-9c46-0cbf77f17a1b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:44.921028 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6466b2c1-603b-461d-9c46-0cbf77f17a1b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:44.921510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6466b2c1-603b-461d-9c46-0cbf77f17a1b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:44.921942 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6466b2c1-603b-461d-9c46-0cbf77f17a1b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:44.922958 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6466b2c1-603b-461d-9c46-0cbf77f17a1b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:44.923407 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6466b2c1-603b-461d-9c46-0cbf77f17a1b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:44.923828 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6466b2c1-603b-461d-9c46-0cbf77f17a1b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:44.942809 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-bb3731be-8db4-4840-840b-bb923780b432 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:44.950232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-bb3731be-8db4-4840-840b-bb923780b432 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087157 Aug 04 23:48:44.951427 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1255/2485] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:44 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:44.989244 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6466b2c1-603b-461d-9c46-0cbf77f17a1b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:44.997726 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6466b2c1-603b-461d-9c46-0cbf77f17a1b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.088878 Aug 04 23:48:44.998440 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1231/2486] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:44 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:45.971662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-03aa9303-5264-4728-903d-a2e4c5ae98f8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:45.972218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-03aa9303-5264-4728-903d-a2e4c5ae98f8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:45.978633 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03aa9303-5264-4728-903d-a2e4c5ae98f8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:45.979112 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03aa9303-5264-4728-903d-a2e4c5ae98f8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:45.979548 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03aa9303-5264-4728-903d-a2e4c5ae98f8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:45.980235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03aa9303-5264-4728-903d-a2e4c5ae98f8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:45.980690 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03aa9303-5264-4728-903d-a2e4c5ae98f8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:45.981114 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-03aa9303-5264-4728-903d-a2e4c5ae98f8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:46.018471 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5ad8c138-b497-40d8-8306-c41a636201a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:46.019077 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5ad8c138-b497-40d8-8306-c41a636201a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:46.025495 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ad8c138-b497-40d8-8306-c41a636201a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:46.025967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ad8c138-b497-40d8-8306-c41a636201a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:46.026410 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ad8c138-b497-40d8-8306-c41a636201a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:46.027097 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ad8c138-b497-40d8-8306-c41a636201a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:46.027542 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ad8c138-b497-40d8-8306-c41a636201a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:46.027953 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5ad8c138-b497-40d8-8306-c41a636201a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:46.043604 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-03aa9303-5264-4728-903d-a2e4c5ae98f8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:46.052201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-03aa9303-5264-4728-903d-a2e4c5ae98f8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084512 Aug 04 23:48:46.052765 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1256/2487] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:45 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:46.093409 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5ad8c138-b497-40d8-8306-c41a636201a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:46.101613 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5ad8c138-b497-40d8-8306-c41a636201a8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.086932 Aug 04 23:48:46.102429 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1232/2488] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:46 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:47.074429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3a1072aa-41ea-4841-96a1-c09b9cad4241 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:47.074996 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3a1072aa-41ea-4841-96a1-c09b9cad4241 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:47.082037 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a1072aa-41ea-4841-96a1-c09b9cad4241 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:47.082578 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a1072aa-41ea-4841-96a1-c09b9cad4241 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:47.083019 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a1072aa-41ea-4841-96a1-c09b9cad4241 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:47.083716 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a1072aa-41ea-4841-96a1-c09b9cad4241 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:47.084168 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a1072aa-41ea-4841-96a1-c09b9cad4241 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:47.084595 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3a1072aa-41ea-4841-96a1-c09b9cad4241 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:47.123539 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-01ab66be-d042-4284-a905-c47171975467 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:47.124233 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-01ab66be-d042-4284-a905-c47171975467 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:47.130640 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-01ab66be-d042-4284-a905-c47171975467 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:47.131122 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-01ab66be-d042-4284-a905-c47171975467 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:47.131562 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-01ab66be-d042-4284-a905-c47171975467 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:47.132256 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-01ab66be-d042-4284-a905-c47171975467 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:47.132702 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-01ab66be-d042-4284-a905-c47171975467 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:47.133117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-01ab66be-d042-4284-a905-c47171975467 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:47.147838 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3a1072aa-41ea-4841-96a1-c09b9cad4241 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:47.155379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3a1072aa-41ea-4841-96a1-c09b9cad4241 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084959 Aug 04 23:48:47.155911 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1257/2489] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:47 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:47.196507 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-01ab66be-d042-4284-a905-c47171975467 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:47.205898 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-01ab66be-d042-4284-a905-c47171975467 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.086686 Aug 04 23:48:47.206481 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1233/2490] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:47 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:48.176022 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-892621ac-5afe-4132-9d9a-affa6706a1f6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:48.176628 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-892621ac-5afe-4132-9d9a-affa6706a1f6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:48.183204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-892621ac-5afe-4132-9d9a-affa6706a1f6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:48.183686 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-892621ac-5afe-4132-9d9a-affa6706a1f6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:48.184113 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-892621ac-5afe-4132-9d9a-affa6706a1f6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:48.184799 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-892621ac-5afe-4132-9d9a-affa6706a1f6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:48.185250 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-892621ac-5afe-4132-9d9a-affa6706a1f6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:48.185677 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-892621ac-5afe-4132-9d9a-affa6706a1f6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:48.225620 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-abda619e-fa1a-4909-9a78-8adb719947f2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:48.226211 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-abda619e-fa1a-4909-9a78-8adb719947f2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:48.234099 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abda619e-fa1a-4909-9a78-8adb719947f2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:48.234617 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abda619e-fa1a-4909-9a78-8adb719947f2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:48.235045 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abda619e-fa1a-4909-9a78-8adb719947f2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:48.235734 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abda619e-fa1a-4909-9a78-8adb719947f2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:48.236176 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abda619e-fa1a-4909-9a78-8adb719947f2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:48.236590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abda619e-fa1a-4909-9a78-8adb719947f2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:48.249087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-892621ac-5afe-4132-9d9a-affa6706a1f6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:48.251318 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:48:48.259790 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-892621ac-5afe-4132-9d9a-affa6706a1f6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087541 Aug 04 23:48:48.260388 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1258/2491] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:48 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:48.304323 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-abda619e-fa1a-4909-9a78-8adb719947f2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:48.312618 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-abda619e-fa1a-4909-9a78-8adb719947f2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.090753 Aug 04 23:48:48.313180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1234/2492] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:48 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:49.282140 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5708ea82-1e28-437c-924b-d29c904be9d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:49.282820 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5708ea82-1e28-437c-924b-d29c904be9d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:49.289318 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5708ea82-1e28-437c-924b-d29c904be9d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:49.289788 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5708ea82-1e28-437c-924b-d29c904be9d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:49.290216 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5708ea82-1e28-437c-924b-d29c904be9d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:49.290925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5708ea82-1e28-437c-924b-d29c904be9d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:49.291372 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5708ea82-1e28-437c-924b-d29c904be9d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:49.291783 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5708ea82-1e28-437c-924b-d29c904be9d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:49.333032 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a5e7699d-0d1e-47c6-b2f1-cfba0e19ee5f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:49.333646 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a5e7699d-0d1e-47c6-b2f1-cfba0e19ee5f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:49.339961 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5e7699d-0d1e-47c6-b2f1-cfba0e19ee5f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:49.340472 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5e7699d-0d1e-47c6-b2f1-cfba0e19ee5f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:49.340908 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5e7699d-0d1e-47c6-b2f1-cfba0e19ee5f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:49.342214 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5e7699d-0d1e-47c6-b2f1-cfba0e19ee5f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:49.342706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5e7699d-0d1e-47c6-b2f1-cfba0e19ee5f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:49.343130 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a5e7699d-0d1e-47c6-b2f1-cfba0e19ee5f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:49.356627 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5708ea82-1e28-437c-924b-d29c904be9d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:49.364350 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5708ea82-1e28-437c-924b-d29c904be9d1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087040 Aug 04 23:48:49.364928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1259/2493] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:49 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:49.405053 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a5e7699d-0d1e-47c6-b2f1-cfba0e19ee5f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:49.413024 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a5e7699d-0d1e-47c6-b2f1-cfba0e19ee5f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.083868 Aug 04 23:48:49.413587 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1235/2494] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:49 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:50.386183 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-38b30c39-3a5d-4dcc-8686-77e3eadfb9d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:50.386843 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-38b30c39-3a5d-4dcc-8686-77e3eadfb9d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:50.393735 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-38b30c39-3a5d-4dcc-8686-77e3eadfb9d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:50.394216 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-38b30c39-3a5d-4dcc-8686-77e3eadfb9d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:50.394683 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-38b30c39-3a5d-4dcc-8686-77e3eadfb9d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:50.395371 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-38b30c39-3a5d-4dcc-8686-77e3eadfb9d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:50.395829 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-38b30c39-3a5d-4dcc-8686-77e3eadfb9d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:50.396251 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-38b30c39-3a5d-4dcc-8686-77e3eadfb9d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:50.433164 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-09a4a215-369d-418f-82cf-eec31da31954 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:50.433803 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-09a4a215-369d-418f-82cf-eec31da31954 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:50.441119 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-09a4a215-369d-418f-82cf-eec31da31954 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:50.441603 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-09a4a215-369d-418f-82cf-eec31da31954 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:50.442036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-09a4a215-369d-418f-82cf-eec31da31954 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:50.442749 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-09a4a215-369d-418f-82cf-eec31da31954 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:50.443199 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-09a4a215-369d-418f-82cf-eec31da31954 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:50.443618 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-09a4a215-369d-418f-82cf-eec31da31954 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:50.458354 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-38b30c39-3a5d-4dcc-8686-77e3eadfb9d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:50.466034 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-38b30c39-3a5d-4dcc-8686-77e3eadfb9d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083733 Aug 04 23:48:50.466669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1260/2495] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:50 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:50.512859 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-09a4a215-369d-418f-82cf-eec31da31954 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:50.521619 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-09a4a215-369d-418f-82cf-eec31da31954 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.092137 Aug 04 23:48:50.522471 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1236/2496] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:50 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:51.487622 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-10725d98-5d9f-412b-8741-c1c5a535e276 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:51.488227 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-10725d98-5d9f-412b-8741-c1c5a535e276 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:51.494666 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10725d98-5d9f-412b-8741-c1c5a535e276 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:51.495148 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10725d98-5d9f-412b-8741-c1c5a535e276 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:51.495584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10725d98-5d9f-412b-8741-c1c5a535e276 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:51.496271 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10725d98-5d9f-412b-8741-c1c5a535e276 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:51.496725 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10725d98-5d9f-412b-8741-c1c5a535e276 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:51.497151 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-10725d98-5d9f-412b-8741-c1c5a535e276 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:51.543608 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4111e60b-f7c5-4144-b722-71073cea9ecc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:51.544227 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4111e60b-f7c5-4144-b722-71073cea9ecc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:51.551972 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4111e60b-f7c5-4144-b722-71073cea9ecc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:51.552450 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4111e60b-f7c5-4144-b722-71073cea9ecc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:51.552878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4111e60b-f7c5-4144-b722-71073cea9ecc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:51.553559 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4111e60b-f7c5-4144-b722-71073cea9ecc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:51.554000 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4111e60b-f7c5-4144-b722-71073cea9ecc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:51.554457 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4111e60b-f7c5-4144-b722-71073cea9ecc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:51.560251 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-10725d98-5d9f-412b-8741-c1c5a535e276 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:51.568487 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-10725d98-5d9f-412b-8741-c1c5a535e276 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084754 Aug 04 23:48:51.569054 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1261/2497] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:51 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:51.617283 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4111e60b-f7c5-4144-b722-71073cea9ecc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:51.626146 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4111e60b-f7c5-4144-b722-71073cea9ecc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.086434 Aug 04 23:48:51.626738 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1237/2498] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:51 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:52.590403 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a1f98d44-6ae0-4186-b777-96fe170c59c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:52.591021 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a1f98d44-6ae0-4186-b777-96fe170c59c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:52.597445 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a1f98d44-6ae0-4186-b777-96fe170c59c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:52.597922 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a1f98d44-6ae0-4186-b777-96fe170c59c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:52.598350 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a1f98d44-6ae0-4186-b777-96fe170c59c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:52.599061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a1f98d44-6ae0-4186-b777-96fe170c59c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:52.599512 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a1f98d44-6ae0-4186-b777-96fe170c59c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:52.599948 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a1f98d44-6ae0-4186-b777-96fe170c59c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:52.647171 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-83226162-f5dc-4548-a650-b81a74c3c143 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:52.647865 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-83226162-f5dc-4548-a650-b81a74c3c143 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:52.653604 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-83226162-f5dc-4548-a650-b81a74c3c143 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:52.654085 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-83226162-f5dc-4548-a650-b81a74c3c143 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:52.654606 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-83226162-f5dc-4548-a650-b81a74c3c143 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:52.655597 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-83226162-f5dc-4548-a650-b81a74c3c143 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:52.656183 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-83226162-f5dc-4548-a650-b81a74c3c143 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:52.656468 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-83226162-f5dc-4548-a650-b81a74c3c143 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:52.662319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a1f98d44-6ae0-4186-b777-96fe170c59c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:52.669897 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a1f98d44-6ae0-4186-b777-96fe170c59c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083249 Aug 04 23:48:52.670632 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1262/2499] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:52 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:52.722646 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-83226162-f5dc-4548-a650-b81a74c3c143 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:52.730711 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-83226162-f5dc-4548-a650-b81a74c3c143 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.087686 Aug 04 23:48:52.731273 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1238/2500] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:52 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:53.691308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-8c15779d-52a4-430a-9de8-43bda0632c32 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:53.692016 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-8c15779d-52a4-430a-9de8-43bda0632c32 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:53.698289 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c15779d-52a4-430a-9de8-43bda0632c32 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:53.698802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c15779d-52a4-430a-9de8-43bda0632c32 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:53.699240 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c15779d-52a4-430a-9de8-43bda0632c32 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:53.699928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c15779d-52a4-430a-9de8-43bda0632c32 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:53.700380 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c15779d-52a4-430a-9de8-43bda0632c32 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:53.700802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-8c15779d-52a4-430a-9de8-43bda0632c32 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:53.752596 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-63272c8d-0ee2-47de-be1c-0ecc8514cfbc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:53.753196 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-63272c8d-0ee2-47de-be1c-0ecc8514cfbc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:53.759694 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-63272c8d-0ee2-47de-be1c-0ecc8514cfbc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:53.760495 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-63272c8d-0ee2-47de-be1c-0ecc8514cfbc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:53.760650 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-63272c8d-0ee2-47de-be1c-0ecc8514cfbc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:53.761346 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-63272c8d-0ee2-47de-be1c-0ecc8514cfbc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:53.761787 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-63272c8d-0ee2-47de-be1c-0ecc8514cfbc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:53.762203 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-63272c8d-0ee2-47de-be1c-0ecc8514cfbc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:53.762438 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-8c15779d-52a4-430a-9de8-43bda0632c32 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:53.771054 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-8c15779d-52a4-430a-9de8-43bda0632c32 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083488 Aug 04 23:48:53.771662 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1263/2501] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:53 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:53.829691 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-63272c8d-0ee2-47de-be1c-0ecc8514cfbc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:53.837522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-63272c8d-0ee2-47de-be1c-0ecc8514cfbc tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.089267 Aug 04 23:48:53.838082 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1239/2502] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:53 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:54.792202 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-060d2f3b-e5d9-402c-9dc6-ecb7930bcf74 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:54.792804 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-060d2f3b-e5d9-402c-9dc6-ecb7930bcf74 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:54.799867 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-060d2f3b-e5d9-402c-9dc6-ecb7930bcf74 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:54.800349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-060d2f3b-e5d9-402c-9dc6-ecb7930bcf74 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:54.800786 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-060d2f3b-e5d9-402c-9dc6-ecb7930bcf74 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:54.801474 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-060d2f3b-e5d9-402c-9dc6-ecb7930bcf74 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:54.801940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-060d2f3b-e5d9-402c-9dc6-ecb7930bcf74 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:54.802386 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-060d2f3b-e5d9-402c-9dc6-ecb7930bcf74 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:54.860204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ce79d16d-d112-4558-a3aa-83c3a8639050 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:54.860922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ce79d16d-d112-4558-a3aa-83c3a8639050 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:54.863134 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=56 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:48:54.863745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-060d2f3b-e5d9-402c-9dc6-ecb7930bcf74 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:54.868632 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce79d16d-d112-4558-a3aa-83c3a8639050 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:54.869116 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce79d16d-d112-4558-a3aa-83c3a8639050 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:54.869582 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce79d16d-d112-4558-a3aa-83c3a8639050 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:54.870256 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce79d16d-d112-4558-a3aa-83c3a8639050 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:54.870727 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce79d16d-d112-4558-a3aa-83c3a8639050 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:54.871139 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ce79d16d-d112-4558-a3aa-83c3a8639050 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:54.871418 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-060d2f3b-e5d9-402c-9dc6-ecb7930bcf74 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083194 Aug 04 23:48:54.871985 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1264/2503] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:54 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:54.936957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ce79d16d-d112-4558-a3aa-83c3a8639050 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:54.944922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ce79d16d-d112-4558-a3aa-83c3a8639050 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.089962 Aug 04 23:48:54.945475 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1240/2504] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:54 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:55.892926 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-070b60b6-1f6d-494d-a98b-45fb27c4206d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:55.893515 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-070b60b6-1f6d-494d-a98b-45fb27c4206d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:55.899892 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-070b60b6-1f6d-494d-a98b-45fb27c4206d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:55.900366 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-070b60b6-1f6d-494d-a98b-45fb27c4206d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:55.900792 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-070b60b6-1f6d-494d-a98b-45fb27c4206d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:55.901464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-070b60b6-1f6d-494d-a98b-45fb27c4206d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:55.901905 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-070b60b6-1f6d-494d-a98b-45fb27c4206d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:55.902320 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-070b60b6-1f6d-494d-a98b-45fb27c4206d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:55.964928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-070b60b6-1f6d-494d-a98b-45fb27c4206d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:55.965102 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-bd78b03b-9be9-40ce-99db-232f1ecb258e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:55.965643 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-bd78b03b-9be9-40ce-99db-232f1ecb258e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:55.972358 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd78b03b-9be9-40ce-99db-232f1ecb258e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:55.972797 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-070b60b6-1f6d-494d-a98b-45fb27c4206d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084223 Aug 04 23:48:55.972948 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd78b03b-9be9-40ce-99db-232f1ecb258e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:55.973239 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd78b03b-9be9-40ce-99db-232f1ecb258e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:55.975468 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1265/2505] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:55 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:55.975640 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd78b03b-9be9-40ce-99db-232f1ecb258e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:55.975640 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd78b03b-9be9-40ce-99db-232f1ecb258e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:55.975640 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd78b03b-9be9-40ce-99db-232f1ecb258e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:56.038441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-bd78b03b-9be9-40ce-99db-232f1ecb258e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:56.047330 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-bd78b03b-9be9-40ce-99db-232f1ecb258e tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.086150 Aug 04 23:48:56.048144 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1241/2506] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:55 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:56.993695 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e3593ffb-0e67-4ede-853e-2ac8381d0493 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:56.994281 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e3593ffb-0e67-4ede-853e-2ac8381d0493 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:56.996592 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=56 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:48:57.002023 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e3593ffb-0e67-4ede-853e-2ac8381d0493 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:57.002536 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e3593ffb-0e67-4ede-853e-2ac8381d0493 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:57.002975 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e3593ffb-0e67-4ede-853e-2ac8381d0493 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:57.003671 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e3593ffb-0e67-4ede-853e-2ac8381d0493 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:57.004121 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e3593ffb-0e67-4ede-853e-2ac8381d0493 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:57.004554 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e3593ffb-0e67-4ede-853e-2ac8381d0493 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:57.068836 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e3593ffb-0e67-4ede-853e-2ac8381d0493 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:57.070526 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-abfbaeec-7958-4b8b-a7fd-a4aaeb9b7f37 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:57.071214 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-abfbaeec-7958-4b8b-a7fd-a4aaeb9b7f37 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:57.076776 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e3593ffb-0e67-4ede-853e-2ac8381d0493 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086856 Aug 04 23:48:57.077366 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1266/2507] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:56 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:57.077597 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abfbaeec-7958-4b8b-a7fd-a4aaeb9b7f37 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:57.078030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abfbaeec-7958-4b8b-a7fd-a4aaeb9b7f37 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:57.078488 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abfbaeec-7958-4b8b-a7fd-a4aaeb9b7f37 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:57.079185 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abfbaeec-7958-4b8b-a7fd-a4aaeb9b7f37 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:57.079635 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abfbaeec-7958-4b8b-a7fd-a4aaeb9b7f37 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:57.080051 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-abfbaeec-7958-4b8b-a7fd-a4aaeb9b7f37 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:57.144816 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-abfbaeec-7958-4b8b-a7fd-a4aaeb9b7f37 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:57.152703 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-abfbaeec-7958-4b8b-a7fd-a4aaeb9b7f37 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.087265 Aug 04 23:48:57.153254 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1242/2508] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:57 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:58.097241 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-daede086-75dc-462a-8ba0-12514d84ac04 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:58.097800 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-daede086-75dc-462a-8ba0-12514d84ac04 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:58.104104 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-daede086-75dc-462a-8ba0-12514d84ac04 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:58.104584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-daede086-75dc-462a-8ba0-12514d84ac04 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:58.105069 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-daede086-75dc-462a-8ba0-12514d84ac04 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:58.105740 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-daede086-75dc-462a-8ba0-12514d84ac04 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:58.106195 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-daede086-75dc-462a-8ba0-12514d84ac04 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:58.106646 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-daede086-75dc-462a-8ba0-12514d84ac04 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:58.168681 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-daede086-75dc-462a-8ba0-12514d84ac04 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:58.174511 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-762201ac-c79c-44eb-96c2-1cd2a8f69ebd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:58.175136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-762201ac-c79c-44eb-96c2-1cd2a8f69ebd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:58.177330 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-daede086-75dc-462a-8ba0-12514d84ac04 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084044 Aug 04 23:48:58.177913 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1267/2509] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:58 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:58.181591 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-762201ac-c79c-44eb-96c2-1cd2a8f69ebd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:58.182071 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-762201ac-c79c-44eb-96c2-1cd2a8f69ebd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:58.182573 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-762201ac-c79c-44eb-96c2-1cd2a8f69ebd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:58.183252 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-762201ac-c79c-44eb-96c2-1cd2a8f69ebd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:58.183701 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-762201ac-c79c-44eb-96c2-1cd2a8f69ebd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:58.184122 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-762201ac-c79c-44eb-96c2-1cd2a8f69ebd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:58.248259 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-762201ac-c79c-44eb-96c2-1cd2a8f69ebd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:58.257113 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-762201ac-c79c-44eb-96c2-1cd2a8f69ebd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.087974 Aug 04 23:48:58.257699 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1243/2510] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:58 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:48:59.198474 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d3605cb2-fbfa-4b77-a98f-6083c53f98a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:59.199092 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d3605cb2-fbfa-4b77-a98f-6083c53f98a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:59.206503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3605cb2-fbfa-4b77-a98f-6083c53f98a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:59.206990 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3605cb2-fbfa-4b77-a98f-6083c53f98a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:59.207429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3605cb2-fbfa-4b77-a98f-6083c53f98a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:59.208134 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3605cb2-fbfa-4b77-a98f-6083c53f98a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:59.208589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3605cb2-fbfa-4b77-a98f-6083c53f98a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:59.209016 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d3605cb2-fbfa-4b77-a98f-6083c53f98a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:59.270833 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d3605cb2-fbfa-4b77-a98f-6083c53f98a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:59.276974 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fc7c00b9-eca3-421f-822c-821c53ee3928 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:48:59.277583 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-fc7c00b9-eca3-421f-822c-821c53ee3928 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:48:59.279289 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d3605cb2-fbfa-4b77-a98f-6083c53f98a4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084540 Aug 04 23:48:59.280700 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1268/2511] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:59 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:48:59.284688 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc7c00b9-eca3-421f-822c-821c53ee3928 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:59.285166 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc7c00b9-eca3-421f-822c-821c53ee3928 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:59.285594 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc7c00b9-eca3-421f-822c-821c53ee3928 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:59.286290 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc7c00b9-eca3-421f-822c-821c53ee3928 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:48:59.286763 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc7c00b9-eca3-421f-822c-821c53ee3928 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:48:59.287185 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc7c00b9-eca3-421f-822c-821c53ee3928 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:48:59.352995 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fc7c00b9-eca3-421f-822c-821c53ee3928 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:48:59.361951 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-fc7c00b9-eca3-421f-822c-821c53ee3928 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.088773 Aug 04 23:48:59.362550 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1244/2512] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:48:59 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:49:00.301922 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-32bfb907-e2b9-4c67-8e25-cda32d5493c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:00.302584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-32bfb907-e2b9-4c67-8e25-cda32d5493c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:00.308999 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32bfb907-e2b9-4c67-8e25-cda32d5493c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:00.309478 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32bfb907-e2b9-4c67-8e25-cda32d5493c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:00.309912 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32bfb907-e2b9-4c67-8e25-cda32d5493c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:00.310632 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32bfb907-e2b9-4c67-8e25-cda32d5493c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:00.311075 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32bfb907-e2b9-4c67-8e25-cda32d5493c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:00.312135 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-32bfb907-e2b9-4c67-8e25-cda32d5493c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:00.372839 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-32bfb907-e2b9-4c67-8e25-cda32d5493c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:00.381171 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-32bfb907-e2b9-4c67-8e25-cda32d5493c9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083332 Aug 04 23:49:00.381737 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1269/2513] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:00 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:00.382431 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-713473f8-59e5-4a5d-8777-5bce614df652 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:00.383049 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-713473f8-59e5-4a5d-8777-5bce614df652 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:00.389486 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-713473f8-59e5-4a5d-8777-5bce614df652 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:00.390612 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-713473f8-59e5-4a5d-8777-5bce614df652 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:00.391063 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-713473f8-59e5-4a5d-8777-5bce614df652 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:00.391740 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-713473f8-59e5-4a5d-8777-5bce614df652 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:00.392185 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-713473f8-59e5-4a5d-8777-5bce614df652 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:00.392604 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-713473f8-59e5-4a5d-8777-5bce614df652 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:00.407651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:49:00.455719 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-713473f8-59e5-4a5d-8777-5bce614df652 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:00.463685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-713473f8-59e5-4a5d-8777-5bce614df652 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.085126 Aug 04 23:49:00.464243 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1245/2514] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:00 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:49:01.401410 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d1eb61dc-738a-4414-bf1f-642884c11790 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:01.402009 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d1eb61dc-738a-4414-bf1f-642884c11790 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:01.409749 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1eb61dc-738a-4414-bf1f-642884c11790 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:01.410235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1eb61dc-738a-4414-bf1f-642884c11790 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:01.410710 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1eb61dc-738a-4414-bf1f-642884c11790 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:01.411410 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1eb61dc-738a-4414-bf1f-642884c11790 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:01.411865 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1eb61dc-738a-4414-bf1f-642884c11790 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:01.412291 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1eb61dc-738a-4414-bf1f-642884c11790 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:01.482131 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d1eb61dc-738a-4414-bf1f-642884c11790 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:01.486180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-807733d6-aa16-42b2-86b9-2a6e85445501 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:01.486959 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-807733d6-aa16-42b2-86b9-2a6e85445501 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:01.491377 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d1eb61dc-738a-4414-bf1f-642884c11790 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.093760 Aug 04 23:49:01.492063 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1270/2515] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:01 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:01.494906 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-807733d6-aa16-42b2-86b9-2a6e85445501 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:01.495382 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-807733d6-aa16-42b2-86b9-2a6e85445501 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:01.495841 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-807733d6-aa16-42b2-86b9-2a6e85445501 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:01.496812 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-807733d6-aa16-42b2-86b9-2a6e85445501 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:01.497268 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-807733d6-aa16-42b2-86b9-2a6e85445501 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:01.497690 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-807733d6-aa16-42b2-86b9-2a6e85445501 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:01.564460 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-807733d6-aa16-42b2-86b9-2a6e85445501 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:01.572593 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-807733d6-aa16-42b2-86b9-2a6e85445501 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.091912 Aug 04 23:49:01.573156 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1246/2516] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:01 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:49:02.511647 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-30aae962-472f-4403-a0de-e70a7698c0eb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:02.512255 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-30aae962-472f-4403-a0de-e70a7698c0eb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:02.519795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-30aae962-472f-4403-a0de-e70a7698c0eb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:02.520263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-30aae962-472f-4403-a0de-e70a7698c0eb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:02.520687 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-30aae962-472f-4403-a0de-e70a7698c0eb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:02.521365 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-30aae962-472f-4403-a0de-e70a7698c0eb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:02.521807 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-30aae962-472f-4403-a0de-e70a7698c0eb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:02.522219 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-30aae962-472f-4403-a0de-e70a7698c0eb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:02.588416 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-30aae962-472f-4403-a0de-e70a7698c0eb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:02.593697 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2a0db946-d665-4cce-aad3-07c49ba23e4a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:02.594944 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2a0db946-d665-4cce-aad3-07c49ba23e4a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:02.596450 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-30aae962-472f-4403-a0de-e70a7698c0eb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.088752 Aug 04 23:49:02.597025 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1271/2517] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:02 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:02.602262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a0db946-d665-4cce-aad3-07c49ba23e4a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:02.602794 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a0db946-d665-4cce-aad3-07c49ba23e4a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:02.603222 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a0db946-d665-4cce-aad3-07c49ba23e4a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:02.603929 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a0db946-d665-4cce-aad3-07c49ba23e4a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:02.604380 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a0db946-d665-4cce-aad3-07c49ba23e4a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:02.604796 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2a0db946-d665-4cce-aad3-07c49ba23e4a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:02.670264 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2a0db946-d665-4cce-aad3-07c49ba23e4a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:02.678779 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2a0db946-d665-4cce-aad3-07c49ba23e4a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.089411 Aug 04 23:49:02.679542 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1247/2518] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:02 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:49:03.619015 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-94e58e05-e5b3-4af8-ac00-de46aa33999a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:03.619619 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-94e58e05-e5b3-4af8-ac00-de46aa33999a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:03.626928 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94e58e05-e5b3-4af8-ac00-de46aa33999a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:03.627416 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94e58e05-e5b3-4af8-ac00-de46aa33999a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:03.627855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94e58e05-e5b3-4af8-ac00-de46aa33999a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:03.628551 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94e58e05-e5b3-4af8-ac00-de46aa33999a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:03.629003 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94e58e05-e5b3-4af8-ac00-de46aa33999a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:03.629428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-94e58e05-e5b3-4af8-ac00-de46aa33999a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:03.691349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-94e58e05-e5b3-4af8-ac00-de46aa33999a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:03.698984 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-94e58e05-e5b3-4af8-ac00-de46aa33999a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083820 Aug 04 23:49:03.699415 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-02ea3e36-3341-4f59-90fa-4602f1aa589b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:03.699859 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1272/2519] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:03 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:03.700085 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-02ea3e36-3341-4f59-90fa-4602f1aa589b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:03.706755 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02ea3e36-3341-4f59-90fa-4602f1aa589b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:03.707251 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02ea3e36-3341-4f59-90fa-4602f1aa589b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:03.707667 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02ea3e36-3341-4f59-90fa-4602f1aa589b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:03.708358 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02ea3e36-3341-4f59-90fa-4602f1aa589b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:03.708805 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02ea3e36-3341-4f59-90fa-4602f1aa589b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:03.709223 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-02ea3e36-3341-4f59-90fa-4602f1aa589b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:03.775379 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-02ea3e36-3341-4f59-90fa-4602f1aa589b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:03.784246 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-02ea3e36-3341-4f59-90fa-4602f1aa589b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.088355 Aug 04 23:49:03.784959 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1248/2520] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:03 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:49:04.720652 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4a3161b4-b77c-434e-a76b-031060ac7afb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:04.721265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4a3161b4-b77c-434e-a76b-031060ac7afb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:04.727857 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4a3161b4-b77c-434e-a76b-031060ac7afb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:04.728678 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4a3161b4-b77c-434e-a76b-031060ac7afb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:04.728846 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4a3161b4-b77c-434e-a76b-031060ac7afb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:04.729449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4a3161b4-b77c-434e-a76b-031060ac7afb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:04.729901 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4a3161b4-b77c-434e-a76b-031060ac7afb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:04.730327 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4a3161b4-b77c-434e-a76b-031060ac7afb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:04.795030 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4a3161b4-b77c-434e-a76b-031060ac7afb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:04.803483 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4a3161b4-b77c-434e-a76b-031060ac7afb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087338 Aug 04 23:49:04.804097 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1273/2521] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:04 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:04.807826 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2c3f557c-d990-4cba-b7ab-72cadf19cff2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:04.808440 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2c3f557c-d990-4cba-b7ab-72cadf19cff2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:04.816131 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c3f557c-d990-4cba-b7ab-72cadf19cff2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:04.816617 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c3f557c-d990-4cba-b7ab-72cadf19cff2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:04.817071 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c3f557c-d990-4cba-b7ab-72cadf19cff2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:04.817747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c3f557c-d990-4cba-b7ab-72cadf19cff2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:04.818194 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c3f557c-d990-4cba-b7ab-72cadf19cff2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:04.818652 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c3f557c-d990-4cba-b7ab-72cadf19cff2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:04.883819 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2c3f557c-d990-4cba-b7ab-72cadf19cff2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:04.892006 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2c3f557c-d990-4cba-b7ab-72cadf19cff2 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.088110 Aug 04 23:49:04.892565 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1249/2522] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:04 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:49:05.824529 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7ade0435-3d0e-4181-af12-4fce475808e1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:05.825262 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7ade0435-3d0e-4181-af12-4fce475808e1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:05.832672 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ade0435-3d0e-4181-af12-4fce475808e1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:05.833161 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ade0435-3d0e-4181-af12-4fce475808e1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:05.833601 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ade0435-3d0e-4181-af12-4fce475808e1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:05.834481 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ade0435-3d0e-4181-af12-4fce475808e1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:05.834986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ade0435-3d0e-4181-af12-4fce475808e1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:05.835322 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7ade0435-3d0e-4181-af12-4fce475808e1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:05.897743 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7ade0435-3d0e-4181-af12-4fce475808e1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:05.905266 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7ade0435-3d0e-4181-af12-4fce475808e1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084614 Aug 04 23:49:05.905948 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1274/2523] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:05 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:05.918902 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3642747a-b587-459c-a528-1585b53aa60f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:05.919564 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3642747a-b587-459c-a528-1585b53aa60f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:05.926534 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3642747a-b587-459c-a528-1585b53aa60f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:05.927019 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3642747a-b587-459c-a528-1585b53aa60f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:05.927454 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3642747a-b587-459c-a528-1585b53aa60f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:05.928147 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3642747a-b587-459c-a528-1585b53aa60f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:05.928621 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3642747a-b587-459c-a528-1585b53aa60f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:05.929105 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3642747a-b587-459c-a528-1585b53aa60f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:05.993903 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3642747a-b587-459c-a528-1585b53aa60f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:06.002543 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3642747a-b587-459c-a528-1585b53aa60f tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.087791 Aug 04 23:49:06.003112 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1250/2524] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:05 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:06.926985 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-775d6629-9525-4081-a724-79eb54fb0849 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:06.927597 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-775d6629-9525-4081-a724-79eb54fb0849 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:06.933993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-775d6629-9525-4081-a724-79eb54fb0849 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:06.934503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-775d6629-9525-4081-a724-79eb54fb0849 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:06.934939 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-775d6629-9525-4081-a724-79eb54fb0849 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:06.935619 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-775d6629-9525-4081-a724-79eb54fb0849 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:06.936066 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-775d6629-9525-4081-a724-79eb54fb0849 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:06.936483 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-775d6629-9525-4081-a724-79eb54fb0849 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:06.951088 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:49:06.999470 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-775d6629-9525-4081-a724-79eb54fb0849 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:07.007084 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-775d6629-9525-4081-a724-79eb54fb0849 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084283 Aug 04 23:49:07.007676 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1275/2525] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:06 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:07.023706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e3039974-051f-43d0-87f0-f0fd68d79ecd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:07.024436 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e3039974-051f-43d0-87f0-f0fd68d79ecd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:07.031706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e3039974-051f-43d0-87f0-f0fd68d79ecd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:07.032202 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e3039974-051f-43d0-87f0-f0fd68d79ecd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:07.032642 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e3039974-051f-43d0-87f0-f0fd68d79ecd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:07.033332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e3039974-051f-43d0-87f0-f0fd68d79ecd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:07.033785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e3039974-051f-43d0-87f0-f0fd68d79ecd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:07.034210 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e3039974-051f-43d0-87f0-f0fd68d79ecd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:07.098718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e3039974-051f-43d0-87f0-f0fd68d79ecd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:07.106627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e3039974-051f-43d0-87f0-f0fd68d79ecd tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.086768 Aug 04 23:49:07.107186 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1251/2526] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:07 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:08.028780 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1dde0edd-69bb-4417-a03b-9a3419d72060 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:08.029435 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1dde0edd-69bb-4417-a03b-9a3419d72060 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:08.036254 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1dde0edd-69bb-4417-a03b-9a3419d72060 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:08.036842 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1dde0edd-69bb-4417-a03b-9a3419d72060 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:08.037191 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1dde0edd-69bb-4417-a03b-9a3419d72060 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:08.038037 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1dde0edd-69bb-4417-a03b-9a3419d72060 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:08.038344 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1dde0edd-69bb-4417-a03b-9a3419d72060 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:08.038797 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1dde0edd-69bb-4417-a03b-9a3419d72060 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:08.103406 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1dde0edd-69bb-4417-a03b-9a3419d72060 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:08.111145 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1dde0edd-69bb-4417-a03b-9a3419d72060 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086258 Aug 04 23:49:08.111711 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1276/2527] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:08 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:08.128135 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9ca7f069-6563-4096-b86c-024368ffddbf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:08.128866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9ca7f069-6563-4096-b86c-024368ffddbf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:08.138330 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9ca7f069-6563-4096-b86c-024368ffddbf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:08.138852 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9ca7f069-6563-4096-b86c-024368ffddbf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:08.139687 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9ca7f069-6563-4096-b86c-024368ffddbf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:08.141240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9ca7f069-6563-4096-b86c-024368ffddbf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:08.142095 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9ca7f069-6563-4096-b86c-024368ffddbf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:08.142557 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9ca7f069-6563-4096-b86c-024368ffddbf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:08.213716 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9ca7f069-6563-4096-b86c-024368ffddbf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:08.223648 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9ca7f069-6563-4096-b86c-024368ffddbf tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.100116 Aug 04 23:49:08.224201 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1252/2528] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:08 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:49:09.131698 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3d6e036e-5c38-48ba-9ea4-1bf76861533b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:09.132255 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3d6e036e-5c38-48ba-9ea4-1bf76861533b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:09.138749 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d6e036e-5c38-48ba-9ea4-1bf76861533b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:09.139234 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d6e036e-5c38-48ba-9ea4-1bf76861533b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:09.139682 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d6e036e-5c38-48ba-9ea4-1bf76861533b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:09.141036 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d6e036e-5c38-48ba-9ea4-1bf76861533b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:09.141491 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d6e036e-5c38-48ba-9ea4-1bf76861533b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:09.141919 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3d6e036e-5c38-48ba-9ea4-1bf76861533b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:09.203640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3d6e036e-5c38-48ba-9ea4-1bf76861533b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:09.211309 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3d6e036e-5c38-48ba-9ea4-1bf76861533b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083506 Aug 04 23:49:09.211929 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1277/2529] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:09 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:09.244936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ebc20ce5-920a-4297-9510-b65bfe0a3b37 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:09.245629 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ebc20ce5-920a-4297-9510-b65bfe0a3b37 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:09.252695 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ebc20ce5-920a-4297-9510-b65bfe0a3b37 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:09.253175 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ebc20ce5-920a-4297-9510-b65bfe0a3b37 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:09.253616 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ebc20ce5-920a-4297-9510-b65bfe0a3b37 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:09.254303 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ebc20ce5-920a-4297-9510-b65bfe0a3b37 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:09.254780 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ebc20ce5-920a-4297-9510-b65bfe0a3b37 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:09.255202 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ebc20ce5-920a-4297-9510-b65bfe0a3b37 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:09.318233 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ebc20ce5-920a-4297-9510-b65bfe0a3b37 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:09.326464 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ebc20ce5-920a-4297-9510-b65bfe0a3b37 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.085342 Aug 04 23:49:09.327030 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1253/2530] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:09 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:10.231872 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2a78cd15-cb21-47e5-be18-a7f26248fa8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:10.232488 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2a78cd15-cb21-47e5-be18-a7f26248fa8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:10.239550 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2a78cd15-cb21-47e5-be18-a7f26248fa8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:10.240035 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2a78cd15-cb21-47e5-be18-a7f26248fa8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:10.240466 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2a78cd15-cb21-47e5-be18-a7f26248fa8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:10.241152 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2a78cd15-cb21-47e5-be18-a7f26248fa8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:10.241606 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2a78cd15-cb21-47e5-be18-a7f26248fa8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:10.242029 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2a78cd15-cb21-47e5-be18-a7f26248fa8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:10.304925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2a78cd15-cb21-47e5-be18-a7f26248fa8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:10.313811 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2a78cd15-cb21-47e5-be18-a7f26248fa8a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085779 Aug 04 23:49:10.314414 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1278/2531] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:10 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:10.347117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-78ede696-7544-4b5c-ad1c-e6769cf1fc81 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:10.347726 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-78ede696-7544-4b5c-ad1c-e6769cf1fc81 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:10.354461 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-78ede696-7544-4b5c-ad1c-e6769cf1fc81 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:10.354941 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-78ede696-7544-4b5c-ad1c-e6769cf1fc81 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:10.355376 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-78ede696-7544-4b5c-ad1c-e6769cf1fc81 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:10.356061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-78ede696-7544-4b5c-ad1c-e6769cf1fc81 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:10.356509 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-78ede696-7544-4b5c-ad1c-e6769cf1fc81 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:10.356927 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-78ede696-7544-4b5c-ad1c-e6769cf1fc81 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:10.423661 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-78ede696-7544-4b5c-ad1c-e6769cf1fc81 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:10.432060 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-78ede696-7544-4b5c-ad1c-e6769cf1fc81 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.088943 Aug 04 23:49:10.432619 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1254/2532] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:10 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:11.334326 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f4c6bfcf-196e-474e-ba74-145eef1bf117 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:11.335025 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f4c6bfcf-196e-474e-ba74-145eef1bf117 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:11.341443 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4c6bfcf-196e-474e-ba74-145eef1bf117 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:11.341932 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4c6bfcf-196e-474e-ba74-145eef1bf117 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:11.342390 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4c6bfcf-196e-474e-ba74-145eef1bf117 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:11.343087 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4c6bfcf-196e-474e-ba74-145eef1bf117 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:11.344057 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4c6bfcf-196e-474e-ba74-145eef1bf117 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:11.344483 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4c6bfcf-196e-474e-ba74-145eef1bf117 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:11.408898 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f4c6bfcf-196e-474e-ba74-145eef1bf117 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:11.416483 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f4c6bfcf-196e-474e-ba74-145eef1bf117 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086015 Aug 04 23:49:11.417040 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1279/2533] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:11 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:11.452752 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-afa05449-a2bc-4e48-b751-6b2010660602 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:11.453382 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-afa05449-a2bc-4e48-b751-6b2010660602 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:11.459940 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-afa05449-a2bc-4e48-b751-6b2010660602 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:11.460421 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-afa05449-a2bc-4e48-b751-6b2010660602 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:11.460854 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-afa05449-a2bc-4e48-b751-6b2010660602 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:11.461540 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-afa05449-a2bc-4e48-b751-6b2010660602 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:11.461991 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-afa05449-a2bc-4e48-b751-6b2010660602 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:11.462432 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-afa05449-a2bc-4e48-b751-6b2010660602 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:11.525809 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-afa05449-a2bc-4e48-b751-6b2010660602 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:11.534957 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-afa05449-a2bc-4e48-b751-6b2010660602 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.086043 Aug 04 23:49:11.535523 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1255/2534] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:11 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:12.437993 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b18deefd-1d69-49ac-a9e4-a5f7ea2402fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:12.438684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b18deefd-1d69-49ac-a9e4-a5f7ea2402fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:12.445089 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b18deefd-1d69-49ac-a9e4-a5f7ea2402fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:12.445569 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b18deefd-1d69-49ac-a9e4-a5f7ea2402fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:12.446041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b18deefd-1d69-49ac-a9e4-a5f7ea2402fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:12.446754 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b18deefd-1d69-49ac-a9e4-a5f7ea2402fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:12.447203 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b18deefd-1d69-49ac-a9e4-a5f7ea2402fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:12.447623 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b18deefd-1d69-49ac-a9e4-a5f7ea2402fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:12.510730 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b18deefd-1d69-49ac-a9e4-a5f7ea2402fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:12.518864 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b18deefd-1d69-49ac-a9e4-a5f7ea2402fc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084731 Aug 04 23:49:12.519418 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1280/2535] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:12 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:12.555576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c97e27bd-4813-4025-8516-ed376efd3418 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:12.556285 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c97e27bd-4813-4025-8516-ed376efd3418 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:12.562769 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c97e27bd-4813-4025-8516-ed376efd3418 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:12.563193 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c97e27bd-4813-4025-8516-ed376efd3418 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:12.563646 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c97e27bd-4813-4025-8516-ed376efd3418 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:12.564342 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c97e27bd-4813-4025-8516-ed376efd3418 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:12.564791 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c97e27bd-4813-4025-8516-ed376efd3418 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:12.565212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c97e27bd-4813-4025-8516-ed376efd3418 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:12.633044 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c97e27bd-4813-4025-8516-ed376efd3418 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:12.641829 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c97e27bd-4813-4025-8516-ed376efd3418 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.090079 Aug 04 23:49:12.642409 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1256/2536] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:12 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:13.541349 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-5886c139-31a4-475e-957e-5d5795686118 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:13.542142 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-5886c139-31a4-475e-957e-5d5795686118 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:13.550204 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5886c139-31a4-475e-957e-5d5795686118 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:13.550633 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5886c139-31a4-475e-957e-5d5795686118 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:13.551065 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5886c139-31a4-475e-957e-5d5795686118 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:13.551755 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5886c139-31a4-475e-957e-5d5795686118 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:13.552196 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5886c139-31a4-475e-957e-5d5795686118 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:13.552616 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-5886c139-31a4-475e-957e-5d5795686118 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:13.615845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-5886c139-31a4-475e-957e-5d5795686118 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:13.623436 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-5886c139-31a4-475e-957e-5d5795686118 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086998 Aug 04 23:49:13.623997 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1281/2537] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:13 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:13.663615 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c00fb44d-f9e3-485a-81f8-a0eb02e2352a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:13.664211 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c00fb44d-f9e3-485a-81f8-a0eb02e2352a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:13.671182 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c00fb44d-f9e3-485a-81f8-a0eb02e2352a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:13.672292 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c00fb44d-f9e3-485a-81f8-a0eb02e2352a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:13.672719 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c00fb44d-f9e3-485a-81f8-a0eb02e2352a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:13.673394 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c00fb44d-f9e3-485a-81f8-a0eb02e2352a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:13.673836 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c00fb44d-f9e3-485a-81f8-a0eb02e2352a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:13.674550 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c00fb44d-f9e3-485a-81f8-a0eb02e2352a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:13.739302 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c00fb44d-f9e3-485a-81f8-a0eb02e2352a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:13.747213 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c00fb44d-f9e3-485a-81f8-a0eb02e2352a tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.087964 Aug 04 23:49:13.747786 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1257/2538] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:13 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:14.645246 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-0cc74e9c-7044-427b-8ee0-22e5882dd29e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:14.645859 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-0cc74e9c-7044-427b-8ee0-22e5882dd29e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:14.652373 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0cc74e9c-7044-427b-8ee0-22e5882dd29e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:14.652844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0cc74e9c-7044-427b-8ee0-22e5882dd29e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:14.653268 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0cc74e9c-7044-427b-8ee0-22e5882dd29e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:14.653953 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0cc74e9c-7044-427b-8ee0-22e5882dd29e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:14.654429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0cc74e9c-7044-427b-8ee0-22e5882dd29e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:14.654845 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-0cc74e9c-7044-427b-8ee0-22e5882dd29e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:14.716439 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-0cc74e9c-7044-427b-8ee0-22e5882dd29e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:14.724583 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-0cc74e9c-7044-427b-8ee0-22e5882dd29e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083143 Aug 04 23:49:14.725144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1282/2539] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:14 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:14.768306 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fc47069b-44e1-4d2c-9ba0-e7980e2c2984 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:14.768959 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-fc47069b-44e1-4d2c-9ba0-e7980e2c2984 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:14.775367 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc47069b-44e1-4d2c-9ba0-e7980e2c2984 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:14.775872 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc47069b-44e1-4d2c-9ba0-e7980e2c2984 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:14.776301 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc47069b-44e1-4d2c-9ba0-e7980e2c2984 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:14.776987 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc47069b-44e1-4d2c-9ba0-e7980e2c2984 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:14.777435 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc47069b-44e1-4d2c-9ba0-e7980e2c2984 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:14.777860 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fc47069b-44e1-4d2c-9ba0-e7980e2c2984 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:14.843112 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fc47069b-44e1-4d2c-9ba0-e7980e2c2984 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:14.851971 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-fc47069b-44e1-4d2c-9ba0-e7980e2c2984 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.087564 Aug 04 23:49:14.852542 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1258/2540] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:14 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:15.745146 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-64b2d17d-4b39-4026-83a2-92793c4bf612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:15.745776 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-64b2d17d-4b39-4026-83a2-92793c4bf612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:15.753333 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64b2d17d-4b39-4026-83a2-92793c4bf612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:15.753810 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64b2d17d-4b39-4026-83a2-92793c4bf612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:15.754243 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64b2d17d-4b39-4026-83a2-92793c4bf612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:15.754986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64b2d17d-4b39-4026-83a2-92793c4bf612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:15.755437 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64b2d17d-4b39-4026-83a2-92793c4bf612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:15.755860 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-64b2d17d-4b39-4026-83a2-92793c4bf612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:15.818593 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-64b2d17d-4b39-4026-83a2-92793c4bf612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:15.826112 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-64b2d17d-4b39-4026-83a2-92793c4bf612 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084853 Aug 04 23:49:15.826701 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1283/2541] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:15 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:15.873318 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6f6c27f3-1b52-470c-8906-435a64a82956 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:15.873927 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6f6c27f3-1b52-470c-8906-435a64a82956 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:15.880525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f6c27f3-1b52-470c-8906-435a64a82956 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:15.881003 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f6c27f3-1b52-470c-8906-435a64a82956 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:15.881436 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f6c27f3-1b52-470c-8906-435a64a82956 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:15.882149 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f6c27f3-1b52-470c-8906-435a64a82956 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:15.882626 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f6c27f3-1b52-470c-8906-435a64a82956 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:15.883047 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6f6c27f3-1b52-470c-8906-435a64a82956 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:15.945198 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6f6c27f3-1b52-470c-8906-435a64a82956 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:15.953241 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6f6c27f3-1b52-470c-8906-435a64a82956 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.083793 Aug 04 23:49:15.953795 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1259/2542] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:15 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:16.846709 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a771456e-5aee-4c19-89f7-b431f69090d7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:16.847329 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a771456e-5aee-4c19-89f7-b431f69090d7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:16.853772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a771456e-5aee-4c19-89f7-b431f69090d7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:16.854256 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a771456e-5aee-4c19-89f7-b431f69090d7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:16.854724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a771456e-5aee-4c19-89f7-b431f69090d7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:16.855416 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a771456e-5aee-4c19-89f7-b431f69090d7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:16.855868 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a771456e-5aee-4c19-89f7-b431f69090d7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:16.856292 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a771456e-5aee-4c19-89f7-b431f69090d7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:16.917515 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a771456e-5aee-4c19-89f7-b431f69090d7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:16.926201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a771456e-5aee-4c19-89f7-b431f69090d7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084282 Aug 04 23:49:16.926803 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1284/2543] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:16 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:16.974210 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a0394ac9-2a2b-45cb-b6a4-4224eeed1c8b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:16.974871 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a0394ac9-2a2b-45cb-b6a4-4224eeed1c8b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:16.989540 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a0394ac9-2a2b-45cb-b6a4-4224eeed1c8b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:16.990151 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a0394ac9-2a2b-45cb-b6a4-4224eeed1c8b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:16.990624 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a0394ac9-2a2b-45cb-b6a4-4224eeed1c8b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:16.991352 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a0394ac9-2a2b-45cb-b6a4-4224eeed1c8b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:16.991816 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a0394ac9-2a2b-45cb-b6a4-4224eeed1c8b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:16.992241 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a0394ac9-2a2b-45cb-b6a4-4224eeed1c8b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:17.056543 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a0394ac9-2a2b-45cb-b6a4-4224eeed1c8b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:17.064901 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a0394ac9-2a2b-45cb-b6a4-4224eeed1c8b tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.094492 Aug 04 23:49:17.065468 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1260/2544] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:16 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:17.948175 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f0fd8a0c-b7ec-424e-ac56-ef61c9a47c0f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:17.948821 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f0fd8a0c-b7ec-424e-ac56-ef61c9a47c0f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:17.956028 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f0fd8a0c-b7ec-424e-ac56-ef61c9a47c0f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:17.956513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f0fd8a0c-b7ec-424e-ac56-ef61c9a47c0f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:17.956952 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f0fd8a0c-b7ec-424e-ac56-ef61c9a47c0f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:17.957652 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f0fd8a0c-b7ec-424e-ac56-ef61c9a47c0f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:17.958148 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f0fd8a0c-b7ec-424e-ac56-ef61c9a47c0f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:17.958571 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f0fd8a0c-b7ec-424e-ac56-ef61c9a47c0f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:18.021006 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f0fd8a0c-b7ec-424e-ac56-ef61c9a47c0f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:18.029005 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f0fd8a0c-b7ec-424e-ac56-ef61c9a47c0f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084695 Aug 04 23:49:18.029563 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1285/2545] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:17 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:18.136180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-be342113-d421-4f2e-bb63-a2474d98b6b8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:18.136787 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-be342113-d421-4f2e-bb63-a2474d98b6b8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:18.143407 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be342113-d421-4f2e-bb63-a2474d98b6b8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:18.143878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be342113-d421-4f2e-bb63-a2474d98b6b8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:18.144309 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be342113-d421-4f2e-bb63-a2474d98b6b8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:18.144977 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be342113-d421-4f2e-bb63-a2474d98b6b8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:18.145418 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be342113-d421-4f2e-bb63-a2474d98b6b8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:18.145861 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be342113-d421-4f2e-bb63-a2474d98b6b8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:18.207154 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-be342113-d421-4f2e-bb63-a2474d98b6b8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:18.215945 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-be342113-d421-4f2e-bb63-a2474d98b6b8 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.134195 Aug 04 23:49:18.216511 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1261/2546] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:18 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:19.050311 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-226d0562-941e-44ae-8629-59696da19acb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:19.050925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-226d0562-941e-44ae-8629-59696da19acb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:19.057325 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-226d0562-941e-44ae-8629-59696da19acb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:19.057837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-226d0562-941e-44ae-8629-59696da19acb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:19.058267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-226d0562-941e-44ae-8629-59696da19acb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:19.058975 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-226d0562-941e-44ae-8629-59696da19acb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:19.059417 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-226d0562-941e-44ae-8629-59696da19acb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:19.059834 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-226d0562-941e-44ae-8629-59696da19acb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:19.124775 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-226d0562-941e-44ae-8629-59696da19acb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:19.132818 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-226d0562-941e-44ae-8629-59696da19acb tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087264 Aug 04 23:49:19.133377 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1286/2547] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:19 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:19.236837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fbc862e7-3fce-457e-bae5-68a64b0fa4d3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:19.237437 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-fbc862e7-3fce-457e-bae5-68a64b0fa4d3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] [instance: c786164b-4aee-4a6a-9208-29f6ae31f247] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:19.243763 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fbc862e7-3fce-457e-bae5-68a64b0fa4d3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:19.244238 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fbc862e7-3fce-457e-bae5-68a64b0fa4d3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:19.244662 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fbc862e7-3fce-457e-bae5-68a64b0fa4d3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:19.245337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fbc862e7-3fce-457e-bae5-68a64b0fa4d3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:19.245785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fbc862e7-3fce-457e-bae5-68a64b0fa4d3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:19.246205 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fbc862e7-3fce-457e-bae5-68a64b0fa4d3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:19.248817 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=100 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:49:19.314233 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fbc862e7-3fce-457e-bae5-68a64b0fa4d3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '146d37206ef046fe98141e20a6835701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d297a325844e15bfc7ac1b305789a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:19.322292 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-fbc862e7-3fce-457e-bae5-68a64b0fa4d3 tempest-VolumesSnapshotTestJSON-1426913507 tempest-VolumesSnapshotTestJSON-1426913507-project] 10.222.0.33 "GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247" status: 200 len: 1349 microversion: 2.1 time: 0.089386 Aug 04 23:49:19.322870 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1262/2548] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:19 2022] GET /compute/v2.1/servers/c786164b-4aee-4a6a-9208-29f6ae31f247 => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:20.154425 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e2dea7af-b8ae-4fde-80e7-58e12caef92d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:20.155042 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e2dea7af-b8ae-4fde-80e7-58e12caef92d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:20.162570 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2dea7af-b8ae-4fde-80e7-58e12caef92d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:20.163089 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2dea7af-b8ae-4fde-80e7-58e12caef92d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:20.163610 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2dea7af-b8ae-4fde-80e7-58e12caef92d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:20.164354 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2dea7af-b8ae-4fde-80e7-58e12caef92d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:20.164890 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2dea7af-b8ae-4fde-80e7-58e12caef92d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:20.165329 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e2dea7af-b8ae-4fde-80e7-58e12caef92d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:20.232317 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e2dea7af-b8ae-4fde-80e7-58e12caef92d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:20.240077 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e2dea7af-b8ae-4fde-80e7-58e12caef92d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.089579 Aug 04 23:49:20.240639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1287/2549] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:20 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:21.261118 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-62748e85-80e2-4f6d-a13e-fcee069abb87 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:21.261727 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-62748e85-80e2-4f6d-a13e-fcee069abb87 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:21.268513 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62748e85-80e2-4f6d-a13e-fcee069abb87 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:21.268993 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62748e85-80e2-4f6d-a13e-fcee069abb87 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:21.269425 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62748e85-80e2-4f6d-a13e-fcee069abb87 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:21.270110 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62748e85-80e2-4f6d-a13e-fcee069abb87 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:21.270593 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62748e85-80e2-4f6d-a13e-fcee069abb87 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:21.271020 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-62748e85-80e2-4f6d-a13e-fcee069abb87 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:21.333157 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-62748e85-80e2-4f6d-a13e-fcee069abb87 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:21.340797 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-62748e85-80e2-4f6d-a13e-fcee069abb87 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083544 Aug 04 23:49:21.341281 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1263/2550] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:21 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:22.360991 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3f11bd3a-273e-4042-9a50-d370e020119d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:22.361588 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3f11bd3a-273e-4042-9a50-d370e020119d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:22.368008 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3f11bd3a-273e-4042-9a50-d370e020119d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:22.368485 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3f11bd3a-273e-4042-9a50-d370e020119d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:22.368919 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3f11bd3a-273e-4042-9a50-d370e020119d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:22.369727 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3f11bd3a-273e-4042-9a50-d370e020119d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:22.370082 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3f11bd3a-273e-4042-9a50-d370e020119d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:22.370531 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3f11bd3a-273e-4042-9a50-d370e020119d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:22.433051 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3f11bd3a-273e-4042-9a50-d370e020119d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:22.441100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3f11bd3a-273e-4042-9a50-d370e020119d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084013 Aug 04 23:49:22.441683 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1288/2551] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:22 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:49:23.461577 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5c889d18-3257-4d9f-ae8e-cefbb539ac76 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:23.462250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5c889d18-3257-4d9f-ae8e-cefbb539ac76 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:23.468394 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c889d18-3257-4d9f-ae8e-cefbb539ac76 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:23.468874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c889d18-3257-4d9f-ae8e-cefbb539ac76 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:23.469874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c889d18-3257-4d9f-ae8e-cefbb539ac76 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:23.470693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c889d18-3257-4d9f-ae8e-cefbb539ac76 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:23.471148 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c889d18-3257-4d9f-ae8e-cefbb539ac76 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:23.471577 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5c889d18-3257-4d9f-ae8e-cefbb539ac76 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:23.535881 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5c889d18-3257-4d9f-ae8e-cefbb539ac76 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:23.543424 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5c889d18-3257-4d9f-ae8e-cefbb539ac76 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085710 Aug 04 23:49:23.543983 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1264/2552] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:23 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:24.566050 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ed4a8068-d0ef-47a6-b6cf-cf6d1aa33c9c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:24.566701 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ed4a8068-d0ef-47a6-b6cf-cf6d1aa33c9c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:24.572930 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed4a8068-d0ef-47a6-b6cf-cf6d1aa33c9c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:24.573409 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed4a8068-d0ef-47a6-b6cf-cf6d1aa33c9c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:24.573843 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed4a8068-d0ef-47a6-b6cf-cf6d1aa33c9c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:24.574571 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed4a8068-d0ef-47a6-b6cf-cf6d1aa33c9c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:24.575023 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed4a8068-d0ef-47a6-b6cf-cf6d1aa33c9c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:24.575444 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ed4a8068-d0ef-47a6-b6cf-cf6d1aa33c9c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:24.636738 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ed4a8068-d0ef-47a6-b6cf-cf6d1aa33c9c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:24.644431 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ed4a8068-d0ef-47a6-b6cf-cf6d1aa33c9c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083012 Aug 04 23:49:24.644997 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1289/2553] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:24 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:25.666007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c2068a67-1808-48a8-b612-b57e4dc51a7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:25.666643 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c2068a67-1808-48a8-b612-b57e4dc51a7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:25.668988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=50 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:49:25.674749 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2068a67-1808-48a8-b612-b57e4dc51a7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:25.675498 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2068a67-1808-48a8-b612-b57e4dc51a7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:25.675931 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2068a67-1808-48a8-b612-b57e4dc51a7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:25.676621 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2068a67-1808-48a8-b612-b57e4dc51a7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:25.677080 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2068a67-1808-48a8-b612-b57e4dc51a7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:25.677503 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c2068a67-1808-48a8-b612-b57e4dc51a7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:25.750641 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c2068a67-1808-48a8-b612-b57e4dc51a7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:25.759179 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c2068a67-1808-48a8-b612-b57e4dc51a7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.097083 Aug 04 23:49:25.759746 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1265/2554] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:25 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:26.780276 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1876a19a-7fbb-4570-8a95-5fb096bc8572 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:26.780889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1876a19a-7fbb-4570-8a95-5fb096bc8572 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:26.788410 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1876a19a-7fbb-4570-8a95-5fb096bc8572 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:26.788896 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1876a19a-7fbb-4570-8a95-5fb096bc8572 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:26.789333 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1876a19a-7fbb-4570-8a95-5fb096bc8572 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:26.790027 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1876a19a-7fbb-4570-8a95-5fb096bc8572 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:26.790517 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1876a19a-7fbb-4570-8a95-5fb096bc8572 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:26.790943 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1876a19a-7fbb-4570-8a95-5fb096bc8572 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:26.854639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1876a19a-7fbb-4570-8a95-5fb096bc8572 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:26.862201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1876a19a-7fbb-4570-8a95-5fb096bc8572 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085962 Aug 04 23:49:26.862815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1290/2555] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:26 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:27.882909 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b541cce8-5109-428a-a6cb-e4b300a67a95 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:27.883511 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b541cce8-5109-428a-a6cb-e4b300a67a95 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:27.889915 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b541cce8-5109-428a-a6cb-e4b300a67a95 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:27.890421 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b541cce8-5109-428a-a6cb-e4b300a67a95 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:27.890851 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b541cce8-5109-428a-a6cb-e4b300a67a95 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:27.891553 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b541cce8-5109-428a-a6cb-e4b300a67a95 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:27.892049 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b541cce8-5109-428a-a6cb-e4b300a67a95 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:27.892522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b541cce8-5109-428a-a6cb-e4b300a67a95 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:27.956942 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b541cce8-5109-428a-a6cb-e4b300a67a95 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:27.964453 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b541cce8-5109-428a-a6cb-e4b300a67a95 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085399 Aug 04 23:49:27.964999 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1266/2556] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:27 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:28.987438 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6582eedb-79f9-411e-9c09-c6e0dff45703 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:28.988053 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-6582eedb-79f9-411e-9c09-c6e0dff45703 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:28.990336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=50 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:49:28.996076 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6582eedb-79f9-411e-9c09-c6e0dff45703 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:28.996553 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6582eedb-79f9-411e-9c09-c6e0dff45703 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:28.996986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6582eedb-79f9-411e-9c09-c6e0dff45703 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:28.997675 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6582eedb-79f9-411e-9c09-c6e0dff45703 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:28.998119 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6582eedb-79f9-411e-9c09-c6e0dff45703 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:28.998566 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-6582eedb-79f9-411e-9c09-c6e0dff45703 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:29.060870 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-6582eedb-79f9-411e-9c09-c6e0dff45703 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:29.070261 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6582eedb-79f9-411e-9c09-c6e0dff45703 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087841 Aug 04 23:49:29.070887 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1291/2557] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:28 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:30.091141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3e8a1459-c40f-4b27-aac2-f34b3c169cbc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:30.091695 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3e8a1459-c40f-4b27-aac2-f34b3c169cbc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:30.098789 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e8a1459-c40f-4b27-aac2-f34b3c169cbc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:30.099271 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e8a1459-c40f-4b27-aac2-f34b3c169cbc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:30.099701 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e8a1459-c40f-4b27-aac2-f34b3c169cbc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:30.100391 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e8a1459-c40f-4b27-aac2-f34b3c169cbc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:30.100843 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e8a1459-c40f-4b27-aac2-f34b3c169cbc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:30.101258 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3e8a1459-c40f-4b27-aac2-f34b3c169cbc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:30.163885 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3e8a1459-c40f-4b27-aac2-f34b3c169cbc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:30.173582 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3e8a1459-c40f-4b27-aac2-f34b3c169cbc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086321 Aug 04 23:49:30.175155 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1267/2558] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:30 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:31.194942 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2e74958b-222c-4ed7-9169-e3fa0b845d48 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:31.195549 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2e74958b-222c-4ed7-9169-e3fa0b845d48 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:31.202043 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e74958b-222c-4ed7-9169-e3fa0b845d48 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:31.202557 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e74958b-222c-4ed7-9169-e3fa0b845d48 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:31.202991 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e74958b-222c-4ed7-9169-e3fa0b845d48 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:31.203669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e74958b-222c-4ed7-9169-e3fa0b845d48 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:31.204115 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e74958b-222c-4ed7-9169-e3fa0b845d48 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:31.204530 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e74958b-222c-4ed7-9169-e3fa0b845d48 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:31.208664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=100 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:49:31.269580 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2e74958b-222c-4ed7-9169-e3fa0b845d48 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:31.277135 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2e74958b-222c-4ed7-9169-e3fa0b845d48 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085995 Aug 04 23:49:31.277700 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1292/2559] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:31 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:32.298099 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ee738551-e12a-4a75-8594-987902274296 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:32.298747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ee738551-e12a-4a75-8594-987902274296 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:32.306167 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ee738551-e12a-4a75-8594-987902274296 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:32.306708 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ee738551-e12a-4a75-8594-987902274296 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:32.307143 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ee738551-e12a-4a75-8594-987902274296 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:32.307833 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ee738551-e12a-4a75-8594-987902274296 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:32.308287 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ee738551-e12a-4a75-8594-987902274296 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:32.308712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ee738551-e12a-4a75-8594-987902274296 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:32.375133 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ee738551-e12a-4a75-8594-987902274296 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:32.382709 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ee738551-e12a-4a75-8594-987902274296 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.088415 Aug 04 23:49:32.383264 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1268/2560] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:32 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:33.403220 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-24f4664e-ecb5-437f-9ce5-0ee9843c224d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:33.403829 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-24f4664e-ecb5-437f-9ce5-0ee9843c224d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:33.410309 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24f4664e-ecb5-437f-9ce5-0ee9843c224d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:33.410816 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24f4664e-ecb5-437f-9ce5-0ee9843c224d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:33.411251 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24f4664e-ecb5-437f-9ce5-0ee9843c224d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:33.411936 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24f4664e-ecb5-437f-9ce5-0ee9843c224d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:33.412387 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24f4664e-ecb5-437f-9ce5-0ee9843c224d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:33.412806 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-24f4664e-ecb5-437f-9ce5-0ee9843c224d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:33.476487 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-24f4664e-ecb5-437f-9ce5-0ee9843c224d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:33.483975 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-24f4664e-ecb5-437f-9ce5-0ee9843c224d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084691 Aug 04 23:49:33.484538 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1293/2561] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:33 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:34.506088 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b590a645-84da-4f9f-bbcc-7b31c2b3bf02 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:34.506720 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b590a645-84da-4f9f-bbcc-7b31c2b3bf02 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:34.513342 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b590a645-84da-4f9f-bbcc-7b31c2b3bf02 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:34.513839 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b590a645-84da-4f9f-bbcc-7b31c2b3bf02 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:34.514294 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b590a645-84da-4f9f-bbcc-7b31c2b3bf02 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:34.515012 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b590a645-84da-4f9f-bbcc-7b31c2b3bf02 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:34.515457 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b590a645-84da-4f9f-bbcc-7b31c2b3bf02 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:34.515908 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b590a645-84da-4f9f-bbcc-7b31c2b3bf02 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:34.581478 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b590a645-84da-4f9f-bbcc-7b31c2b3bf02 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:34.589031 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b590a645-84da-4f9f-bbcc-7b31c2b3bf02 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086857 Aug 04 23:49:34.589584 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1269/2562] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:34 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:49:35.610201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-05987f4a-1f90-431d-afc5-9890fe5957f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:35.610829 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-05987f4a-1f90-431d-afc5-9890fe5957f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:35.617810 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-05987f4a-1f90-431d-afc5-9890fe5957f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:35.618314 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-05987f4a-1f90-431d-afc5-9890fe5957f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:35.618769 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-05987f4a-1f90-431d-afc5-9890fe5957f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:35.619462 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-05987f4a-1f90-431d-afc5-9890fe5957f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:35.619909 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-05987f4a-1f90-431d-afc5-9890fe5957f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:35.620814 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-05987f4a-1f90-431d-afc5-9890fe5957f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:35.683229 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-05987f4a-1f90-431d-afc5-9890fe5957f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:35.691368 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-05987f4a-1f90-431d-afc5-9890fe5957f4 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084966 Aug 04 23:49:35.691931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1294/2563] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:35 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:36.713244 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-8d35c198-ced1-4b2e-8c46-657028feca90 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:36.713868 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-8d35c198-ced1-4b2e-8c46-657028feca90 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:36.720242 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8d35c198-ced1-4b2e-8c46-657028feca90 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:36.720718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8d35c198-ced1-4b2e-8c46-657028feca90 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:36.721183 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8d35c198-ced1-4b2e-8c46-657028feca90 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:36.721872 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8d35c198-ced1-4b2e-8c46-657028feca90 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:36.722320 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8d35c198-ced1-4b2e-8c46-657028feca90 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:36.722766 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-8d35c198-ced1-4b2e-8c46-657028feca90 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:36.787822 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-8d35c198-ced1-4b2e-8c46-657028feca90 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:36.795415 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-8d35c198-ced1-4b2e-8c46-657028feca90 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086076 Aug 04 23:49:36.796040 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1270/2564] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:36 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:37.815673 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d290f609-caa4-4c4c-ad99-af853a875f28 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:37.816277 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d290f609-caa4-4c4c-ad99-af853a875f28 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:37.822922 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d290f609-caa4-4c4c-ad99-af853a875f28 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:37.823401 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d290f609-caa4-4c4c-ad99-af853a875f28 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:37.823838 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d290f609-caa4-4c4c-ad99-af853a875f28 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:37.824527 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d290f609-caa4-4c4c-ad99-af853a875f28 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:37.824974 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d290f609-caa4-4c4c-ad99-af853a875f28 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:37.825393 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d290f609-caa4-4c4c-ad99-af853a875f28 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:37.890927 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d290f609-caa4-4c4c-ad99-af853a875f28 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:37.899041 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d290f609-caa4-4c4c-ad99-af853a875f28 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087249 Aug 04 23:49:37.899603 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1295/2565] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:37 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:38.920380 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-67d14a23-62ab-44bd-9118-fc9d37b21841 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:38.920979 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-67d14a23-62ab-44bd-9118-fc9d37b21841 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:38.928989 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-67d14a23-62ab-44bd-9118-fc9d37b21841 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:38.929474 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-67d14a23-62ab-44bd-9118-fc9d37b21841 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:38.929906 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-67d14a23-62ab-44bd-9118-fc9d37b21841 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:38.930632 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-67d14a23-62ab-44bd-9118-fc9d37b21841 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:38.931083 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-67d14a23-62ab-44bd-9118-fc9d37b21841 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:38.931504 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-67d14a23-62ab-44bd-9118-fc9d37b21841 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:38.993475 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-67d14a23-62ab-44bd-9118-fc9d37b21841 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:39.001050 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-67d14a23-62ab-44bd-9118-fc9d37b21841 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084574 Aug 04 23:49:39.001596 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1271/2566] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:38 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:40.022555 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2e1930f8-24aa-4cce-8161-991ed061de3e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:40.023152 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2e1930f8-24aa-4cce-8161-991ed061de3e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:40.029962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e1930f8-24aa-4cce-8161-991ed061de3e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:40.030499 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e1930f8-24aa-4cce-8161-991ed061de3e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:40.030941 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e1930f8-24aa-4cce-8161-991ed061de3e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:40.031655 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e1930f8-24aa-4cce-8161-991ed061de3e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:40.032111 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e1930f8-24aa-4cce-8161-991ed061de3e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:40.032537 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2e1930f8-24aa-4cce-8161-991ed061de3e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:40.101821 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2e1930f8-24aa-4cce-8161-991ed061de3e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:40.109721 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2e1930f8-24aa-4cce-8161-991ed061de3e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.091362 Aug 04 23:49:40.110315 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1296/2567] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:40 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:41.131953 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fae9f795-67d2-4a35-8c05-37db9d89d642 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:41.132515 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-fae9f795-67d2-4a35-8c05-37db9d89d642 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:41.139018 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fae9f795-67d2-4a35-8c05-37db9d89d642 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:41.139504 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fae9f795-67d2-4a35-8c05-37db9d89d642 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:41.139934 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fae9f795-67d2-4a35-8c05-37db9d89d642 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:41.140636 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fae9f795-67d2-4a35-8c05-37db9d89d642 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:41.141180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fae9f795-67d2-4a35-8c05-37db9d89d642 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:41.141598 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fae9f795-67d2-4a35-8c05-37db9d89d642 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:41.205624 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fae9f795-67d2-4a35-8c05-37db9d89d642 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:41.214250 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-fae9f795-67d2-4a35-8c05-37db9d89d642 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086889 Aug 04 23:49:41.214833 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1272/2568] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:41 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:42.235339 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a0ba22cb-1ff0-49af-965c-5f94d90e9390 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:42.236412 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a0ba22cb-1ff0-49af-965c-5f94d90e9390 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:42.245171 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0ba22cb-1ff0-49af-965c-5f94d90e9390 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:42.245651 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0ba22cb-1ff0-49af-965c-5f94d90e9390 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:42.246083 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0ba22cb-1ff0-49af-965c-5f94d90e9390 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:42.246802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0ba22cb-1ff0-49af-965c-5f94d90e9390 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:42.247255 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0ba22cb-1ff0-49af-965c-5f94d90e9390 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:42.247677 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a0ba22cb-1ff0-49af-965c-5f94d90e9390 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:42.310940 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a0ba22cb-1ff0-49af-965c-5f94d90e9390 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:42.318721 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a0ba22cb-1ff0-49af-965c-5f94d90e9390 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087443 Aug 04 23:49:42.319298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1297/2569] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:42 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:43.340317 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-af38acc5-acc9-4d93-b581-860d99dab214 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:43.340934 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-af38acc5-acc9-4d93-b581-860d99dab214 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:43.348123 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af38acc5-acc9-4d93-b581-860d99dab214 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:43.348606 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af38acc5-acc9-4d93-b581-860d99dab214 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:43.349041 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af38acc5-acc9-4d93-b581-860d99dab214 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:43.349735 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af38acc5-acc9-4d93-b581-860d99dab214 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:43.350187 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af38acc5-acc9-4d93-b581-860d99dab214 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:43.350652 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-af38acc5-acc9-4d93-b581-860d99dab214 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:43.411745 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-af38acc5-acc9-4d93-b581-860d99dab214 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:43.419184 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-af38acc5-acc9-4d93-b581-860d99dab214 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.082829 Aug 04 23:49:43.419740 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1273/2570] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:43 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:43.643926 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:49:43.643926 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:49:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:49:44.441051 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ab714534-b717-4cf7-9998-3c6370a73063 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:44.441667 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ab714534-b717-4cf7-9998-3c6370a73063 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:44.448255 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab714534-b717-4cf7-9998-3c6370a73063 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:44.448734 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab714534-b717-4cf7-9998-3c6370a73063 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:44.449173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab714534-b717-4cf7-9998-3c6370a73063 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:44.449968 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab714534-b717-4cf7-9998-3c6370a73063 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:44.450308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab714534-b717-4cf7-9998-3c6370a73063 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:44.450756 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ab714534-b717-4cf7-9998-3c6370a73063 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:44.512847 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ab714534-b717-4cf7-9998-3c6370a73063 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:44.520990 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ab714534-b717-4cf7-9998-3c6370a73063 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084324 Aug 04 23:49:44.521562 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1298/2571] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:44 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:45.542244 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-4888ce1a-f7bf-49a0-abb2-83b7bd917715 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:45.542847 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-4888ce1a-f7bf-49a0-abb2-83b7bd917715 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:45.549371 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4888ce1a-f7bf-49a0-abb2-83b7bd917715 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:45.550352 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4888ce1a-f7bf-49a0-abb2-83b7bd917715 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:45.550810 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4888ce1a-f7bf-49a0-abb2-83b7bd917715 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:45.551874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4888ce1a-f7bf-49a0-abb2-83b7bd917715 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:45.552321 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4888ce1a-f7bf-49a0-abb2-83b7bd917715 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:45.552741 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-4888ce1a-f7bf-49a0-abb2-83b7bd917715 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:45.618991 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-4888ce1a-f7bf-49a0-abb2-83b7bd917715 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:45.626651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-4888ce1a-f7bf-49a0-abb2-83b7bd917715 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.088303 Aug 04 23:49:45.627214 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1274/2572] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:45 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:46.647810 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ae399ed5-dfa0-4100-bc76-06af6a6da36f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:46.648427 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ae399ed5-dfa0-4100-bc76-06af6a6da36f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:46.655022 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ae399ed5-dfa0-4100-bc76-06af6a6da36f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:46.655511 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ae399ed5-dfa0-4100-bc76-06af6a6da36f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:46.655950 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ae399ed5-dfa0-4100-bc76-06af6a6da36f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:46.656647 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ae399ed5-dfa0-4100-bc76-06af6a6da36f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:46.657101 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ae399ed5-dfa0-4100-bc76-06af6a6da36f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:46.657527 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ae399ed5-dfa0-4100-bc76-06af6a6da36f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:46.722068 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ae399ed5-dfa0-4100-bc76-06af6a6da36f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:46.730008 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ae399ed5-dfa0-4100-bc76-06af6a6da36f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086586 Aug 04 23:49:46.730602 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1299/2573] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:46 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:47.751888 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-744a114a-74d6-4993-bd08-59be0cd8e63a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:47.752494 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-744a114a-74d6-4993-bd08-59be0cd8e63a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:47.759517 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-744a114a-74d6-4993-bd08-59be0cd8e63a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:47.759987 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-744a114a-74d6-4993-bd08-59be0cd8e63a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:47.760410 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-744a114a-74d6-4993-bd08-59be0cd8e63a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:47.761085 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-744a114a-74d6-4993-bd08-59be0cd8e63a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:47.761530 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-744a114a-74d6-4993-bd08-59be0cd8e63a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:47.762016 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-744a114a-74d6-4993-bd08-59be0cd8e63a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:47.824054 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-744a114a-74d6-4993-bd08-59be0cd8e63a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:47.831589 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-744a114a-74d6-4993-bd08-59be0cd8e63a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083545 Aug 04 23:49:47.832143 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1275/2574] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:47 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:48.853686 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b400f2b8-c97b-42d3-8893-bcfe4b8f1d28 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:48.854296 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b400f2b8-c97b-42d3-8893-bcfe4b8f1d28 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:48.860828 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b400f2b8-c97b-42d3-8893-bcfe4b8f1d28 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:48.861298 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b400f2b8-c97b-42d3-8893-bcfe4b8f1d28 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:48.861724 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b400f2b8-c97b-42d3-8893-bcfe4b8f1d28 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:48.862429 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b400f2b8-c97b-42d3-8893-bcfe4b8f1d28 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:48.862875 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b400f2b8-c97b-42d3-8893-bcfe4b8f1d28 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:48.863290 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b400f2b8-c97b-42d3-8893-bcfe4b8f1d28 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:48.926421 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b400f2b8-c97b-42d3-8893-bcfe4b8f1d28 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:48.934589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b400f2b8-c97b-42d3-8893-bcfe4b8f1d28 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085382 Aug 04 23:49:48.935146 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1300/2575] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:48 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:49.955206 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7115764c-0371-46b3-a4e6-aef05d0f37ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:49.955837 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7115764c-0371-46b3-a4e6-aef05d0f37ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:49.962270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7115764c-0371-46b3-a4e6-aef05d0f37ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:49.962780 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7115764c-0371-46b3-a4e6-aef05d0f37ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:49.963217 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7115764c-0371-46b3-a4e6-aef05d0f37ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:49.963912 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7115764c-0371-46b3-a4e6-aef05d0f37ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:49.964368 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7115764c-0371-46b3-a4e6-aef05d0f37ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:49.964798 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7115764c-0371-46b3-a4e6-aef05d0f37ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:49.970922 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=84 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:49:50.044195 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7115764c-0371-46b3-a4e6-aef05d0f37ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:50.052061 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7115764c-0371-46b3-a4e6-aef05d0f37ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.100540 Aug 04 23:49:50.053568 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1276/2576] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:49 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:51.074559 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-47b35a04-d236-47cc-b48c-4ea5bb8fa4a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:51.075157 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-47b35a04-d236-47cc-b48c-4ea5bb8fa4a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:51.081517 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-47b35a04-d236-47cc-b48c-4ea5bb8fa4a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:51.081990 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-47b35a04-d236-47cc-b48c-4ea5bb8fa4a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:51.082470 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-47b35a04-d236-47cc-b48c-4ea5bb8fa4a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:51.083149 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-47b35a04-d236-47cc-b48c-4ea5bb8fa4a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:51.083591 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-47b35a04-d236-47cc-b48c-4ea5bb8fa4a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:51.084863 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-47b35a04-d236-47cc-b48c-4ea5bb8fa4a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:51.146118 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-47b35a04-d236-47cc-b48c-4ea5bb8fa4a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:51.154464 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-47b35a04-d236-47cc-b48c-4ea5bb8fa4a6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084169 Aug 04 23:49:51.155018 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1301/2577] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:51 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:52.175147 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-de2e55ed-d40c-4a24-a462-5e3f5b6f8265 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:52.175766 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-de2e55ed-d40c-4a24-a462-5e3f5b6f8265 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:52.183123 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de2e55ed-d40c-4a24-a462-5e3f5b6f8265 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:52.183599 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de2e55ed-d40c-4a24-a462-5e3f5b6f8265 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:52.184032 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de2e55ed-d40c-4a24-a462-5e3f5b6f8265 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:52.184710 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de2e55ed-d40c-4a24-a462-5e3f5b6f8265 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:52.185157 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de2e55ed-d40c-4a24-a462-5e3f5b6f8265 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:52.185577 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-de2e55ed-d40c-4a24-a462-5e3f5b6f8265 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:52.246973 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-de2e55ed-d40c-4a24-a462-5e3f5b6f8265 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:52.254500 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-de2e55ed-d40c-4a24-a462-5e3f5b6f8265 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083234 Aug 04 23:49:52.255053 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1277/2578] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:52 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:53.275270 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d40cbcee-5374-4e8e-b984-fb21bda4296d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:53.275883 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d40cbcee-5374-4e8e-b984-fb21bda4296d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:53.282720 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d40cbcee-5374-4e8e-b984-fb21bda4296d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:53.283207 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d40cbcee-5374-4e8e-b984-fb21bda4296d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:53.283642 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d40cbcee-5374-4e8e-b984-fb21bda4296d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:53.284324 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d40cbcee-5374-4e8e-b984-fb21bda4296d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:53.284772 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d40cbcee-5374-4e8e-b984-fb21bda4296d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:53.285191 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d40cbcee-5374-4e8e-b984-fb21bda4296d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:53.347225 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d40cbcee-5374-4e8e-b984-fb21bda4296d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:53.355541 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d40cbcee-5374-4e8e-b984-fb21bda4296d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084200 Aug 04 23:49:53.356090 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1302/2579] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:53 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:54.376141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d927062d-ca4f-472c-bf27-3c3da53c46b7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:54.376753 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d927062d-ca4f-472c-bf27-3c3da53c46b7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:54.382813 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d927062d-ca4f-472c-bf27-3c3da53c46b7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:54.383296 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d927062d-ca4f-472c-bf27-3c3da53c46b7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:54.383730 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d927062d-ca4f-472c-bf27-3c3da53c46b7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:54.384423 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d927062d-ca4f-472c-bf27-3c3da53c46b7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:54.384874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d927062d-ca4f-472c-bf27-3c3da53c46b7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:54.385299 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d927062d-ca4f-472c-bf27-3c3da53c46b7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:54.451298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d927062d-ca4f-472c-bf27-3c3da53c46b7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:54.458779 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d927062d-ca4f-472c-bf27-3c3da53c46b7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086628 Aug 04 23:49:54.459859 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1278/2580] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:54 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:55.480240 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a5d913d0-e9c2-4c26-bb92-c70e314e8427 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:55.480862 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a5d913d0-e9c2-4c26-bb92-c70e314e8427 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:55.486999 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5d913d0-e9c2-4c26-bb92-c70e314e8427 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:55.487481 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5d913d0-e9c2-4c26-bb92-c70e314e8427 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:55.487919 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5d913d0-e9c2-4c26-bb92-c70e314e8427 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:55.488603 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5d913d0-e9c2-4c26-bb92-c70e314e8427 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:55.489057 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5d913d0-e9c2-4c26-bb92-c70e314e8427 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:55.489478 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a5d913d0-e9c2-4c26-bb92-c70e314e8427 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:55.551184 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a5d913d0-e9c2-4c26-bb92-c70e314e8427 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:55.559661 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a5d913d0-e9c2-4c26-bb92-c70e314e8427 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083304 Aug 04 23:49:55.560224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1303/2581] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:55 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:56.580275 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-423c2807-af1d-4fd4-83f4-d52c9e70165e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:56.580884 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-423c2807-af1d-4fd4-83f4-d52c9e70165e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:56.583263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=28 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:49:56.589214 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-423c2807-af1d-4fd4-83f4-d52c9e70165e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:56.589696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-423c2807-af1d-4fd4-83f4-d52c9e70165e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:56.590128 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-423c2807-af1d-4fd4-83f4-d52c9e70165e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:56.590844 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-423c2807-af1d-4fd4-83f4-d52c9e70165e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:56.591296 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-423c2807-af1d-4fd4-83f4-d52c9e70165e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:56.591720 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-423c2807-af1d-4fd4-83f4-d52c9e70165e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:56.654225 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-423c2807-af1d-4fd4-83f4-d52c9e70165e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:56.661828 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-423c2807-af1d-4fd4-83f4-d52c9e70165e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085334 Aug 04 23:49:56.662339 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1279/2582] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:56 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:57.684537 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-1aa3683a-f280-488e-bad2-460e674d7bd9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:57.685161 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-1aa3683a-f280-488e-bad2-460e674d7bd9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:57.691659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1aa3683a-f280-488e-bad2-460e674d7bd9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:57.692150 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1aa3683a-f280-488e-bad2-460e674d7bd9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:57.692618 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1aa3683a-f280-488e-bad2-460e674d7bd9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:57.693330 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1aa3683a-f280-488e-bad2-460e674d7bd9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:57.693784 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1aa3683a-f280-488e-bad2-460e674d7bd9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:57.694213 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-1aa3683a-f280-488e-bad2-460e674d7bd9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:57.757972 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-1aa3683a-f280-488e-bad2-460e674d7bd9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:57.765854 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-1aa3683a-f280-488e-bad2-460e674d7bd9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085166 Aug 04 23:49:57.766423 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1304/2583] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:57 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:58.787542 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-652ee2de-2af5-4645-a5a7-b66ce9021d44 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:58.788235 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-652ee2de-2af5-4645-a5a7-b66ce9021d44 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:58.794731 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-652ee2de-2af5-4645-a5a7-b66ce9021d44 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:58.795210 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-652ee2de-2af5-4645-a5a7-b66ce9021d44 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:58.795643 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-652ee2de-2af5-4645-a5a7-b66ce9021d44 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:58.796326 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-652ee2de-2af5-4645-a5a7-b66ce9021d44 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:58.796778 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-652ee2de-2af5-4645-a5a7-b66ce9021d44 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:58.797201 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-652ee2de-2af5-4645-a5a7-b66ce9021d44 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:58.861945 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-652ee2de-2af5-4645-a5a7-b66ce9021d44 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:58.870415 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-652ee2de-2af5-4645-a5a7-b66ce9021d44 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086822 Aug 04 23:49:58.870995 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1280/2584] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:58 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:49:59.893115 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b370b363-9334-4b78-975e-510db6bfb048 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:49:59.893726 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b370b363-9334-4b78-975e-510db6bfb048 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:49:59.896089 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=28 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:49:59.901493 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b370b363-9334-4b78-975e-510db6bfb048 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:59.901973 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b370b363-9334-4b78-975e-510db6bfb048 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:59.902431 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b370b363-9334-4b78-975e-510db6bfb048 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:59.903118 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b370b363-9334-4b78-975e-510db6bfb048 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:49:59.903567 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b370b363-9334-4b78-975e-510db6bfb048 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:49:59.903988 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b370b363-9334-4b78-975e-510db6bfb048 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:49:59.968227 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b370b363-9334-4b78-975e-510db6bfb048 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:49:59.975766 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b370b363-9334-4b78-975e-510db6bfb048 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086557 Aug 04 23:49:59.976326 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1305/2585] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:49:59 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:00.998310 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-faa159ec-f89a-456f-ab0e-a53e7b0fe4a3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:00.998944 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-faa159ec-f89a-456f-ab0e-a53e7b0fe4a3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:01.005405 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-faa159ec-f89a-456f-ab0e-a53e7b0fe4a3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:01.005882 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-faa159ec-f89a-456f-ab0e-a53e7b0fe4a3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:01.006312 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-faa159ec-f89a-456f-ab0e-a53e7b0fe4a3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:01.007025 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-faa159ec-f89a-456f-ab0e-a53e7b0fe4a3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:01.007474 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-faa159ec-f89a-456f-ab0e-a53e7b0fe4a3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:01.007936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-faa159ec-f89a-456f-ab0e-a53e7b0fe4a3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:01.069038 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-faa159ec-f89a-456f-ab0e-a53e7b0fe4a3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:01.077716 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-faa159ec-f89a-456f-ab0e-a53e7b0fe4a3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083221 Aug 04 23:50:01.078284 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1281/2586] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:00 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:02.099486 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d8fb3630-6462-454f-ae25-33a1fbcd9b81 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:02.100148 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d8fb3630-6462-454f-ae25-33a1fbcd9b81 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:02.107625 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d8fb3630-6462-454f-ae25-33a1fbcd9b81 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:02.108101 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d8fb3630-6462-454f-ae25-33a1fbcd9b81 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:02.108529 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d8fb3630-6462-454f-ae25-33a1fbcd9b81 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:02.109210 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d8fb3630-6462-454f-ae25-33a1fbcd9b81 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:02.110003 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d8fb3630-6462-454f-ae25-33a1fbcd9b81 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:02.110443 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d8fb3630-6462-454f-ae25-33a1fbcd9b81 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:02.113215 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=84 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:50:02.176605 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d8fb3630-6462-454f-ae25-33a1fbcd9b81 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:02.185337 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d8fb3630-6462-454f-ae25-33a1fbcd9b81 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.089860 Aug 04 23:50:02.185890 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1306/2587] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:02 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:03.206390 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-c01b70c5-3e36-4ed9-8d03-88c7f83c5e4d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:03.206981 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-c01b70c5-3e36-4ed9-8d03-88c7f83c5e4d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:03.213636 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c01b70c5-3e36-4ed9-8d03-88c7f83c5e4d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:03.214177 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c01b70c5-3e36-4ed9-8d03-88c7f83c5e4d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:03.214635 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c01b70c5-3e36-4ed9-8d03-88c7f83c5e4d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:03.215318 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c01b70c5-3e36-4ed9-8d03-88c7f83c5e4d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:03.215767 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c01b70c5-3e36-4ed9-8d03-88c7f83c5e4d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:03.216189 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-c01b70c5-3e36-4ed9-8d03-88c7f83c5e4d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:03.280312 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-c01b70c5-3e36-4ed9-8d03-88c7f83c5e4d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:03.287882 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-c01b70c5-3e36-4ed9-8d03-88c7f83c5e4d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085420 Aug 04 23:50:03.288448 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1282/2588] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:03 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:03.971936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:50:03.972240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:50:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:50:04.310281 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c855a7f4-08f3-4f61-b425-d0ba7f5798b8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:04.310935 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c855a7f4-08f3-4f61-b425-d0ba7f5798b8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:04.317584 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c855a7f4-08f3-4f61-b425-d0ba7f5798b8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:04.318068 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c855a7f4-08f3-4f61-b425-d0ba7f5798b8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:04.318534 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c855a7f4-08f3-4f61-b425-d0ba7f5798b8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:04.319225 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c855a7f4-08f3-4f61-b425-d0ba7f5798b8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:04.319678 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c855a7f4-08f3-4f61-b425-d0ba7f5798b8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:04.320107 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c855a7f4-08f3-4f61-b425-d0ba7f5798b8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:04.380950 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c855a7f4-08f3-4f61-b425-d0ba7f5798b8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:04.388806 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c855a7f4-08f3-4f61-b425-d0ba7f5798b8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.082510 Aug 04 23:50:04.389375 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1307/2589] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:04 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:05.410285 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d5824363-6462-47d5-b7bb-aa8bec7400dd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:05.411018 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d5824363-6462-47d5-b7bb-aa8bec7400dd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:05.417390 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d5824363-6462-47d5-b7bb-aa8bec7400dd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:05.417864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d5824363-6462-47d5-b7bb-aa8bec7400dd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:05.418293 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d5824363-6462-47d5-b7bb-aa8bec7400dd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:05.419025 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d5824363-6462-47d5-b7bb-aa8bec7400dd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:05.419468 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d5824363-6462-47d5-b7bb-aa8bec7400dd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:05.419887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d5824363-6462-47d5-b7bb-aa8bec7400dd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:05.483752 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d5824363-6462-47d5-b7bb-aa8bec7400dd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:05.491904 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d5824363-6462-47d5-b7bb-aa8bec7400dd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085543 Aug 04 23:50:05.492989 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1283/2590] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:05 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:06.513846 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-85f40edc-555a-4e97-bbb3-4312d71ff2be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:06.514589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-85f40edc-555a-4e97-bbb3-4312d71ff2be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:06.520903 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85f40edc-555a-4e97-bbb3-4312d71ff2be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:06.521378 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85f40edc-555a-4e97-bbb3-4312d71ff2be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:06.521838 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85f40edc-555a-4e97-bbb3-4312d71ff2be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:06.522543 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85f40edc-555a-4e97-bbb3-4312d71ff2be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:06.522988 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85f40edc-555a-4e97-bbb3-4312d71ff2be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:06.523405 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-85f40edc-555a-4e97-bbb3-4312d71ff2be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:06.590341 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-85f40edc-555a-4e97-bbb3-4312d71ff2be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:06.598348 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-85f40edc-555a-4e97-bbb3-4312d71ff2be tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.088664 Aug 04 23:50:06.598931 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1308/2591] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:06 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:06.723866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ae7d4e71-2bb2-4b01-9398-2013b2bb7547 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:06.724429 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ae7d4e71-2bb2-4b01-9398-2013b2bb7547 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:06.730705 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae7d4e71-2bb2-4b01-9398-2013b2bb7547 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:06.731188 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae7d4e71-2bb2-4b01-9398-2013b2bb7547 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:06.731623 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae7d4e71-2bb2-4b01-9398-2013b2bb7547 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:06.732314 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae7d4e71-2bb2-4b01-9398-2013b2bb7547 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:06.732763 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae7d4e71-2bb2-4b01-9398-2013b2bb7547 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:06.733214 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ae7d4e71-2bb2-4b01-9398-2013b2bb7547 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:06.747157 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-ae7d4e71-2bb2-4b01-9398-2013b2bb7547 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] HTTP exception thrown: Instance 46a7e2be-71c5-4d64-b02a-a8d125d790e2 could not be found. Aug 04 23:50:06.748806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ae7d4e71-2bb2-4b01-9398-2013b2bb7547 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Request method failure captured: Aug 04 23:50:06.748806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: DELETE /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 HTTP/1.1 Aug 04 23:50:06.748806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:50:06.748806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:50:06.748806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:50:06.748806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 0 Aug 04 23:50:06.748806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:50:06.748806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:50:06.748806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:50:06.748806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:50:06.748806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FRJZMt_ovgBvylQQkOcY773MPZMsH8E61Dm1eLB6D0DgOOyRBI6G0yizu_QS-puIt--Wzz0jIf7la2DtjZkT40s5ZQw8pt2ehw_CTLUmEDuF9PwY_Sam_5zdViqLq68DjmONE54QtGf94GQ2KGKeOyXIby2fSy9S1J2kzxo2Jyuz1g Aug 04 23:50:06.748806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:50:06.748806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:50:06.748806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:50:06.748806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:50:06.748806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:50:06.748806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:50:06.748806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: c5dd21e824d843aea197d84ef1ab1319 Aug 04 23:50:06.748806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-AttachVolumeTestJSON-2132667042 Aug 04 23:50:06.748806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:50:06.748806 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:50:06.750864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c5dd21e824d843aea197d84ef1ab1319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c5dd21e824d843aea197d84ef1ab1319"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c5dd21e824d843aea197d84ef1ab1319"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c5dd21e824d843aea197d84ef1ab1319"}]}] Aug 04 23:50:06.750864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-AttachVolumeTestJSON-2132667042 Aug 04 23:50:06.750864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: c5dd21e824d843aea197d84ef1ab1319 Aug 04 23:50:06.750864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2132667042 Aug 04 23:50:06.750864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-AttachVolumeTestJSON-2132667042-project Aug 04 23:50:06.750864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:50:06.750864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:50:06.750864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: 3a00aba057b548b1bc81e68acffea150 Aug 04 23:50:06.750864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-AttachVolumeTestJSON-2132667042-project Aug 04 23:50:06.750864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: > Aug 04 23:50:06.750864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Instance 46a7e2be-71c5-4d64-b02a-a8d125d790e2 could not be found. Aug 04 23:50:06.750864 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'id': '46a7e2be-71c5-4d64-b02a-a8d125d790e2'} Aug 04 23:50:06.752086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:50:06.752086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:50:06.752086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:50:06.752086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:50:06.752086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:50:06.752086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:50:06.752086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:50:06.752086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:50:06.752086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:50:06.752086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:50:06.752086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46a7e2be-71c5-4d64-b02a-a8d125d790e2 could not be found. Aug 04 23:50:06.752086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:50:06.752086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:50:06.752086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:50:06.752086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:50:06.752086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:50:06.752086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:50:06.752086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:50:06.752086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:50:06.752086 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:50:06.753878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:50:06.753878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 23:50:06.753878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 23:50:06.753878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 23:50:06.753878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 23:50:06.753878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:50:06.753878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:50:06.753878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:50:06.753878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:50:06.753878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46a7e2be-71c5-4d64-b02a-a8d125d790e2 could not be found. Aug 04 23:50:06.753878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:50:06.753878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:50:06.753878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:50:06.753878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:50:06.753878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:50:06.753878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:50:06.753878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:50:06.753878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:50:06.753878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46a7e2be-71c5-4d64-b02a-a8d125d790e2 could not be found. Aug 04 23:50:06.753878 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:50:06.755676 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ae7d4e71-2bb2-4b01-9398-2013b2bb7547 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Returning 404 to user: Instance 46a7e2be-71c5-4d64-b02a-a8d125d790e2 could not be found. {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:50:06.755676 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ae7d4e71-2bb2-4b01-9398-2013b2bb7547 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "DELETE /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 404 len: 111 microversion: 2.1 time: 0.030123 Aug 04 23:50:06.755676 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1284/2592] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:50:06 2022] DELETE /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 23:50:06.759253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-334c6340-ae4d-4641-a2cf-a1834baea3a7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:06.759870 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-334c6340-ae4d-4641-a2cf-a1834baea3a7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] [instance: 46a7e2be-71c5-4d64-b02a-a8d125d790e2] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:06.766250 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-334c6340-ae4d-4641-a2cf-a1834baea3a7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:06.766713 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-334c6340-ae4d-4641-a2cf-a1834baea3a7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:06.767148 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-334c6340-ae4d-4641-a2cf-a1834baea3a7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:06.767943 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-334c6340-ae4d-4641-a2cf-a1834baea3a7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:06.768354 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-334c6340-ae4d-4641-a2cf-a1834baea3a7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:06.768750 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-334c6340-ae4d-4641-a2cf-a1834baea3a7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:06.787007 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-334c6340-ae4d-4641-a2cf-a1834baea3a7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] HTTP exception thrown: Instance 46a7e2be-71c5-4d64-b02a-a8d125d790e2 could not be found. Aug 04 23:50:06.788656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-334c6340-ae4d-4641-a2cf-a1834baea3a7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Request method failure captured: Aug 04 23:50:06.788656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 HTTP/1.1 Aug 04 23:50:06.788656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:50:06.788656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:50:06.788656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:50:06.788656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:50:06.788656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:50:06.788656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:50:06.788656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:50:06.788656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:50:06.788656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FRJZMt_ovgBvylQQkOcY773MPZMsH8E61Dm1eLB6D0DgOOyRBI6G0yizu_QS-puIt--Wzz0jIf7la2DtjZkT40s5ZQw8pt2ehw_CTLUmEDuF9PwY_Sam_5zdViqLq68DjmONE54QtGf94GQ2KGKeOyXIby2fSy9S1J2kzxo2Jyuz1g Aug 04 23:50:06.788656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:50:06.788656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:50:06.788656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:50:06.788656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:50:06.788656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:50:06.788656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:50:06.788656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: c5dd21e824d843aea197d84ef1ab1319 Aug 04 23:50:06.788656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-AttachVolumeTestJSON-2132667042 Aug 04 23:50:06.788656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:50:06.788656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:50:06.790411 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c5dd21e824d843aea197d84ef1ab1319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c5dd21e824d843aea197d84ef1ab1319"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c5dd21e824d843aea197d84ef1ab1319"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c5dd21e824d843aea197d84ef1ab1319"}]}] Aug 04 23:50:06.790411 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-AttachVolumeTestJSON-2132667042 Aug 04 23:50:06.790411 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: c5dd21e824d843aea197d84ef1ab1319 Aug 04 23:50:06.790411 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2132667042 Aug 04 23:50:06.790411 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-AttachVolumeTestJSON-2132667042-project Aug 04 23:50:06.790411 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:50:06.790411 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:50:06.790411 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: 3a00aba057b548b1bc81e68acffea150 Aug 04 23:50:06.790411 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-AttachVolumeTestJSON-2132667042-project Aug 04 23:50:06.790411 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:50:06.790411 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Instance 46a7e2be-71c5-4d64-b02a-a8d125d790e2 could not be found. Aug 04 23:50:06.790411 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': '46a7e2be-71c5-4d64-b02a-a8d125d790e2'} Aug 04 23:50:06.791471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:50:06.791471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:50:06.791471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:50:06.791471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:50:06.791471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:50:06.791471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:50:06.791471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:50:06.791471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:50:06.791471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:50:06.791471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:50:06.791471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46a7e2be-71c5-4d64-b02a-a8d125d790e2 could not be found. Aug 04 23:50:06.791471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:50:06.791471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:50:06.791471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:50:06.791471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:50:06.791471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:50:06.791471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:50:06.791471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:50:06.791471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:50:06.791471 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:50:06.793144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:50:06.793144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:50:06.793144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:50:06.793144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:50:06.793144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:50:06.793144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:50:06.793144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:50:06.793144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46a7e2be-71c5-4d64-b02a-a8d125d790e2 could not be found. Aug 04 23:50:06.793144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:50:06.793144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:50:06.793144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:50:06.793144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:50:06.793144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:50:06.793144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:50:06.793144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:50:06.793144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:50:06.793144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46a7e2be-71c5-4d64-b02a-a8d125d790e2 could not be found. Aug 04 23:50:06.793144 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:50:06.794644 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-334c6340-ae4d-4641-a2cf-a1834baea3a7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] Returning 404 to user: Instance 46a7e2be-71c5-4d64-b02a-a8d125d790e2 could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:50:06.794644 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-334c6340-ae4d-4641-a2cf-a1834baea3a7 tempest-AttachVolumeTestJSON-2132667042 tempest-AttachVolumeTestJSON-2132667042-project] 10.222.0.33 "GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2" status: 404 len: 111 microversion: 2.1 time: 0.035293 Aug 04 23:50:06.794644 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1309/2593] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:06 2022] GET /compute/v2.1/servers/46a7e2be-71c5-4d64-b02a-a8d125d790e2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 23:50:07.619200 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5757d258-5b7a-4b25-95bf-c973abd8eb7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:07.619816 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5757d258-5b7a-4b25-95bf-c973abd8eb7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:07.626052 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5757d258-5b7a-4b25-95bf-c973abd8eb7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:07.626584 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5757d258-5b7a-4b25-95bf-c973abd8eb7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:07.627019 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5757d258-5b7a-4b25-95bf-c973abd8eb7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:07.627716 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5757d258-5b7a-4b25-95bf-c973abd8eb7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:07.628286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5757d258-5b7a-4b25-95bf-c973abd8eb7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:07.628620 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5757d258-5b7a-4b25-95bf-c973abd8eb7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:07.694026 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5757d258-5b7a-4b25-95bf-c973abd8eb7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:07.702810 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5757d258-5b7a-4b25-95bf-c973abd8eb7c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.088136 Aug 04 23:50:07.703386 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1285/2594] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:07 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:08.730304 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-cc6e0889-d953-4690-9981-fbff736fa950 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:08.732404 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-cc6e0889-d953-4690-9981-fbff736fa950 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:08.744460 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc6e0889-d953-4690-9981-fbff736fa950 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:08.745702 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc6e0889-d953-4690-9981-fbff736fa950 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:08.746937 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc6e0889-d953-4690-9981-fbff736fa950 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:08.748404 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc6e0889-d953-4690-9981-fbff736fa950 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:08.749476 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc6e0889-d953-4690-9981-fbff736fa950 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:08.750436 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cc6e0889-d953-4690-9981-fbff736fa950 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:08.826169 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-cc6e0889-d953-4690-9981-fbff736fa950 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:08.840557 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-cc6e0889-d953-4690-9981-fbff736fa950 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.118655 Aug 04 23:50:08.841637 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1310/2595] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:08 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:09.862906 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fd3130a2-4f66-4e0a-ba45-4e319a626d30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:09.863644 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-fd3130a2-4f66-4e0a-ba45-4e319a626d30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:09.871525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fd3130a2-4f66-4e0a-ba45-4e319a626d30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:09.872134 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fd3130a2-4f66-4e0a-ba45-4e319a626d30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:09.872814 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fd3130a2-4f66-4e0a-ba45-4e319a626d30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:09.873612 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fd3130a2-4f66-4e0a-ba45-4e319a626d30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:09.874128 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fd3130a2-4f66-4e0a-ba45-4e319a626d30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:09.874640 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fd3130a2-4f66-4e0a-ba45-4e319a626d30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:09.946043 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fd3130a2-4f66-4e0a-ba45-4e319a626d30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:09.954698 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-fd3130a2-4f66-4e0a-ba45-4e319a626d30 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.095526 Aug 04 23:50:09.956085 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1286/2596] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:09 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:10.977783 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-034b8994-73b2-4fea-8d69-916545b65e1b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:10.979100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-034b8994-73b2-4fea-8d69-916545b65e1b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:10.985438 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-034b8994-73b2-4fea-8d69-916545b65e1b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:10.985911 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-034b8994-73b2-4fea-8d69-916545b65e1b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:10.986341 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-034b8994-73b2-4fea-8d69-916545b65e1b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:10.987060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-034b8994-73b2-4fea-8d69-916545b65e1b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:10.987506 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-034b8994-73b2-4fea-8d69-916545b65e1b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:10.987923 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-034b8994-73b2-4fea-8d69-916545b65e1b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:11.053080 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-034b8994-73b2-4fea-8d69-916545b65e1b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:11.060817 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-034b8994-73b2-4fea-8d69-916545b65e1b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087482 Aug 04 23:50:11.061383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1311/2597] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:10 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:12.082967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3160eb72-c592-4f96-ade1-53d48cb62df2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:12.083576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3160eb72-c592-4f96-ade1-53d48cb62df2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:12.090676 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3160eb72-c592-4f96-ade1-53d48cb62df2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:12.091159 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3160eb72-c592-4f96-ade1-53d48cb62df2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:12.091594 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3160eb72-c592-4f96-ade1-53d48cb62df2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:12.092299 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3160eb72-c592-4f96-ade1-53d48cb62df2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:12.092750 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3160eb72-c592-4f96-ade1-53d48cb62df2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:12.093179 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3160eb72-c592-4f96-ade1-53d48cb62df2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:12.157732 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3160eb72-c592-4f96-ade1-53d48cb62df2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:12.165976 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3160eb72-c592-4f96-ade1-53d48cb62df2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086843 Aug 04 23:50:12.166570 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1287/2598] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:12 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:13.188357 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-610b9240-4519-467f-9d6c-53d974c6cefc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:13.188995 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-610b9240-4519-467f-9d6c-53d974c6cefc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:13.195532 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-610b9240-4519-467f-9d6c-53d974c6cefc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:13.196751 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-610b9240-4519-467f-9d6c-53d974c6cefc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:13.197373 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-610b9240-4519-467f-9d6c-53d974c6cefc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:13.197944 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-610b9240-4519-467f-9d6c-53d974c6cefc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:13.198413 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-610b9240-4519-467f-9d6c-53d974c6cefc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:13.198838 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-610b9240-4519-467f-9d6c-53d974c6cefc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:13.260338 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-610b9240-4519-467f-9d6c-53d974c6cefc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:13.267986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-610b9240-4519-467f-9d6c-53d974c6cefc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083685 Aug 04 23:50:13.268537 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1312/2599] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:13 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:14.289268 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9984cb87-b760-459d-b9f8-fb8d0e8cac87 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:14.290114 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9984cb87-b760-459d-b9f8-fb8d0e8cac87 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:14.296845 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9984cb87-b760-459d-b9f8-fb8d0e8cac87 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:14.297336 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9984cb87-b760-459d-b9f8-fb8d0e8cac87 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:14.297774 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9984cb87-b760-459d-b9f8-fb8d0e8cac87 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:14.298502 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9984cb87-b760-459d-b9f8-fb8d0e8cac87 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:14.298956 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9984cb87-b760-459d-b9f8-fb8d0e8cac87 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:14.299377 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9984cb87-b760-459d-b9f8-fb8d0e8cac87 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:14.367068 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9984cb87-b760-459d-b9f8-fb8d0e8cac87 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:14.375578 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9984cb87-b760-459d-b9f8-fb8d0e8cac87 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.090106 Aug 04 23:50:14.376154 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1288/2600] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:14 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:15.397257 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-41562432-7f4f-4d1f-b0d4-daebcf51966c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:15.397917 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-41562432-7f4f-4d1f-b0d4-daebcf51966c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:15.405174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-41562432-7f4f-4d1f-b0d4-daebcf51966c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:15.405678 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-41562432-7f4f-4d1f-b0d4-daebcf51966c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:15.406137 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-41562432-7f4f-4d1f-b0d4-daebcf51966c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:15.406929 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-41562432-7f4f-4d1f-b0d4-daebcf51966c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:15.407412 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-41562432-7f4f-4d1f-b0d4-daebcf51966c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:15.407860 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-41562432-7f4f-4d1f-b0d4-daebcf51966c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:15.475091 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-41562432-7f4f-4d1f-b0d4-daebcf51966c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:15.484129 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-41562432-7f4f-4d1f-b0d4-daebcf51966c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.090331 Aug 04 23:50:15.484704 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1313/2601] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:15 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:16.506208 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5e06d1a4-89ca-492d-8cf5-f0d6edab04d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:16.506881 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5e06d1a4-89ca-492d-8cf5-f0d6edab04d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:16.514279 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5e06d1a4-89ca-492d-8cf5-f0d6edab04d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:16.514814 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5e06d1a4-89ca-492d-8cf5-f0d6edab04d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:16.515264 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5e06d1a4-89ca-492d-8cf5-f0d6edab04d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:16.516034 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5e06d1a4-89ca-492d-8cf5-f0d6edab04d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:16.516488 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5e06d1a4-89ca-492d-8cf5-f0d6edab04d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:16.516907 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5e06d1a4-89ca-492d-8cf5-f0d6edab04d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:16.594069 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5e06d1a4-89ca-492d-8cf5-f0d6edab04d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:16.607307 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5e06d1a4-89ca-492d-8cf5-f0d6edab04d0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.104987 Aug 04 23:50:16.608011 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1289/2602] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:16 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:17.630013 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-13be0931-cf12-47a5-ac20-89eed83ec5cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:17.630844 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-13be0931-cf12-47a5-ac20-89eed83ec5cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:17.638116 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-13be0931-cf12-47a5-ac20-89eed83ec5cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:17.638626 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-13be0931-cf12-47a5-ac20-89eed83ec5cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:17.639059 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-13be0931-cf12-47a5-ac20-89eed83ec5cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:17.639755 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-13be0931-cf12-47a5-ac20-89eed83ec5cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:17.640200 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-13be0931-cf12-47a5-ac20-89eed83ec5cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:17.640613 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-13be0931-cf12-47a5-ac20-89eed83ec5cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:17.706408 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-13be0931-cf12-47a5-ac20-89eed83ec5cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:17.715475 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-13be0931-cf12-47a5-ac20-89eed83ec5cf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.089279 Aug 04 23:50:17.716061 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1314/2603] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:17 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:18.971069 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-524d6112-e64c-4f9e-a680-7378a6d67e56 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:18.972039 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-524d6112-e64c-4f9e-a680-7378a6d67e56 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:18.980019 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-524d6112-e64c-4f9e-a680-7378a6d67e56 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:18.980513 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-524d6112-e64c-4f9e-a680-7378a6d67e56 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:18.980949 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-524d6112-e64c-4f9e-a680-7378a6d67e56 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:18.981653 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-524d6112-e64c-4f9e-a680-7378a6d67e56 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:18.982108 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-524d6112-e64c-4f9e-a680-7378a6d67e56 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:18.982639 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-524d6112-e64c-4f9e-a680-7378a6d67e56 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:19.067584 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-524d6112-e64c-4f9e-a680-7378a6d67e56 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:19.067584 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-524d6112-e64c-4f9e-a680-7378a6d67e56 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.328899 Aug 04 23:50:19.067584 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1290/2604] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:18 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:20.088377 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3c5a6b91-68c7-4fb3-a9f9-7e84df92b4e5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:20.088907 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3c5a6b91-68c7-4fb3-a9f9-7e84df92b4e5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:20.095722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c5a6b91-68c7-4fb3-a9f9-7e84df92b4e5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:20.096212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c5a6b91-68c7-4fb3-a9f9-7e84df92b4e5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:20.096653 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c5a6b91-68c7-4fb3-a9f9-7e84df92b4e5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:20.097360 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c5a6b91-68c7-4fb3-a9f9-7e84df92b4e5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:20.097815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c5a6b91-68c7-4fb3-a9f9-7e84df92b4e5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:20.098244 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3c5a6b91-68c7-4fb3-a9f9-7e84df92b4e5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:20.164731 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3c5a6b91-68c7-4fb3-a9f9-7e84df92b4e5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:20.174333 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3c5a6b91-68c7-4fb3-a9f9-7e84df92b4e5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.090242 Aug 04 23:50:20.175054 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1315/2605] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:20 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:21.198294 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-50d03a13-1a8f-4a0a-9a4d-c95ea1e39cf5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:21.199076 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-50d03a13-1a8f-4a0a-9a4d-c95ea1e39cf5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:21.205705 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-50d03a13-1a8f-4a0a-9a4d-c95ea1e39cf5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:21.206224 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-50d03a13-1a8f-4a0a-9a4d-c95ea1e39cf5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:21.206697 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-50d03a13-1a8f-4a0a-9a4d-c95ea1e39cf5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:21.207395 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-50d03a13-1a8f-4a0a-9a4d-c95ea1e39cf5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:21.207843 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-50d03a13-1a8f-4a0a-9a4d-c95ea1e39cf5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:21.208261 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-50d03a13-1a8f-4a0a-9a4d-c95ea1e39cf5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:21.211031 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=86 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:50:21.280207 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-50d03a13-1a8f-4a0a-9a4d-c95ea1e39cf5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:21.293251 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-50d03a13-1a8f-4a0a-9a4d-c95ea1e39cf5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.099108 Aug 04 23:50:21.294550 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1291/2606] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:21 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:22.314503 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b8913b79-128d-4081-a49e-eeb895cdc85c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:22.315288 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b8913b79-128d-4081-a49e-eeb895cdc85c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:22.321726 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8913b79-128d-4081-a49e-eeb895cdc85c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:22.322164 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8913b79-128d-4081-a49e-eeb895cdc85c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:22.322625 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8913b79-128d-4081-a49e-eeb895cdc85c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:22.323337 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8913b79-128d-4081-a49e-eeb895cdc85c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:22.323793 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8913b79-128d-4081-a49e-eeb895cdc85c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:22.324216 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b8913b79-128d-4081-a49e-eeb895cdc85c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:22.396253 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b8913b79-128d-4081-a49e-eeb895cdc85c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:22.404889 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b8913b79-128d-4081-a49e-eeb895cdc85c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.094192 Aug 04 23:50:22.405478 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1316/2607] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:22 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:23.425484 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-20dadd73-04e6-474b-a3fb-86486948d2a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:23.426104 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-20dadd73-04e6-474b-a3fb-86486948d2a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:23.433331 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20dadd73-04e6-474b-a3fb-86486948d2a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:23.433809 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20dadd73-04e6-474b-a3fb-86486948d2a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:23.434234 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20dadd73-04e6-474b-a3fb-86486948d2a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:23.434947 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20dadd73-04e6-474b-a3fb-86486948d2a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:23.435391 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20dadd73-04e6-474b-a3fb-86486948d2a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:23.435805 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-20dadd73-04e6-474b-a3fb-86486948d2a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:23.499547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-20dadd73-04e6-474b-a3fb-86486948d2a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:23.507179 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-20dadd73-04e6-474b-a3fb-86486948d2a5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085818 Aug 04 23:50:23.507751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1292/2608] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:23 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:24.529314 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-14530bc7-d645-4b0b-b95f-e96daff342b3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:24.529846 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-14530bc7-d645-4b0b-b95f-e96daff342b3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:24.535776 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-14530bc7-d645-4b0b-b95f-e96daff342b3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:24.536249 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-14530bc7-d645-4b0b-b95f-e96daff342b3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:24.536673 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-14530bc7-d645-4b0b-b95f-e96daff342b3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:24.537354 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-14530bc7-d645-4b0b-b95f-e96daff342b3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:24.537796 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-14530bc7-d645-4b0b-b95f-e96daff342b3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:24.538216 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-14530bc7-d645-4b0b-b95f-e96daff342b3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:24.602522 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-14530bc7-d645-4b0b-b95f-e96daff342b3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:24.610886 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-14530bc7-d645-4b0b-b95f-e96daff342b3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086384 Aug 04 23:50:24.611462 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1317/2609] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:24 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:25.633415 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-64a1e8ad-9be6-44cc-84da-c980b0569ff5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:25.634764 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-64a1e8ad-9be6-44cc-84da-c980b0569ff5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:25.642677 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-64a1e8ad-9be6-44cc-84da-c980b0569ff5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:25.643307 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-64a1e8ad-9be6-44cc-84da-c980b0569ff5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:25.643828 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-64a1e8ad-9be6-44cc-84da-c980b0569ff5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:25.644636 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-64a1e8ad-9be6-44cc-84da-c980b0569ff5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:25.645170 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-64a1e8ad-9be6-44cc-84da-c980b0569ff5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:25.645670 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-64a1e8ad-9be6-44cc-84da-c980b0569ff5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:25.733805 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-64a1e8ad-9be6-44cc-84da-c980b0569ff5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:25.741887 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-64a1e8ad-9be6-44cc-84da-c980b0569ff5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.112728 Aug 04 23:50:25.742495 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1293/2610] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:25 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:26.776803 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-38cb113b-3a85-4acc-b15a-62b705cd75f1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:26.777420 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-38cb113b-3a85-4acc-b15a-62b705cd75f1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:26.784321 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-38cb113b-3a85-4acc-b15a-62b705cd75f1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:26.784806 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-38cb113b-3a85-4acc-b15a-62b705cd75f1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:26.785235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-38cb113b-3a85-4acc-b15a-62b705cd75f1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:26.785984 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-38cb113b-3a85-4acc-b15a-62b705cd75f1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:26.786496 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-38cb113b-3a85-4acc-b15a-62b705cd75f1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:26.786920 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-38cb113b-3a85-4acc-b15a-62b705cd75f1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:26.858336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-38cb113b-3a85-4acc-b15a-62b705cd75f1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:26.867944 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-38cb113b-3a85-4acc-b15a-62b705cd75f1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.094956 Aug 04 23:50:26.868577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1318/2611] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:26 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:27.890525 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-fbb40906-0bf4-4ccf-b076-f3de301c0c0a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:27.891138 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-fbb40906-0bf4-4ccf-b076-f3de301c0c0a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:27.893471 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=30 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:50:27.898987 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fbb40906-0bf4-4ccf-b076-f3de301c0c0a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:27.899475 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fbb40906-0bf4-4ccf-b076-f3de301c0c0a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:27.899956 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fbb40906-0bf4-4ccf-b076-f3de301c0c0a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:27.900828 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fbb40906-0bf4-4ccf-b076-f3de301c0c0a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:27.901286 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fbb40906-0bf4-4ccf-b076-f3de301c0c0a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:27.901710 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-fbb40906-0bf4-4ccf-b076-f3de301c0c0a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:27.967356 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-fbb40906-0bf4-4ccf-b076-f3de301c0c0a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:27.975080 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-fbb40906-0bf4-4ccf-b076-f3de301c0c0a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.088592 Aug 04 23:50:27.975642 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1294/2612] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:27 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:28.995987 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-cf6aa050-5eb0-4cea-acaa-99dd2eee5f40 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:28.996604 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-cf6aa050-5eb0-4cea-acaa-99dd2eee5f40 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:29.003399 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf6aa050-5eb0-4cea-acaa-99dd2eee5f40 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:29.003897 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf6aa050-5eb0-4cea-acaa-99dd2eee5f40 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:29.004335 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf6aa050-5eb0-4cea-acaa-99dd2eee5f40 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:29.005052 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf6aa050-5eb0-4cea-acaa-99dd2eee5f40 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:29.005504 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf6aa050-5eb0-4cea-acaa-99dd2eee5f40 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:29.005929 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-cf6aa050-5eb0-4cea-acaa-99dd2eee5f40 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:29.074489 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-cf6aa050-5eb0-4cea-acaa-99dd2eee5f40 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:29.082575 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-cf6aa050-5eb0-4cea-acaa-99dd2eee5f40 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.090291 Aug 04 23:50:29.083198 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1319/2613] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:28 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:29.557729 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:50:29.558296 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:50:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:50:30.108081 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-79973809-1c1d-4a1e-a05e-5be18c7610f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:30.109018 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-79973809-1c1d-4a1e-a05e-5be18c7610f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:30.117648 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79973809-1c1d-4a1e-a05e-5be18c7610f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:30.118170 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79973809-1c1d-4a1e-a05e-5be18c7610f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:30.119159 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79973809-1c1d-4a1e-a05e-5be18c7610f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:30.119860 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79973809-1c1d-4a1e-a05e-5be18c7610f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:30.120310 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79973809-1c1d-4a1e-a05e-5be18c7610f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:30.120738 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79973809-1c1d-4a1e-a05e-5be18c7610f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:30.190902 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-79973809-1c1d-4a1e-a05e-5be18c7610f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:30.199987 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-79973809-1c1d-4a1e-a05e-5be18c7610f5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.099089 Aug 04 23:50:30.200561 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1295/2614] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:30 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:31.220756 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7b1282f5-5da6-4f58-9be3-35ca61bf2a47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:31.221540 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7b1282f5-5da6-4f58-9be3-35ca61bf2a47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:31.223800 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=30 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:50:31.229679 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b1282f5-5da6-4f58-9be3-35ca61bf2a47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:31.230168 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b1282f5-5da6-4f58-9be3-35ca61bf2a47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:31.230632 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b1282f5-5da6-4f58-9be3-35ca61bf2a47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:31.231339 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b1282f5-5da6-4f58-9be3-35ca61bf2a47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:31.231791 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b1282f5-5da6-4f58-9be3-35ca61bf2a47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:31.232222 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7b1282f5-5da6-4f58-9be3-35ca61bf2a47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:31.299049 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7b1282f5-5da6-4f58-9be3-35ca61bf2a47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:31.313127 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7b1282f5-5da6-4f58-9be3-35ca61bf2a47 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.096122 Aug 04 23:50:31.313706 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1320/2615] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:31 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:32.334775 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3d300a41-5845-4ab7-a6dc-313d953cd41a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:32.335382 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3d300a41-5845-4ab7-a6dc-313d953cd41a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:32.342914 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3d300a41-5845-4ab7-a6dc-313d953cd41a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:32.343419 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3d300a41-5845-4ab7-a6dc-313d953cd41a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:32.343877 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3d300a41-5845-4ab7-a6dc-313d953cd41a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:32.344571 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3d300a41-5845-4ab7-a6dc-313d953cd41a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:32.345020 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3d300a41-5845-4ab7-a6dc-313d953cd41a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:32.345446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3d300a41-5845-4ab7-a6dc-313d953cd41a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:32.412663 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3d300a41-5845-4ab7-a6dc-313d953cd41a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:32.421140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3d300a41-5845-4ab7-a6dc-313d953cd41a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.090206 Aug 04 23:50:32.421649 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1296/2616] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:32 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:33.442064 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-727dac7c-8551-43dd-a3ca-ad0b96711cd0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:33.442698 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-727dac7c-8551-43dd-a3ca-ad0b96711cd0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:33.449698 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-727dac7c-8551-43dd-a3ca-ad0b96711cd0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:33.450176 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-727dac7c-8551-43dd-a3ca-ad0b96711cd0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:33.450656 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-727dac7c-8551-43dd-a3ca-ad0b96711cd0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:33.451353 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-727dac7c-8551-43dd-a3ca-ad0b96711cd0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:33.451806 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-727dac7c-8551-43dd-a3ca-ad0b96711cd0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:33.452231 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-727dac7c-8551-43dd-a3ca-ad0b96711cd0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:33.454836 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=86 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:50:33.513357 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-727dac7c-8551-43dd-a3ca-ad0b96711cd0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:33.520770 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-727dac7c-8551-43dd-a3ca-ad0b96711cd0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.082582 Aug 04 23:50:33.521321 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1321/2617] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:33 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:34.542442 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-90256cf0-c042-4c97-baf2-44943ac7034b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:34.542979 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-90256cf0-c042-4c97-baf2-44943ac7034b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:34.559072 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-90256cf0-c042-4c97-baf2-44943ac7034b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:34.559569 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-90256cf0-c042-4c97-baf2-44943ac7034b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:34.560009 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-90256cf0-c042-4c97-baf2-44943ac7034b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:34.560714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-90256cf0-c042-4c97-baf2-44943ac7034b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:34.561166 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-90256cf0-c042-4c97-baf2-44943ac7034b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:34.561583 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-90256cf0-c042-4c97-baf2-44943ac7034b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:34.628875 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-90256cf0-c042-4c97-baf2-44943ac7034b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:34.638104 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-90256cf0-c042-4c97-baf2-44943ac7034b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.099514 Aug 04 23:50:34.638712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1297/2618] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:34 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:35.659188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b711a40a-37c7-49fa-a959-ac99137c27a8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:35.659768 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b711a40a-37c7-49fa-a959-ac99137c27a8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:35.667208 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b711a40a-37c7-49fa-a959-ac99137c27a8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:35.667697 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b711a40a-37c7-49fa-a959-ac99137c27a8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:35.668161 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b711a40a-37c7-49fa-a959-ac99137c27a8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:35.668941 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b711a40a-37c7-49fa-a959-ac99137c27a8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:35.669408 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b711a40a-37c7-49fa-a959-ac99137c27a8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:35.669832 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b711a40a-37c7-49fa-a959-ac99137c27a8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:35.735849 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b711a40a-37c7-49fa-a959-ac99137c27a8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:35.743496 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b711a40a-37c7-49fa-a959-ac99137c27a8 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.088141 Aug 04 23:50:35.744740 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1322/2619] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:35 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:36.766555 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e44e2d12-92c1-465f-adde-fe2a7cb88c60 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:36.767168 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e44e2d12-92c1-465f-adde-fe2a7cb88c60 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:36.773649 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e44e2d12-92c1-465f-adde-fe2a7cb88c60 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:36.774131 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e44e2d12-92c1-465f-adde-fe2a7cb88c60 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:36.774601 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e44e2d12-92c1-465f-adde-fe2a7cb88c60 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:36.775289 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e44e2d12-92c1-465f-adde-fe2a7cb88c60 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:36.775735 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e44e2d12-92c1-465f-adde-fe2a7cb88c60 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:36.776155 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e44e2d12-92c1-465f-adde-fe2a7cb88c60 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:36.852989 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e44e2d12-92c1-465f-adde-fe2a7cb88c60 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:36.861145 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e44e2d12-92c1-465f-adde-fe2a7cb88c60 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.099076 Aug 04 23:50:36.861827 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1298/2620] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:36 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:37.882989 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-bf2a2c9d-499b-451d-88e8-3ed7fed64961 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:37.883598 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-bf2a2c9d-499b-451d-88e8-3ed7fed64961 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:37.890967 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bf2a2c9d-499b-451d-88e8-3ed7fed64961 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:37.891481 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bf2a2c9d-499b-451d-88e8-3ed7fed64961 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:37.891935 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bf2a2c9d-499b-451d-88e8-3ed7fed64961 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:37.892630 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bf2a2c9d-499b-451d-88e8-3ed7fed64961 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:37.893076 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bf2a2c9d-499b-451d-88e8-3ed7fed64961 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:37.893495 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-bf2a2c9d-499b-451d-88e8-3ed7fed64961 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:37.958255 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-bf2a2c9d-499b-451d-88e8-3ed7fed64961 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:37.967829 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-bf2a2c9d-499b-451d-88e8-3ed7fed64961 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.088682 Aug 04 23:50:37.968409 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1323/2621] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:37 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:38.988741 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-26f024cb-d5d5-4098-a089-cf614e8931f1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:38.989617 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-26f024cb-d5d5-4098-a089-cf614e8931f1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:38.995999 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26f024cb-d5d5-4098-a089-cf614e8931f1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:38.997034 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26f024cb-d5d5-4098-a089-cf614e8931f1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:38.997652 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26f024cb-d5d5-4098-a089-cf614e8931f1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:38.998372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26f024cb-d5d5-4098-a089-cf614e8931f1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:38.998830 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26f024cb-d5d5-4098-a089-cf614e8931f1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:38.999252 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-26f024cb-d5d5-4098-a089-cf614e8931f1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:39.065992 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-26f024cb-d5d5-4098-a089-cf614e8931f1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:39.073894 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-26f024cb-d5d5-4098-a089-cf614e8931f1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.088999 Aug 04 23:50:39.074590 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1299/2622] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:38 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:40.100403 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a38e093b-8740-4468-bf97-a1d258775bf7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:40.100932 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a38e093b-8740-4468-bf97-a1d258775bf7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:40.107603 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a38e093b-8740-4468-bf97-a1d258775bf7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:40.108081 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a38e093b-8740-4468-bf97-a1d258775bf7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:40.108517 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a38e093b-8740-4468-bf97-a1d258775bf7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:40.109209 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a38e093b-8740-4468-bf97-a1d258775bf7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:40.109659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a38e093b-8740-4468-bf97-a1d258775bf7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:40.110076 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a38e093b-8740-4468-bf97-a1d258775bf7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:40.171355 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a38e093b-8740-4468-bf97-a1d258775bf7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:40.178926 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a38e093b-8740-4468-bf97-a1d258775bf7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.082425 Aug 04 23:50:40.179742 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1324/2623] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:40 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:41.200197 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5dafbeb2-8b6f-42e1-a9e7-86fbab4013c7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:41.200938 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5dafbeb2-8b6f-42e1-a9e7-86fbab4013c7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:41.207859 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5dafbeb2-8b6f-42e1-a9e7-86fbab4013c7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:41.208351 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5dafbeb2-8b6f-42e1-a9e7-86fbab4013c7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:41.208787 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5dafbeb2-8b6f-42e1-a9e7-86fbab4013c7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:41.209490 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5dafbeb2-8b6f-42e1-a9e7-86fbab4013c7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:41.209949 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5dafbeb2-8b6f-42e1-a9e7-86fbab4013c7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:41.210391 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5dafbeb2-8b6f-42e1-a9e7-86fbab4013c7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:41.275238 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5dafbeb2-8b6f-42e1-a9e7-86fbab4013c7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:41.284918 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5dafbeb2-8b6f-42e1-a9e7-86fbab4013c7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.088536 Aug 04 23:50:41.285493 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1300/2624] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:41 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:42.306884 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2250289d-e4d0-4c7a-add7-031d59e15290 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:42.307493 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2250289d-e4d0-4c7a-add7-031d59e15290 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:42.314978 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2250289d-e4d0-4c7a-add7-031d59e15290 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:42.315456 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2250289d-e4d0-4c7a-add7-031d59e15290 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:42.315881 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2250289d-e4d0-4c7a-add7-031d59e15290 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:42.316560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2250289d-e4d0-4c7a-add7-031d59e15290 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:42.317004 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2250289d-e4d0-4c7a-add7-031d59e15290 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:42.317418 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2250289d-e4d0-4c7a-add7-031d59e15290 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:42.379561 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2250289d-e4d0-4c7a-add7-031d59e15290 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:42.387265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2250289d-e4d0-4c7a-add7-031d59e15290 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084435 Aug 04 23:50:42.387913 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1325/2625] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:42 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:43.409112 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6470207c-0550-4656-89b6-2516a5ef4c33 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:43.409718 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6470207c-0550-4656-89b6-2516a5ef4c33 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:43.416311 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6470207c-0550-4656-89b6-2516a5ef4c33 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:43.416788 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6470207c-0550-4656-89b6-2516a5ef4c33 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:43.417221 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6470207c-0550-4656-89b6-2516a5ef4c33 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:43.417911 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6470207c-0550-4656-89b6-2516a5ef4c33 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:43.418384 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6470207c-0550-4656-89b6-2516a5ef4c33 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:43.418951 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6470207c-0550-4656-89b6-2516a5ef4c33 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:43.485395 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6470207c-0550-4656-89b6-2516a5ef4c33 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:43.493310 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6470207c-0550-4656-89b6-2516a5ef4c33 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.088502 Aug 04 23:50:43.493907 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1301/2626] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:43 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:50:44.514032 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f4e0e62a-2df0-4a74-8b16-145172a012c1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:44.514589 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f4e0e62a-2df0-4a74-8b16-145172a012c1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:44.521180 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4e0e62a-2df0-4a74-8b16-145172a012c1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:44.521659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4e0e62a-2df0-4a74-8b16-145172a012c1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:44.522088 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4e0e62a-2df0-4a74-8b16-145172a012c1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:44.522837 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4e0e62a-2df0-4a74-8b16-145172a012c1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:44.523308 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4e0e62a-2df0-4a74-8b16-145172a012c1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:44.523748 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f4e0e62a-2df0-4a74-8b16-145172a012c1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:44.589095 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f4e0e62a-2df0-4a74-8b16-145172a012c1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:44.597189 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f4e0e62a-2df0-4a74-8b16-145172a012c1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087571 Aug 04 23:50:44.597757 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1326/2627] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:44 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:45.618700 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-07b17dba-755e-48d5-9af2-c17877a073df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:45.619309 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-07b17dba-755e-48d5-9af2-c17877a073df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:45.626785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-07b17dba-755e-48d5-9af2-c17877a073df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:45.627275 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-07b17dba-755e-48d5-9af2-c17877a073df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:45.627713 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-07b17dba-755e-48d5-9af2-c17877a073df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:45.628431 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-07b17dba-755e-48d5-9af2-c17877a073df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:45.628892 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-07b17dba-755e-48d5-9af2-c17877a073df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:45.629320 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-07b17dba-755e-48d5-9af2-c17877a073df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:45.697521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-07b17dba-755e-48d5-9af2-c17877a073df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:45.706179 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-07b17dba-755e-48d5-9af2-c17877a073df tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.091559 Aug 04 23:50:45.706776 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1302/2628] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:45 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:46.727134 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-27622df7-acc3-4a57-adb9-1f0d56efec63 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:46.727802 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-27622df7-acc3-4a57-adb9-1f0d56efec63 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:46.734884 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-27622df7-acc3-4a57-adb9-1f0d56efec63 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:46.735364 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-27622df7-acc3-4a57-adb9-1f0d56efec63 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:46.735799 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-27622df7-acc3-4a57-adb9-1f0d56efec63 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:46.736508 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-27622df7-acc3-4a57-adb9-1f0d56efec63 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:46.736959 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-27622df7-acc3-4a57-adb9-1f0d56efec63 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:46.737379 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-27622df7-acc3-4a57-adb9-1f0d56efec63 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:46.801681 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-27622df7-acc3-4a57-adb9-1f0d56efec63 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:46.809795 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-27622df7-acc3-4a57-adb9-1f0d56efec63 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086363 Aug 04 23:50:46.810633 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1327/2629] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:46 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:47.830290 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-80d7cee6-b601-40f7-83ed-4b6b97bdb4e6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:47.830923 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-80d7cee6-b601-40f7-83ed-4b6b97bdb4e6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:47.837470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80d7cee6-b601-40f7-83ed-4b6b97bdb4e6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:47.837947 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80d7cee6-b601-40f7-83ed-4b6b97bdb4e6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:47.838389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80d7cee6-b601-40f7-83ed-4b6b97bdb4e6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:47.839082 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80d7cee6-b601-40f7-83ed-4b6b97bdb4e6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:47.839531 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80d7cee6-b601-40f7-83ed-4b6b97bdb4e6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:47.839950 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-80d7cee6-b601-40f7-83ed-4b6b97bdb4e6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:47.906581 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-80d7cee6-b601-40f7-83ed-4b6b97bdb4e6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:47.914355 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-80d7cee6-b601-40f7-83ed-4b6b97bdb4e6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087939 Aug 04 23:50:47.914941 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1303/2630] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:47 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:48.936623 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-43e77f1f-6167-4056-a20b-d7ead15b4348 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:48.937229 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-43e77f1f-6167-4056-a20b-d7ead15b4348 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:48.943734 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-43e77f1f-6167-4056-a20b-d7ead15b4348 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:48.944210 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-43e77f1f-6167-4056-a20b-d7ead15b4348 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:48.944640 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-43e77f1f-6167-4056-a20b-d7ead15b4348 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:48.945323 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-43e77f1f-6167-4056-a20b-d7ead15b4348 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:48.945771 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-43e77f1f-6167-4056-a20b-d7ead15b4348 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:48.946196 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-43e77f1f-6167-4056-a20b-d7ead15b4348 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:49.008299 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-43e77f1f-6167-4056-a20b-d7ead15b4348 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:49.016885 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-43e77f1f-6167-4056-a20b-d7ead15b4348 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085111 Aug 04 23:50:49.017451 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1328/2631] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:48 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:50.038959 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-0be49fbc-e616-4b8f-8b5f-a4be899f2653 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:50.039589 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-0be49fbc-e616-4b8f-8b5f-a4be899f2653 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:50.046414 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0be49fbc-e616-4b8f-8b5f-a4be899f2653 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:50.046881 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0be49fbc-e616-4b8f-8b5f-a4be899f2653 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:50.047305 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0be49fbc-e616-4b8f-8b5f-a4be899f2653 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:50.047981 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0be49fbc-e616-4b8f-8b5f-a4be899f2653 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:50.048546 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0be49fbc-e616-4b8f-8b5f-a4be899f2653 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:50.049084 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-0be49fbc-e616-4b8f-8b5f-a4be899f2653 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:50.113924 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-0be49fbc-e616-4b8f-8b5f-a4be899f2653 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:50.121530 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-0be49fbc-e616-4b8f-8b5f-a4be899f2653 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086931 Aug 04 23:50:50.123132 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1304/2632] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:50 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:51.143836 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4c7be7ee-4971-40f8-8e35-eb185ef4d60b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:51.144363 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4c7be7ee-4971-40f8-8e35-eb185ef4d60b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:51.150798 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c7be7ee-4971-40f8-8e35-eb185ef4d60b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:51.151276 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c7be7ee-4971-40f8-8e35-eb185ef4d60b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:51.151710 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c7be7ee-4971-40f8-8e35-eb185ef4d60b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:51.152524 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c7be7ee-4971-40f8-8e35-eb185ef4d60b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:51.152977 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c7be7ee-4971-40f8-8e35-eb185ef4d60b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:51.154210 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c7be7ee-4971-40f8-8e35-eb185ef4d60b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:51.216665 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4c7be7ee-4971-40f8-8e35-eb185ef4d60b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:51.224212 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4c7be7ee-4971-40f8-8e35-eb185ef4d60b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084445 Aug 04 23:50:51.224779 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1329/2633] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:51 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:52.245396 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2358f8a8-c91d-4215-91b9-2f1ee5a3a142 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:52.245997 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2358f8a8-c91d-4215-91b9-2f1ee5a3a142 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:52.253234 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2358f8a8-c91d-4215-91b9-2f1ee5a3a142 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:52.253717 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2358f8a8-c91d-4215-91b9-2f1ee5a3a142 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:52.254181 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2358f8a8-c91d-4215-91b9-2f1ee5a3a142 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:52.254844 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2358f8a8-c91d-4215-91b9-2f1ee5a3a142 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:52.255292 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2358f8a8-c91d-4215-91b9-2f1ee5a3a142 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:52.255709 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2358f8a8-c91d-4215-91b9-2f1ee5a3a142 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:52.258214 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=84 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:50:52.322807 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2358f8a8-c91d-4215-91b9-2f1ee5a3a142 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:52.330886 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2358f8a8-c91d-4215-91b9-2f1ee5a3a142 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.089373 Aug 04 23:50:52.331438 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1305/2634] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:52 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:53.352096 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-75201554-ae70-4588-adb9-046cdb7fc182 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:53.352701 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-75201554-ae70-4588-adb9-046cdb7fc182 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:53.360476 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-75201554-ae70-4588-adb9-046cdb7fc182 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:53.360965 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-75201554-ae70-4588-adb9-046cdb7fc182 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:53.361399 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-75201554-ae70-4588-adb9-046cdb7fc182 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:53.362089 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-75201554-ae70-4588-adb9-046cdb7fc182 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:53.362595 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-75201554-ae70-4588-adb9-046cdb7fc182 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:53.363020 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-75201554-ae70-4588-adb9-046cdb7fc182 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:53.425658 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-75201554-ae70-4588-adb9-046cdb7fc182 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:53.433372 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-75201554-ae70-4588-adb9-046cdb7fc182 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085207 Aug 04 23:50:53.433934 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1330/2635] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:53 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:54.455929 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-095787b6-3029-45dd-8ddb-adc44fa53c49 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:54.456482 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-095787b6-3029-45dd-8ddb-adc44fa53c49 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:54.462658 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-095787b6-3029-45dd-8ddb-adc44fa53c49 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:54.463134 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-095787b6-3029-45dd-8ddb-adc44fa53c49 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:54.463560 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-095787b6-3029-45dd-8ddb-adc44fa53c49 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:54.464241 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-095787b6-3029-45dd-8ddb-adc44fa53c49 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:54.464712 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-095787b6-3029-45dd-8ddb-adc44fa53c49 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:54.465097 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-095787b6-3029-45dd-8ddb-adc44fa53c49 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:54.529927 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-095787b6-3029-45dd-8ddb-adc44fa53c49 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:54.537522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-095787b6-3029-45dd-8ddb-adc44fa53c49 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087571 Aug 04 23:50:54.538089 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1306/2636] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:54 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:55.559230 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2c2f2486-0f19-4920-ad95-23fcfaf35113 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:55.560455 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2c2f2486-0f19-4920-ad95-23fcfaf35113 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:55.566736 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c2f2486-0f19-4920-ad95-23fcfaf35113 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:55.567210 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c2f2486-0f19-4920-ad95-23fcfaf35113 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:55.567636 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c2f2486-0f19-4920-ad95-23fcfaf35113 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:55.568310 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c2f2486-0f19-4920-ad95-23fcfaf35113 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:55.568756 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c2f2486-0f19-4920-ad95-23fcfaf35113 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:55.569173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2c2f2486-0f19-4920-ad95-23fcfaf35113 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:55.631557 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-2c2f2486-0f19-4920-ad95-23fcfaf35113 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:55.639760 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2c2f2486-0f19-4920-ad95-23fcfaf35113 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084668 Aug 04 23:50:55.640323 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1331/2637] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:55 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:50:56.660602 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-93e93a02-c3e1-4e6f-8e06-617d918e3d3c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:56.661217 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-93e93a02-c3e1-4e6f-8e06-617d918e3d3c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:56.667815 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-93e93a02-c3e1-4e6f-8e06-617d918e3d3c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:56.669829 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-93e93a02-c3e1-4e6f-8e06-617d918e3d3c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:56.670520 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-93e93a02-c3e1-4e6f-8e06-617d918e3d3c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:56.671349 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-93e93a02-c3e1-4e6f-8e06-617d918e3d3c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:56.671826 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-93e93a02-c3e1-4e6f-8e06-617d918e3d3c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:56.672254 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-93e93a02-c3e1-4e6f-8e06-617d918e3d3c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:56.736589 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-93e93a02-c3e1-4e6f-8e06-617d918e3d3c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:56.744296 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-93e93a02-c3e1-4e6f-8e06-617d918e3d3c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087644 Aug 04 23:50:56.744860 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1307/2638] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:56 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:57.765512 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3fa0be87-1000-4230-a472-d653bd06d32a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:57.766118 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3fa0be87-1000-4230-a472-d653bd06d32a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:57.772538 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3fa0be87-1000-4230-a472-d653bd06d32a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:57.773010 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3fa0be87-1000-4230-a472-d653bd06d32a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:57.773442 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3fa0be87-1000-4230-a472-d653bd06d32a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:57.774126 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3fa0be87-1000-4230-a472-d653bd06d32a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:57.774604 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3fa0be87-1000-4230-a472-d653bd06d32a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:57.775040 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3fa0be87-1000-4230-a472-d653bd06d32a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:57.837391 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3fa0be87-1000-4230-a472-d653bd06d32a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:57.845517 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3fa0be87-1000-4230-a472-d653bd06d32a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083859 Aug 04 23:50:57.846071 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1332/2639] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:57 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:58.866969 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-24da5cd9-c3a0-4bbc-8eae-ca7dd227276f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:58.870706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-24da5cd9-c3a0-4bbc-8eae-ca7dd227276f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:58.870706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=28 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:50:58.876175 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24da5cd9-c3a0-4bbc-8eae-ca7dd227276f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:58.876650 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24da5cd9-c3a0-4bbc-8eae-ca7dd227276f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:58.877081 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24da5cd9-c3a0-4bbc-8eae-ca7dd227276f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:58.877761 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24da5cd9-c3a0-4bbc-8eae-ca7dd227276f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:58.878205 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24da5cd9-c3a0-4bbc-8eae-ca7dd227276f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:58.878644 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-24da5cd9-c3a0-4bbc-8eae-ca7dd227276f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:58.940386 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-24da5cd9-c3a0-4bbc-8eae-ca7dd227276f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:50:58.947844 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-24da5cd9-c3a0-4bbc-8eae-ca7dd227276f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084883 Aug 04 23:50:58.948399 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1308/2640] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:58 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:50:59.969232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4c97783d-59c2-405a-9a80-4a9c59f84a6a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:50:59.969836 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4c97783d-59c2-405a-9a80-4a9c59f84a6a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:50:59.976383 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c97783d-59c2-405a-9a80-4a9c59f84a6a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:59.976862 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c97783d-59c2-405a-9a80-4a9c59f84a6a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:59.977287 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c97783d-59c2-405a-9a80-4a9c59f84a6a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:50:59.977964 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c97783d-59c2-405a-9a80-4a9c59f84a6a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:50:59.978554 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c97783d-59c2-405a-9a80-4a9c59f84a6a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:50:59.978987 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4c97783d-59c2-405a-9a80-4a9c59f84a6a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:00.040324 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4c97783d-59c2-405a-9a80-4a9c59f84a6a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:00.048013 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4c97783d-59c2-405a-9a80-4a9c59f84a6a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.082649 Aug 04 23:51:00.048587 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1333/2641] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:50:59 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:01.069434 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-18e88810-069b-4020-b5e6-015fd9b277ee tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:01.070076 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-18e88810-069b-4020-b5e6-015fd9b277ee tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:01.077393 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18e88810-069b-4020-b5e6-015fd9b277ee tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:01.078070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18e88810-069b-4020-b5e6-015fd9b277ee tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:01.078549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18e88810-069b-4020-b5e6-015fd9b277ee tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:01.079241 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18e88810-069b-4020-b5e6-015fd9b277ee tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:01.079689 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18e88810-069b-4020-b5e6-015fd9b277ee tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:01.080136 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-18e88810-069b-4020-b5e6-015fd9b277ee tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:01.145509 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-18e88810-069b-4020-b5e6-015fd9b277ee tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:01.152978 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-18e88810-069b-4020-b5e6-015fd9b277ee tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087449 Aug 04 23:51:01.153529 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1309/2642] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:01 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:02.173733 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a82dad08-2af5-4e93-ac0c-bd9892cf2869 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:02.174345 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a82dad08-2af5-4e93-ac0c-bd9892cf2869 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:02.176628 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=28 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:51:02.181973 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a82dad08-2af5-4e93-ac0c-bd9892cf2869 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:02.182478 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a82dad08-2af5-4e93-ac0c-bd9892cf2869 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:02.182903 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a82dad08-2af5-4e93-ac0c-bd9892cf2869 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:02.183582 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a82dad08-2af5-4e93-ac0c-bd9892cf2869 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:02.184028 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a82dad08-2af5-4e93-ac0c-bd9892cf2869 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:02.184449 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a82dad08-2af5-4e93-ac0c-bd9892cf2869 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:02.247646 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a82dad08-2af5-4e93-ac0c-bd9892cf2869 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:02.255816 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a82dad08-2af5-4e93-ac0c-bd9892cf2869 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086264 Aug 04 23:51:02.256372 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1334/2643] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:02 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:03.277073 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-89a76de9-7196-4090-b963-160c2eb6a0d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:03.277686 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-89a76de9-7196-4090-b963-160c2eb6a0d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:03.284775 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-89a76de9-7196-4090-b963-160c2eb6a0d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:03.285258 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-89a76de9-7196-4090-b963-160c2eb6a0d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:03.285688 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-89a76de9-7196-4090-b963-160c2eb6a0d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:03.286390 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-89a76de9-7196-4090-b963-160c2eb6a0d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:03.286843 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-89a76de9-7196-4090-b963-160c2eb6a0d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:03.287263 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-89a76de9-7196-4090-b963-160c2eb6a0d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:03.350215 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-89a76de9-7196-4090-b963-160c2eb6a0d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:03.357972 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-89a76de9-7196-4090-b963-160c2eb6a0d5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084800 Aug 04 23:51:03.358550 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1310/2644] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:03 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:04.378227 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-31ba7a01-64ab-424a-985a-da72ebe3d467 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:04.378898 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-31ba7a01-64ab-424a-985a-da72ebe3d467 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:04.385292 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31ba7a01-64ab-424a-985a-da72ebe3d467 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:04.385782 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31ba7a01-64ab-424a-985a-da72ebe3d467 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:04.386218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31ba7a01-64ab-424a-985a-da72ebe3d467 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:04.386934 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31ba7a01-64ab-424a-985a-da72ebe3d467 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:04.387390 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31ba7a01-64ab-424a-985a-da72ebe3d467 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:04.387815 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-31ba7a01-64ab-424a-985a-da72ebe3d467 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:04.390331 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=84 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:51:04.450262 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-31ba7a01-64ab-424a-985a-da72ebe3d467 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:04.460221 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-31ba7a01-64ab-424a-985a-da72ebe3d467 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085805 Aug 04 23:51:04.460818 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1335/2645] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:04 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:05.483879 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a012e6d6-30b9-4b81-861c-2042545e2052 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:05.484490 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a012e6d6-30b9-4b81-861c-2042545e2052 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:05.491705 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a012e6d6-30b9-4b81-861c-2042545e2052 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:05.492242 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a012e6d6-30b9-4b81-861c-2042545e2052 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:05.492679 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a012e6d6-30b9-4b81-861c-2042545e2052 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:05.493377 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a012e6d6-30b9-4b81-861c-2042545e2052 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:05.493825 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a012e6d6-30b9-4b81-861c-2042545e2052 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:05.494244 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a012e6d6-30b9-4b81-861c-2042545e2052 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:05.559225 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a012e6d6-30b9-4b81-861c-2042545e2052 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:05.567356 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a012e6d6-30b9-4b81-861c-2042545e2052 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087489 Aug 04 23:51:05.567916 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1311/2646] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:05 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:06.588694 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-e463a5dc-fae2-4947-91a1-051e27b6a245 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:06.589232 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-e463a5dc-fae2-4947-91a1-051e27b6a245 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:06.596134 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e463a5dc-fae2-4947-91a1-051e27b6a245 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:06.596607 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e463a5dc-fae2-4947-91a1-051e27b6a245 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:06.597042 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e463a5dc-fae2-4947-91a1-051e27b6a245 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:06.597716 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e463a5dc-fae2-4947-91a1-051e27b6a245 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:06.598198 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e463a5dc-fae2-4947-91a1-051e27b6a245 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:06.598642 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-e463a5dc-fae2-4947-91a1-051e27b6a245 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:06.664960 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-e463a5dc-fae2-4947-91a1-051e27b6a245 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:06.674605 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-e463a5dc-fae2-4947-91a1-051e27b6a245 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.089777 Aug 04 23:51:06.675173 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1336/2647] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:06 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:07.696118 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-79520e17-83cd-4f35-b169-c6a7248e00d2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:07.696755 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-79520e17-83cd-4f35-b169-c6a7248e00d2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:07.703772 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79520e17-83cd-4f35-b169-c6a7248e00d2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:07.704262 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79520e17-83cd-4f35-b169-c6a7248e00d2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:07.704703 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79520e17-83cd-4f35-b169-c6a7248e00d2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:07.705404 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79520e17-83cd-4f35-b169-c6a7248e00d2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:07.705858 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79520e17-83cd-4f35-b169-c6a7248e00d2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:07.706282 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-79520e17-83cd-4f35-b169-c6a7248e00d2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:07.771124 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-79520e17-83cd-4f35-b169-c6a7248e00d2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:07.779466 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-79520e17-83cd-4f35-b169-c6a7248e00d2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086463 Aug 04 23:51:07.779466 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1312/2648] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:07 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:08.799900 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-424f7740-236a-4a33-a19d-d5854ee1be85 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:08.800518 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-424f7740-236a-4a33-a19d-d5854ee1be85 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:08.807230 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-424f7740-236a-4a33-a19d-d5854ee1be85 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:08.807712 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-424f7740-236a-4a33-a19d-d5854ee1be85 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:08.808148 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-424f7740-236a-4a33-a19d-d5854ee1be85 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:08.808838 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-424f7740-236a-4a33-a19d-d5854ee1be85 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:08.809295 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-424f7740-236a-4a33-a19d-d5854ee1be85 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:08.809723 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-424f7740-236a-4a33-a19d-d5854ee1be85 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:08.871259 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-424f7740-236a-4a33-a19d-d5854ee1be85 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:08.879265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-424f7740-236a-4a33-a19d-d5854ee1be85 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083321 Aug 04 23:51:08.879831 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1337/2649] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:08 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:09.900762 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-829e299c-cf40-4cee-a3fe-0668751c2207 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:09.901370 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-829e299c-cf40-4cee-a3fe-0668751c2207 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:09.908611 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-829e299c-cf40-4cee-a3fe-0668751c2207 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:09.909088 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-829e299c-cf40-4cee-a3fe-0668751c2207 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:09.909520 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-829e299c-cf40-4cee-a3fe-0668751c2207 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:09.910201 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-829e299c-cf40-4cee-a3fe-0668751c2207 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:09.910685 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-829e299c-cf40-4cee-a3fe-0668751c2207 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:09.911105 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-829e299c-cf40-4cee-a3fe-0668751c2207 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:09.975124 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-829e299c-cf40-4cee-a3fe-0668751c2207 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:09.982738 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-829e299c-cf40-4cee-a3fe-0668751c2207 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085840 Aug 04 23:51:09.983317 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1313/2650] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:09 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:10.552244 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:51:10.552745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:51:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:51:11.004520 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b3357d46-df88-428d-a2fa-7b180c37b740 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:11.005134 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b3357d46-df88-428d-a2fa-7b180c37b740 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:11.011841 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3357d46-df88-428d-a2fa-7b180c37b740 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:11.012310 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3357d46-df88-428d-a2fa-7b180c37b740 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:11.012745 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3357d46-df88-428d-a2fa-7b180c37b740 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:11.013446 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3357d46-df88-428d-a2fa-7b180c37b740 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:11.013897 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3357d46-df88-428d-a2fa-7b180c37b740 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:11.014324 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b3357d46-df88-428d-a2fa-7b180c37b740 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:11.076261 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b3357d46-df88-428d-a2fa-7b180c37b740 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:11.084726 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b3357d46-df88-428d-a2fa-7b180c37b740 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084093 Aug 04 23:51:11.085226 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1338/2651] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:10 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:12.106316 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-819f4665-5b3b-4531-9b1b-8c2d96d35270 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:12.106964 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-819f4665-5b3b-4531-9b1b-8c2d96d35270 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:12.113335 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-819f4665-5b3b-4531-9b1b-8c2d96d35270 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:12.113817 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-819f4665-5b3b-4531-9b1b-8c2d96d35270 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:12.114248 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-819f4665-5b3b-4531-9b1b-8c2d96d35270 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:12.114987 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-819f4665-5b3b-4531-9b1b-8c2d96d35270 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:12.115435 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-819f4665-5b3b-4531-9b1b-8c2d96d35270 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:12.115856 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-819f4665-5b3b-4531-9b1b-8c2d96d35270 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:12.178868 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-819f4665-5b3b-4531-9b1b-8c2d96d35270 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:12.186706 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-819f4665-5b3b-4531-9b1b-8c2d96d35270 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084270 Aug 04 23:51:12.187396 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1314/2652] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:12 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:13.207608 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-eb7b5f9e-aea6-49de-a2c7-749b6ed7090c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:13.208226 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-eb7b5f9e-aea6-49de-a2c7-749b6ed7090c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:13.215596 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb7b5f9e-aea6-49de-a2c7-749b6ed7090c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:13.216171 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb7b5f9e-aea6-49de-a2c7-749b6ed7090c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:13.216671 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb7b5f9e-aea6-49de-a2c7-749b6ed7090c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:13.217405 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb7b5f9e-aea6-49de-a2c7-749b6ed7090c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:13.217857 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb7b5f9e-aea6-49de-a2c7-749b6ed7090c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:13.218284 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eb7b5f9e-aea6-49de-a2c7-749b6ed7090c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:13.286918 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-eb7b5f9e-aea6-49de-a2c7-749b6ed7090c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:13.294301 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-eb7b5f9e-aea6-49de-a2c7-749b6ed7090c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.090622 Aug 04 23:51:13.294888 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1339/2653] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:13 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:14.315740 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-2c81529e-dae3-4778-bbf6-f949763f748f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:14.316445 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-2c81529e-dae3-4778-bbf6-f949763f748f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:14.322930 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c81529e-dae3-4778-bbf6-f949763f748f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:14.323522 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c81529e-dae3-4778-bbf6-f949763f748f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:14.324036 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c81529e-dae3-4778-bbf6-f949763f748f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:14.324808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c81529e-dae3-4778-bbf6-f949763f748f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:14.325381 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c81529e-dae3-4778-bbf6-f949763f748f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:14.325880 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-2c81529e-dae3-4778-bbf6-f949763f748f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:14.391466 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-2c81529e-dae3-4778-bbf6-f949763f748f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:14.399137 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-2c81529e-dae3-4778-bbf6-f949763f748f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.088161 Aug 04 23:51:14.399697 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1315/2654] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:14 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:15.420201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-95682d80-552d-4f58-a539-0b9da05edef1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:15.420870 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-95682d80-552d-4f58-a539-0b9da05edef1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:15.428174 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-95682d80-552d-4f58-a539-0b9da05edef1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:15.428654 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-95682d80-552d-4f58-a539-0b9da05edef1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:15.429093 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-95682d80-552d-4f58-a539-0b9da05edef1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:15.429790 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-95682d80-552d-4f58-a539-0b9da05edef1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:15.430242 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-95682d80-552d-4f58-a539-0b9da05edef1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:15.430713 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-95682d80-552d-4f58-a539-0b9da05edef1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:15.495392 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-95682d80-552d-4f58-a539-0b9da05edef1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:15.503040 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-95682d80-552d-4f58-a539-0b9da05edef1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086826 Aug 04 23:51:15.503600 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1340/2655] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:15 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:16.524304 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-7980d049-6380-4db1-aaf5-578320d5db3d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:16.524917 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-7980d049-6380-4db1-aaf5-578320d5db3d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:16.531391 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7980d049-6380-4db1-aaf5-578320d5db3d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:16.531874 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7980d049-6380-4db1-aaf5-578320d5db3d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:16.532310 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7980d049-6380-4db1-aaf5-578320d5db3d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:16.533028 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7980d049-6380-4db1-aaf5-578320d5db3d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:16.533517 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7980d049-6380-4db1-aaf5-578320d5db3d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:16.533940 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-7980d049-6380-4db1-aaf5-578320d5db3d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:16.600513 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-7980d049-6380-4db1-aaf5-578320d5db3d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:16.608067 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-7980d049-6380-4db1-aaf5-578320d5db3d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087665 Aug 04 23:51:16.608629 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1316/2656] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:16 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:17.630385 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-72964469-4c16-4f43-9e3a-bfb7e787ad2a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:17.630992 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-72964469-4c16-4f43-9e3a-bfb7e787ad2a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:17.637380 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72964469-4c16-4f43-9e3a-bfb7e787ad2a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:17.637905 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72964469-4c16-4f43-9e3a-bfb7e787ad2a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:17.638344 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72964469-4c16-4f43-9e3a-bfb7e787ad2a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:17.639054 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72964469-4c16-4f43-9e3a-bfb7e787ad2a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:17.639511 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72964469-4c16-4f43-9e3a-bfb7e787ad2a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:17.639937 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-72964469-4c16-4f43-9e3a-bfb7e787ad2a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:17.700630 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-72964469-4c16-4f43-9e3a-bfb7e787ad2a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:17.709060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-72964469-4c16-4f43-9e3a-bfb7e787ad2a tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083049 Aug 04 23:51:17.709831 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1341/2657] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:17 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:18.731396 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-a7a2a788-9961-41a8-b204-2c60c5b0904e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:18.732007 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-a7a2a788-9961-41a8-b204-2c60c5b0904e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:18.738744 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a7a2a788-9961-41a8-b204-2c60c5b0904e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:18.739226 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a7a2a788-9961-41a8-b204-2c60c5b0904e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:18.739656 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a7a2a788-9961-41a8-b204-2c60c5b0904e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:18.740337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a7a2a788-9961-41a8-b204-2c60c5b0904e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:18.740786 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a7a2a788-9961-41a8-b204-2c60c5b0904e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:18.741204 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-a7a2a788-9961-41a8-b204-2c60c5b0904e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:18.804247 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-a7a2a788-9961-41a8-b204-2c60c5b0904e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:18.812165 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-a7a2a788-9961-41a8-b204-2c60c5b0904e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084625 Aug 04 23:51:18.812726 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1317/2658] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:18 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:19.833044 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c50c1e10-4eff-4368-a83f-df461a22dcc9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:19.834201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c50c1e10-4eff-4368-a83f-df461a22dcc9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:19.840286 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c50c1e10-4eff-4368-a83f-df461a22dcc9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:19.840783 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c50c1e10-4eff-4368-a83f-df461a22dcc9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:19.841252 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c50c1e10-4eff-4368-a83f-df461a22dcc9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:19.841950 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c50c1e10-4eff-4368-a83f-df461a22dcc9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:19.842432 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c50c1e10-4eff-4368-a83f-df461a22dcc9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:19.842888 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c50c1e10-4eff-4368-a83f-df461a22dcc9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:19.908014 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c50c1e10-4eff-4368-a83f-df461a22dcc9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:19.916613 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c50c1e10-4eff-4368-a83f-df461a22dcc9 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087731 Aug 04 23:51:19.917164 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1342/2659] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:19 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:20.937651 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-25ca0b80-9e85-471c-9087-462dece4b0bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:20.938270 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-25ca0b80-9e85-471c-9087-462dece4b0bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:20.945661 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-25ca0b80-9e85-471c-9087-462dece4b0bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:20.946140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-25ca0b80-9e85-471c-9087-462dece4b0bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:20.946604 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-25ca0b80-9e85-471c-9087-462dece4b0bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:20.947298 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-25ca0b80-9e85-471c-9087-462dece4b0bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:20.947747 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-25ca0b80-9e85-471c-9087-462dece4b0bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:20.948171 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-25ca0b80-9e85-471c-9087-462dece4b0bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:21.010760 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-25ca0b80-9e85-471c-9087-462dece4b0bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:21.018242 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-25ca0b80-9e85-471c-9087-462dece4b0bd tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084482 Aug 04 23:51:21.018873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1318/2660] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:20 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:22.038341 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-7500a2e7-414e-4f67-8cac-359da6de2676 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:22.038894 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-7500a2e7-414e-4f67-8cac-359da6de2676 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:22.045516 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7500a2e7-414e-4f67-8cac-359da6de2676 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:22.046023 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7500a2e7-414e-4f67-8cac-359da6de2676 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:22.046494 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7500a2e7-414e-4f67-8cac-359da6de2676 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:22.047218 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7500a2e7-414e-4f67-8cac-359da6de2676 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:22.047664 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7500a2e7-414e-4f67-8cac-359da6de2676 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:22.048079 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-7500a2e7-414e-4f67-8cac-359da6de2676 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:22.113818 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-7500a2e7-414e-4f67-8cac-359da6de2676 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:22.121410 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-7500a2e7-414e-4f67-8cac-359da6de2676 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086995 Aug 04 23:51:22.121972 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1343/2661] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:22 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:23.143391 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-5a0ba3cc-11d4-4dc7-87ff-eeae9d76a8b7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:23.144259 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-5a0ba3cc-11d4-4dc7-87ff-eeae9d76a8b7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:23.150542 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a0ba3cc-11d4-4dc7-87ff-eeae9d76a8b7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:23.151034 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a0ba3cc-11d4-4dc7-87ff-eeae9d76a8b7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:23.151470 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a0ba3cc-11d4-4dc7-87ff-eeae9d76a8b7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:23.152159 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a0ba3cc-11d4-4dc7-87ff-eeae9d76a8b7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:23.152631 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a0ba3cc-11d4-4dc7-87ff-eeae9d76a8b7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:23.153052 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-5a0ba3cc-11d4-4dc7-87ff-eeae9d76a8b7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:23.157035 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=84 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:51:23.218751 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-5a0ba3cc-11d4-4dc7-87ff-eeae9d76a8b7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:23.227439 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-5a0ba3cc-11d4-4dc7-87ff-eeae9d76a8b7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.088657 Aug 04 23:51:23.227999 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1319/2662] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:23 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:23.462793 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:51:23.463024 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:51:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:51:24.248722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-a9f00a34-3f50-4cea-a60a-5a99c4ffce2d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:24.249329 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-a9f00a34-3f50-4cea-a60a-5a99c4ffce2d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:24.255608 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9f00a34-3f50-4cea-a60a-5a99c4ffce2d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:24.256074 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9f00a34-3f50-4cea-a60a-5a99c4ffce2d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:24.256502 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9f00a34-3f50-4cea-a60a-5a99c4ffce2d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:24.257263 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9f00a34-3f50-4cea-a60a-5a99c4ffce2d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:24.257710 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9f00a34-3f50-4cea-a60a-5a99c4ffce2d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:24.258127 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-a9f00a34-3f50-4cea-a60a-5a99c4ffce2d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:24.319279 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-a9f00a34-3f50-4cea-a60a-5a99c4ffce2d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:24.326670 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-a9f00a34-3f50-4cea-a60a-5a99c4ffce2d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.081817 Aug 04 23:51:24.327225 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1344/2663] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:24 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:25.347808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6aeb07cf-25a8-408e-9305-015e363175af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:25.349208 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6aeb07cf-25a8-408e-9305-015e363175af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:25.355690 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6aeb07cf-25a8-408e-9305-015e363175af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:25.356168 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6aeb07cf-25a8-408e-9305-015e363175af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:25.356600 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6aeb07cf-25a8-408e-9305-015e363175af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:25.357283 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6aeb07cf-25a8-408e-9305-015e363175af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:25.357730 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6aeb07cf-25a8-408e-9305-015e363175af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:25.358151 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6aeb07cf-25a8-408e-9305-015e363175af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:25.419523 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6aeb07cf-25a8-408e-9305-015e363175af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:25.427567 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6aeb07cf-25a8-408e-9305-015e363175af tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083689 Aug 04 23:51:25.428116 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1320/2664] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:25 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:26.449338 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-49e8a469-0437-4173-84d1-0c256c30f2e7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:26.449877 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-49e8a469-0437-4173-84d1-0c256c30f2e7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:26.456224 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49e8a469-0437-4173-84d1-0c256c30f2e7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:26.456696 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49e8a469-0437-4173-84d1-0c256c30f2e7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:26.457124 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49e8a469-0437-4173-84d1-0c256c30f2e7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:26.458856 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49e8a469-0437-4173-84d1-0c256c30f2e7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:26.459468 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49e8a469-0437-4173-84d1-0c256c30f2e7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:26.459894 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-49e8a469-0437-4173-84d1-0c256c30f2e7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:26.522312 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-49e8a469-0437-4173-84d1-0c256c30f2e7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:26.529774 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-49e8a469-0437-4173-84d1-0c256c30f2e7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084426 Aug 04 23:51:26.530325 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1345/2665] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:26 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:27.552521 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-66744221-827e-447b-98ae-40c7ce482281 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:27.553166 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-66744221-827e-447b-98ae-40c7ce482281 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:27.559879 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66744221-827e-447b-98ae-40c7ce482281 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:27.560358 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66744221-827e-447b-98ae-40c7ce482281 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:27.560784 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66744221-827e-447b-98ae-40c7ce482281 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:27.561457 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66744221-827e-447b-98ae-40c7ce482281 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:27.561898 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66744221-827e-447b-98ae-40c7ce482281 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:27.562310 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-66744221-827e-447b-98ae-40c7ce482281 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:27.626408 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-66744221-827e-447b-98ae-40c7ce482281 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:27.635141 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-66744221-827e-447b-98ae-40c7ce482281 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087083 Aug 04 23:51:27.635839 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1321/2666] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:27 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:51:28.656744 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-f848233d-075c-4f37-a4ce-5a6544610808 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:28.657256 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-f848233d-075c-4f37-a4ce-5a6544610808 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:28.664705 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f848233d-075c-4f37-a4ce-5a6544610808 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:28.665185 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f848233d-075c-4f37-a4ce-5a6544610808 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:28.665620 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f848233d-075c-4f37-a4ce-5a6544610808 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:28.666319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f848233d-075c-4f37-a4ce-5a6544610808 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:28.666803 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f848233d-075c-4f37-a4ce-5a6544610808 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:28.667225 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-f848233d-075c-4f37-a4ce-5a6544610808 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:28.728732 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-f848233d-075c-4f37-a4ce-5a6544610808 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:28.736248 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-f848233d-075c-4f37-a4ce-5a6544610808 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083459 Aug 04 23:51:28.736808 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1346/2667] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:28 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:29.758209 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b94881a5-cb45-4008-85bc-edd59b4ab3bf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:29.758838 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b94881a5-cb45-4008-85bc-edd59b4ab3bf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:29.761180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=28 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:51:29.766510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b94881a5-cb45-4008-85bc-edd59b4ab3bf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:29.766991 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b94881a5-cb45-4008-85bc-edd59b4ab3bf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:29.767424 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b94881a5-cb45-4008-85bc-edd59b4ab3bf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:29.768114 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b94881a5-cb45-4008-85bc-edd59b4ab3bf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:29.768570 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b94881a5-cb45-4008-85bc-edd59b4ab3bf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:29.768990 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b94881a5-cb45-4008-85bc-edd59b4ab3bf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:29.832745 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b94881a5-cb45-4008-85bc-edd59b4ab3bf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:29.840987 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b94881a5-cb45-4008-85bc-edd59b4ab3bf tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087410 Aug 04 23:51:29.841538 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1322/2668] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:29 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:30.861142 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-3ef251a1-afe7-41c9-a0c6-89e421015557 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:30.861785 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-3ef251a1-afe7-41c9-a0c6-89e421015557 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:30.869264 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3ef251a1-afe7-41c9-a0c6-89e421015557 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:30.869684 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3ef251a1-afe7-41c9-a0c6-89e421015557 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:30.870123 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3ef251a1-afe7-41c9-a0c6-89e421015557 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:30.870860 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3ef251a1-afe7-41c9-a0c6-89e421015557 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:30.871319 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3ef251a1-afe7-41c9-a0c6-89e421015557 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:30.871744 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-3ef251a1-afe7-41c9-a0c6-89e421015557 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:30.936921 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-3ef251a1-afe7-41c9-a0c6-89e421015557 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:30.945615 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-3ef251a1-afe7-41c9-a0c6-89e421015557 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.088312 Aug 04 23:51:30.946172 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1347/2669] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:30 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:51:31.966513 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e87affdf-81b4-497b-9ce3-9e0ef3428394 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:31.967123 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e87affdf-81b4-497b-9ce3-9e0ef3428394 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:31.973633 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e87affdf-81b4-497b-9ce3-9e0ef3428394 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:31.974104 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e87affdf-81b4-497b-9ce3-9e0ef3428394 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:31.975704 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e87affdf-81b4-497b-9ce3-9e0ef3428394 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:31.976412 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e87affdf-81b4-497b-9ce3-9e0ef3428394 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:31.976858 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e87affdf-81b4-497b-9ce3-9e0ef3428394 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:31.977273 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e87affdf-81b4-497b-9ce3-9e0ef3428394 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:32.044344 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e87affdf-81b4-497b-9ce3-9e0ef3428394 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:32.051836 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e87affdf-81b4-497b-9ce3-9e0ef3428394 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.089170 Aug 04 23:51:32.053239 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1323/2670] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:31 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:33.074170 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-076d1cb4-58a6-4bda-9572-97850f9ef9c5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:33.074822 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-076d1cb4-58a6-4bda-9572-97850f9ef9c5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:33.077187 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=28 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:51:33.082600 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-076d1cb4-58a6-4bda-9572-97850f9ef9c5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:33.083083 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-076d1cb4-58a6-4bda-9572-97850f9ef9c5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:33.083517 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-076d1cb4-58a6-4bda-9572-97850f9ef9c5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:33.084946 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-076d1cb4-58a6-4bda-9572-97850f9ef9c5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:33.085428 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-076d1cb4-58a6-4bda-9572-97850f9ef9c5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:33.086006 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-076d1cb4-58a6-4bda-9572-97850f9ef9c5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:33.149407 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-076d1cb4-58a6-4bda-9572-97850f9ef9c5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:33.157201 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-076d1cb4-58a6-4bda-9572-97850f9ef9c5 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086868 Aug 04 23:51:33.157759 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1348/2671] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:33 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:34.178902 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-3947bbfd-2cd6-40a0-80d5-34ff3a1d61f3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:34.179511 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-3947bbfd-2cd6-40a0-80d5-34ff3a1d61f3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:34.186352 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3947bbfd-2cd6-40a0-80d5-34ff3a1d61f3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:34.186856 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3947bbfd-2cd6-40a0-80d5-34ff3a1d61f3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:34.187299 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3947bbfd-2cd6-40a0-80d5-34ff3a1d61f3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:34.187988 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3947bbfd-2cd6-40a0-80d5-34ff3a1d61f3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:34.188441 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3947bbfd-2cd6-40a0-80d5-34ff3a1d61f3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:34.188866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-3947bbfd-2cd6-40a0-80d5-34ff3a1d61f3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:34.250233 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-3947bbfd-2cd6-40a0-80d5-34ff3a1d61f3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:34.257820 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-3947bbfd-2cd6-40a0-80d5-34ff3a1d61f3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083590 Aug 04 23:51:34.258389 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1324/2672] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:34 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:35.278306 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c3fcef90-4a7c-4fa8-a756-a7f6c7c2128f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:35.278957 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c3fcef90-4a7c-4fa8-a756-a7f6c7c2128f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:35.285377 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3fcef90-4a7c-4fa8-a756-a7f6c7c2128f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:35.285862 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3fcef90-4a7c-4fa8-a756-a7f6c7c2128f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:35.286300 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3fcef90-4a7c-4fa8-a756-a7f6c7c2128f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:35.287116 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3fcef90-4a7c-4fa8-a756-a7f6c7c2128f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:35.287651 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3fcef90-4a7c-4fa8-a756-a7f6c7c2128f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:35.287976 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3fcef90-4a7c-4fa8-a756-a7f6c7c2128f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:35.290554 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=84 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:51:35.351258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c3fcef90-4a7c-4fa8-a756-a7f6c7c2128f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:35.358783 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c3fcef90-4a7c-4fa8-a756-a7f6c7c2128f tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084308 Aug 04 23:51:35.359345 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1349/2673] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:35 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:36.380410 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6ccdf2d8-7a2f-4eff-b7d0-de2b1d733de0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:36.381009 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6ccdf2d8-7a2f-4eff-b7d0-de2b1d733de0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:36.387480 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ccdf2d8-7a2f-4eff-b7d0-de2b1d733de0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:36.387963 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ccdf2d8-7a2f-4eff-b7d0-de2b1d733de0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:36.388390 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ccdf2d8-7a2f-4eff-b7d0-de2b1d733de0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:36.389078 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ccdf2d8-7a2f-4eff-b7d0-de2b1d733de0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:36.389535 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ccdf2d8-7a2f-4eff-b7d0-de2b1d733de0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:36.389958 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6ccdf2d8-7a2f-4eff-b7d0-de2b1d733de0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:36.454754 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6ccdf2d8-7a2f-4eff-b7d0-de2b1d733de0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:36.462507 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6ccdf2d8-7a2f-4eff-b7d0-de2b1d733de0 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086055 Aug 04 23:51:36.463070 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1325/2674] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:36 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:51:37.483547 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-73080041-1a63-4fa9-85c2-39fa8c804913 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:37.484149 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-73080041-1a63-4fa9-85c2-39fa8c804913 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:37.491665 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-73080041-1a63-4fa9-85c2-39fa8c804913 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:37.492189 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-73080041-1a63-4fa9-85c2-39fa8c804913 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:37.492666 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-73080041-1a63-4fa9-85c2-39fa8c804913 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:37.493401 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-73080041-1a63-4fa9-85c2-39fa8c804913 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:37.493890 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-73080041-1a63-4fa9-85c2-39fa8c804913 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:37.494354 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-73080041-1a63-4fa9-85c2-39fa8c804913 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:37.556152 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-73080041-1a63-4fa9-85c2-39fa8c804913 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:37.563974 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-73080041-1a63-4fa9-85c2-39fa8c804913 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084305 Aug 04 23:51:37.564527 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1350/2675] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:37 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:38.586448 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e0849256-0817-48ae-a454-885d13ecf22e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:38.586990 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e0849256-0817-48ae-a454-885d13ecf22e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:38.593429 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0849256-0817-48ae-a454-885d13ecf22e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:38.593909 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0849256-0817-48ae-a454-885d13ecf22e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:38.594340 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0849256-0817-48ae-a454-885d13ecf22e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:38.595052 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0849256-0817-48ae-a454-885d13ecf22e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:38.595503 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0849256-0817-48ae-a454-885d13ecf22e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:38.595926 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e0849256-0817-48ae-a454-885d13ecf22e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:38.659479 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e0849256-0817-48ae-a454-885d13ecf22e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:38.667368 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e0849256-0817-48ae-a454-885d13ecf22e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085652 Aug 04 23:51:38.667940 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1326/2676] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:38 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:39.688432 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-ac8cc693-9098-40b8-99b8-be93c47109c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:39.689046 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-ac8cc693-9098-40b8-99b8-be93c47109c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:39.695488 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac8cc693-9098-40b8-99b8-be93c47109c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:39.695971 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac8cc693-9098-40b8-99b8-be93c47109c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:39.696412 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac8cc693-9098-40b8-99b8-be93c47109c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:39.697100 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac8cc693-9098-40b8-99b8-be93c47109c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:39.697560 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac8cc693-9098-40b8-99b8-be93c47109c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:39.697988 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-ac8cc693-9098-40b8-99b8-be93c47109c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:39.760182 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-ac8cc693-9098-40b8-99b8-be93c47109c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:39.768756 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-ac8cc693-9098-40b8-99b8-be93c47109c6 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084178 Aug 04 23:51:39.769370 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1351/2677] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:39 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:40.791601 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-9f1bd7fd-f58a-4855-985d-cf778e8ab9bc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:40.792212 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-9f1bd7fd-f58a-4855-985d-cf778e8ab9bc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:40.798658 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9f1bd7fd-f58a-4855-985d-cf778e8ab9bc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:40.799174 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9f1bd7fd-f58a-4855-985d-cf778e8ab9bc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:40.799626 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9f1bd7fd-f58a-4855-985d-cf778e8ab9bc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:40.800310 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9f1bd7fd-f58a-4855-985d-cf778e8ab9bc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:40.800758 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9f1bd7fd-f58a-4855-985d-cf778e8ab9bc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:40.801180 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-9f1bd7fd-f58a-4855-985d-cf778e8ab9bc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:40.866847 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-9f1bd7fd-f58a-4855-985d-cf778e8ab9bc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:40.874517 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-9f1bd7fd-f58a-4855-985d-cf778e8ab9bc tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087784 Aug 04 23:51:40.875089 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1327/2678] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:40 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:41.099067 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:51:41.099598 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:51:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:51:41.895978 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-83388c1f-f13a-4a13-bbb8-a14a4ed70839 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:41.897180 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-83388c1f-f13a-4a13-bbb8-a14a4ed70839 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:41.904240 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-83388c1f-f13a-4a13-bbb8-a14a4ed70839 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:41.904722 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-83388c1f-f13a-4a13-bbb8-a14a4ed70839 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:41.905163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-83388c1f-f13a-4a13-bbb8-a14a4ed70839 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:41.905891 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-83388c1f-f13a-4a13-bbb8-a14a4ed70839 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:41.906336 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-83388c1f-f13a-4a13-bbb8-a14a4ed70839 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:41.906789 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-83388c1f-f13a-4a13-bbb8-a14a4ed70839 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:41.970791 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-83388c1f-f13a-4a13-bbb8-a14a4ed70839 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:41.978706 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-83388c1f-f13a-4a13-bbb8-a14a4ed70839 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086573 Aug 04 23:51:41.979282 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1352/2679] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:41 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:42.999723 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-374203be-d1ef-4aa8-8e07-b8cc3f4b05ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:43.000332 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-374203be-d1ef-4aa8-8e07-b8cc3f4b05ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:43.007541 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-374203be-d1ef-4aa8-8e07-b8cc3f4b05ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:43.008017 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-374203be-d1ef-4aa8-8e07-b8cc3f4b05ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:43.008446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-374203be-d1ef-4aa8-8e07-b8cc3f4b05ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:43.009129 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-374203be-d1ef-4aa8-8e07-b8cc3f4b05ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:43.009576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-374203be-d1ef-4aa8-8e07-b8cc3f4b05ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:43.010080 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-374203be-d1ef-4aa8-8e07-b8cc3f4b05ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:43.071123 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-374203be-d1ef-4aa8-8e07-b8cc3f4b05ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:43.078647 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-374203be-d1ef-4aa8-8e07-b8cc3f4b05ab tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.082718 Aug 04 23:51:43.079201 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1328/2680] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:42 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:44.100878 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-20170f7a-7ce7-4779-aab9-3da6fc46a18c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:44.101441 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-20170f7a-7ce7-4779-aab9-3da6fc46a18c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:44.108729 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-20170f7a-7ce7-4779-aab9-3da6fc46a18c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:44.109220 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-20170f7a-7ce7-4779-aab9-3da6fc46a18c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:44.109659 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-20170f7a-7ce7-4779-aab9-3da6fc46a18c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:44.110381 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-20170f7a-7ce7-4779-aab9-3da6fc46a18c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:44.110842 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-20170f7a-7ce7-4779-aab9-3da6fc46a18c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:44.111267 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-20170f7a-7ce7-4779-aab9-3da6fc46a18c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:44.174618 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-20170f7a-7ce7-4779-aab9-3da6fc46a18c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:44.182186 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-20170f7a-7ce7-4779-aab9-3da6fc46a18c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086160 Aug 04 23:51:44.183050 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1353/2681] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:44 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:45.203133 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6e324c0a-a187-4df6-9663-61f2071f9937 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:45.203755 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6e324c0a-a187-4df6-9663-61f2071f9937 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:45.212735 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e324c0a-a187-4df6-9663-61f2071f9937 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:45.213221 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e324c0a-a187-4df6-9663-61f2071f9937 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:45.213662 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e324c0a-a187-4df6-9663-61f2071f9937 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:45.214383 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e324c0a-a187-4df6-9663-61f2071f9937 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:45.214844 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e324c0a-a187-4df6-9663-61f2071f9937 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:45.215271 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e324c0a-a187-4df6-9663-61f2071f9937 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:45.278820 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6e324c0a-a187-4df6-9663-61f2071f9937 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:45.286501 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6e324c0a-a187-4df6-9663-61f2071f9937 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087252 Aug 04 23:51:45.288364 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1329/2682] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:45 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:46.308370 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-d1360f55-686f-4012-87a6-509d5dada924 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:46.308973 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-d1360f55-686f-4012-87a6-509d5dada924 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:46.315483 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1360f55-686f-4012-87a6-509d5dada924 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:46.315961 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1360f55-686f-4012-87a6-509d5dada924 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:46.316415 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1360f55-686f-4012-87a6-509d5dada924 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:46.317102 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1360f55-686f-4012-87a6-509d5dada924 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:46.317550 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1360f55-686f-4012-87a6-509d5dada924 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:46.317972 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-d1360f55-686f-4012-87a6-509d5dada924 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:46.382482 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-d1360f55-686f-4012-87a6-509d5dada924 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:46.389935 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-d1360f55-686f-4012-87a6-509d5dada924 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085785 Aug 04 23:51:46.390504 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1354/2683] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:46 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:47.410818 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-53211880-622d-4fba-a7b6-a023647e1278 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:47.411446 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-53211880-622d-4fba-a7b6-a023647e1278 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:47.421238 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-53211880-622d-4fba-a7b6-a023647e1278 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:47.421714 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-53211880-622d-4fba-a7b6-a023647e1278 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:47.422145 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-53211880-622d-4fba-a7b6-a023647e1278 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:47.422865 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-53211880-622d-4fba-a7b6-a023647e1278 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:47.423308 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-53211880-622d-4fba-a7b6-a023647e1278 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:47.423720 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-53211880-622d-4fba-a7b6-a023647e1278 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:47.488440 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-53211880-622d-4fba-a7b6-a023647e1278 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:47.496200 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-53211880-622d-4fba-a7b6-a023647e1278 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.089272 Aug 04 23:51:47.496759 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1330/2684] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:47 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:48.517405 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-9fab3fea-b9b8-4e68-a167-7784e9875de7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:48.517921 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-9fab3fea-b9b8-4e68-a167-7784e9875de7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:48.525045 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9fab3fea-b9b8-4e68-a167-7784e9875de7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:48.525522 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9fab3fea-b9b8-4e68-a167-7784e9875de7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:48.525962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9fab3fea-b9b8-4e68-a167-7784e9875de7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:48.526668 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9fab3fea-b9b8-4e68-a167-7784e9875de7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:48.527121 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9fab3fea-b9b8-4e68-a167-7784e9875de7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:48.527539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-9fab3fea-b9b8-4e68-a167-7784e9875de7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:48.589513 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-9fab3fea-b9b8-4e68-a167-7784e9875de7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:48.597225 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-9fab3fea-b9b8-4e68-a167-7784e9875de7 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083658 Aug 04 23:51:48.597784 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1355/2685] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:48 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:49.619625 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-ad005028-e563-498b-89c6-a2aa9ce1917e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:49.620240 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-ad005028-e563-498b-89c6-a2aa9ce1917e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:49.626705 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad005028-e563-498b-89c6-a2aa9ce1917e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:49.627191 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad005028-e563-498b-89c6-a2aa9ce1917e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:49.627626 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad005028-e563-498b-89c6-a2aa9ce1917e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:49.628314 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad005028-e563-498b-89c6-a2aa9ce1917e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:49.628765 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad005028-e563-498b-89c6-a2aa9ce1917e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:49.629195 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-ad005028-e563-498b-89c6-a2aa9ce1917e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:49.695743 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-ad005028-e563-498b-89c6-a2aa9ce1917e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:49.703274 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-ad005028-e563-498b-89c6-a2aa9ce1917e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.088191 Aug 04 23:51:49.703842 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1331/2686] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:49 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:50.722672 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c2e9982f-1abc-4095-967e-e3036e36329b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:50.723283 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c2e9982f-1abc-4095-967e-e3036e36329b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:50.730272 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c2e9982f-1abc-4095-967e-e3036e36329b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:50.730770 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c2e9982f-1abc-4095-967e-e3036e36329b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:50.731211 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c2e9982f-1abc-4095-967e-e3036e36329b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:50.731902 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c2e9982f-1abc-4095-967e-e3036e36329b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:50.732358 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c2e9982f-1abc-4095-967e-e3036e36329b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:50.732779 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c2e9982f-1abc-4095-967e-e3036e36329b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:50.795564 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c2e9982f-1abc-4095-967e-e3036e36329b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:50.803768 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c2e9982f-1abc-4095-967e-e3036e36329b tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084283 Aug 04 23:51:50.804337 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1356/2687] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:50 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:51.825133 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-be802429-db19-41e4-aee0-cd3adb2f970e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:51.825772 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-be802429-db19-41e4-aee0-cd3adb2f970e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:51.832385 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be802429-db19-41e4-aee0-cd3adb2f970e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:51.832873 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be802429-db19-41e4-aee0-cd3adb2f970e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:51.833309 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be802429-db19-41e4-aee0-cd3adb2f970e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:51.834004 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be802429-db19-41e4-aee0-cd3adb2f970e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:51.835109 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be802429-db19-41e4-aee0-cd3adb2f970e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:51.835819 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-be802429-db19-41e4-aee0-cd3adb2f970e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:51.899785 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-be802429-db19-41e4-aee0-cd3adb2f970e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:51.907344 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-be802429-db19-41e4-aee0-cd3adb2f970e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086096 Aug 04 23:51:51.907896 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1332/2688] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:51 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:52.928930 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-828b6f5a-ad6f-4b5e-b67e-b1011c174661 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:52.929539 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-828b6f5a-ad6f-4b5e-b67e-b1011c174661 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:52.936605 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-828b6f5a-ad6f-4b5e-b67e-b1011c174661 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:52.937085 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-828b6f5a-ad6f-4b5e-b67e-b1011c174661 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:52.937546 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-828b6f5a-ad6f-4b5e-b67e-b1011c174661 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:52.938258 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-828b6f5a-ad6f-4b5e-b67e-b1011c174661 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:52.938736 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-828b6f5a-ad6f-4b5e-b67e-b1011c174661 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:52.939189 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-828b6f5a-ad6f-4b5e-b67e-b1011c174661 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:53.001985 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-828b6f5a-ad6f-4b5e-b67e-b1011c174661 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:53.010527 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-828b6f5a-ad6f-4b5e-b67e-b1011c174661 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085966 Aug 04 23:51:53.011129 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1357/2689] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:52 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:54.032125 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-bd769466-f447-49a6-9840-9372d1bdd4ef tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:54.032732 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-bd769466-f447-49a6-9840-9372d1bdd4ef tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:54.039967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd769466-f447-49a6-9840-9372d1bdd4ef tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:54.040450 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd769466-f447-49a6-9840-9372d1bdd4ef tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:54.040890 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd769466-f447-49a6-9840-9372d1bdd4ef tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:54.041576 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd769466-f447-49a6-9840-9372d1bdd4ef tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:54.042199 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd769466-f447-49a6-9840-9372d1bdd4ef tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:54.042675 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-bd769466-f447-49a6-9840-9372d1bdd4ef tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:54.045347 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_cell1:SELECT=84 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:51:54.110135 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-bd769466-f447-49a6-9840-9372d1bdd4ef tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:54.118534 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-bd769466-f447-49a6-9840-9372d1bdd4ef tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.090817 Aug 04 23:51:54.119111 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1333/2690] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:54 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:51:55.141911 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-56823f14-2b12-4495-bde2-45e82cb3b9ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:55.142485 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-56823f14-2b12-4495-bde2-45e82cb3b9ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:55.149236 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-56823f14-2b12-4495-bde2-45e82cb3b9ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:55.149770 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-56823f14-2b12-4495-bde2-45e82cb3b9ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:55.150157 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-56823f14-2b12-4495-bde2-45e82cb3b9ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:55.150872 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-56823f14-2b12-4495-bde2-45e82cb3b9ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:55.151324 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-56823f14-2b12-4495-bde2-45e82cb3b9ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:55.151743 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-56823f14-2b12-4495-bde2-45e82cb3b9ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:55.213093 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-56823f14-2b12-4495-bde2-45e82cb3b9ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:55.220621 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-56823f14-2b12-4495-bde2-45e82cb3b9ed tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083307 Aug 04 23:51:55.221176 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1358/2691] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:55 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:56.241783 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-d81173c5-ed9f-4db8-841f-3154cd9e8dd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:56.242444 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-d81173c5-ed9f-4db8-841f-3154cd9e8dd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:56.248895 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d81173c5-ed9f-4db8-841f-3154cd9e8dd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:56.249372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d81173c5-ed9f-4db8-841f-3154cd9e8dd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:56.249804 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d81173c5-ed9f-4db8-841f-3154cd9e8dd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:56.250532 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d81173c5-ed9f-4db8-841f-3154cd9e8dd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:56.250985 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d81173c5-ed9f-4db8-841f-3154cd9e8dd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:56.251411 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-d81173c5-ed9f-4db8-841f-3154cd9e8dd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:56.313924 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-d81173c5-ed9f-4db8-841f-3154cd9e8dd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:56.322325 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-d81173c5-ed9f-4db8-841f-3154cd9e8dd1 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085107 Aug 04 23:51:56.322961 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1334/2692] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:56 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:57.343905 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-b299d03d-6d7e-48da-b001-6cbcc7561a33 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:57.344537 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-b299d03d-6d7e-48da-b001-6cbcc7561a33 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:57.351080 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b299d03d-6d7e-48da-b001-6cbcc7561a33 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:57.351566 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b299d03d-6d7e-48da-b001-6cbcc7561a33 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:57.351999 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b299d03d-6d7e-48da-b001-6cbcc7561a33 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:57.353235 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b299d03d-6d7e-48da-b001-6cbcc7561a33 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:57.353750 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b299d03d-6d7e-48da-b001-6cbcc7561a33 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:57.354176 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-b299d03d-6d7e-48da-b001-6cbcc7561a33 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:57.419673 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-b299d03d-6d7e-48da-b001-6cbcc7561a33 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:57.427409 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-b299d03d-6d7e-48da-b001-6cbcc7561a33 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.087322 Aug 04 23:51:57.427977 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1359/2693] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:57 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:58.449288 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-6e43de5e-71da-432f-a754-0247753b9a58 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:58.449885 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-6e43de5e-71da-432f-a754-0247753b9a58 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:58.456337 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e43de5e-71da-432f-a754-0247753b9a58 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:58.456808 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e43de5e-71da-432f-a754-0247753b9a58 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:58.457235 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e43de5e-71da-432f-a754-0247753b9a58 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:58.457919 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e43de5e-71da-432f-a754-0247753b9a58 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:58.458381 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e43de5e-71da-432f-a754-0247753b9a58 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:58.458802 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-6e43de5e-71da-432f-a754-0247753b9a58 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:58.523049 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-6e43de5e-71da-432f-a754-0247753b9a58 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:58.530595 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-6e43de5e-71da-432f-a754-0247753b9a58 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.085717 Aug 04 23:51:58.531145 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1335/2694] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:58 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:51:59.551134 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-4fb04eef-850b-4d38-972d-c9e66b9f2170 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:51:59.551734 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-4fb04eef-850b-4d38-972d-c9e66b9f2170 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:51:59.559064 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4fb04eef-850b-4d38-972d-c9e66b9f2170 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:59.559536 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4fb04eef-850b-4d38-972d-c9e66b9f2170 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:59.559962 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4fb04eef-850b-4d38-972d-c9e66b9f2170 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:59.560638 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4fb04eef-850b-4d38-972d-c9e66b9f2170 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:51:59.561110 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4fb04eef-850b-4d38-972d-c9e66b9f2170 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:51:59.561524 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-4fb04eef-850b-4d38-972d-c9e66b9f2170 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:51:59.849487 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-4fb04eef-850b-4d38-972d-c9e66b9f2170 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:51:59.857206 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-4fb04eef-850b-4d38-972d-c9e66b9f2170 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.309925 Aug 04 23:51:59.857762 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1360/2695] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:51:59 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:52:00.878333 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-e94971c2-7be8-4a36-9805-38d566677662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:52:00.878967 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-e94971c2-7be8-4a36-9805-38d566677662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:52:00.881277 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG dbcounter [-] [129791] Writing DB stats nova_api:SELECT=28 {{(pid=129791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:52:00.887038 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e94971c2-7be8-4a36-9805-38d566677662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:52:00.887510 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e94971c2-7be8-4a36-9805-38d566677662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:52:00.888028 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e94971c2-7be8-4a36-9805-38d566677662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:52:00.888659 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e94971c2-7be8-4a36-9805-38d566677662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:52:00.889059 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e94971c2-7be8-4a36-9805-38d566677662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:52:00.889473 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-e94971c2-7be8-4a36-9805-38d566677662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:52:00.951315 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-e94971c2-7be8-4a36-9805-38d566677662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:52:00.958743 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-e94971c2-7be8-4a36-9805-38d566677662 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.084265 Aug 04 23:52:00.959308 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1336/2696] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:52:00 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:52:01.980753 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-eddb0798-5ab5-4f3f-aab7-a4cfc545c35c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:52:01.981438 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-eddb0798-5ab5-4f3f-aab7-a4cfc545c35c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:52:01.988961 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eddb0798-5ab5-4f3f-aab7-a4cfc545c35c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:52:01.989445 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eddb0798-5ab5-4f3f-aab7-a4cfc545c35c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:52:01.989878 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eddb0798-5ab5-4f3f-aab7-a4cfc545c35c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:52:01.990606 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eddb0798-5ab5-4f3f-aab7-a4cfc545c35c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:52:01.991060 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eddb0798-5ab5-4f3f-aab7-a4cfc545c35c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:52:01.991483 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-eddb0798-5ab5-4f3f-aab7-a4cfc545c35c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:52:02.058260 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-eddb0798-5ab5-4f3f-aab7-a4cfc545c35c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:52:02.066046 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-eddb0798-5ab5-4f3f-aab7-a4cfc545c35c tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.089647 Aug 04 23:52:02.066639 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1361/2697] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:52:01 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:52:03.087408 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-60f5417c-5dc6-4617-8488-66c4223764c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:52:03.089134 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-60f5417c-5dc6-4617-8488-66c4223764c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:52:03.095266 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-60f5417c-5dc6-4617-8488-66c4223764c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:52:03.095746 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-60f5417c-5dc6-4617-8488-66c4223764c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:52:03.096214 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-60f5417c-5dc6-4617-8488-66c4223764c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:52:03.096903 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-60f5417c-5dc6-4617-8488-66c4223764c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:52:03.097354 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-60f5417c-5dc6-4617-8488-66c4223764c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:52:03.097775 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-60f5417c-5dc6-4617-8488-66c4223764c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:52:03.161960 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-60f5417c-5dc6-4617-8488-66c4223764c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:52:03.169646 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-60f5417c-5dc6-4617-8488-66c4223764c3 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086160 Aug 04 23:52:03.170211 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1337/2698] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:52:03 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 23:52:04.190780 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-c3908e8c-a9aa-4044-a4d9-cde749d2388e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:52:04.191385 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-c3908e8c-a9aa-4044-a4d9-cde749d2388e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:52:04.193669 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=28 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:52:04.199855 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3908e8c-a9aa-4044-a4d9-cde749d2388e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:52:04.200338 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3908e8c-a9aa-4044-a4d9-cde749d2388e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:52:04.200769 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3908e8c-a9aa-4044-a4d9-cde749d2388e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:52:04.201450 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3908e8c-a9aa-4044-a4d9-cde749d2388e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:52:04.201900 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3908e8c-a9aa-4044-a4d9-cde749d2388e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:52:04.202318 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-c3908e8c-a9aa-4044-a4d9-cde749d2388e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:52:04.266147 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.policy [None req-c3908e8c-a9aa-4044-a4d9-cde749d2388e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129790) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:52:04.273688 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-c3908e8c-a9aa-4044-a4d9-cde749d2388e tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.086778 Aug 04 23:52:04.274239 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1362/2699] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:52:04 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:52:05.294534 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b9733112-b535-4818-b8f4-c4a2e8a35332 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:52:05.295151 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b9733112-b535-4818-b8f4-c4a2e8a35332 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: ee044da9-1338-4d15-a87d-7fcc18f8354a] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:52:05.301654 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b9733112-b535-4818-b8f4-c4a2e8a35332 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:52:05.302140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b9733112-b535-4818-b8f4-c4a2e8a35332 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:52:05.302613 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b9733112-b535-4818-b8f4-c4a2e8a35332 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:52:05.303307 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b9733112-b535-4818-b8f4-c4a2e8a35332 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:52:05.303759 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b9733112-b535-4818-b8f4-c4a2e8a35332 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:52:05.304182 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b9733112-b535-4818-b8f4-c4a2e8a35332 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:52:05.365693 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.policy [None req-b9733112-b535-4818-b8f4-c4a2e8a35332 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c10802aacf46be91e86b33dff95abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7954e7a03fce4b64b498e68370483def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129791) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 23:52:05.373862 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b9733112-b535-4818-b8f4-c4a2e8a35332 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a" status: 200 len: 1225 microversion: 2.1 time: 0.083595 Aug 04 23:52:05.374438 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1338/2700] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:52:05 2022] GET /compute/v2.1/servers/ee044da9-1338-4d15-a87d-7fcc18f8354a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 23:52:05.845062 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2f57f45b-4074-45f4-9a52-a9b2192b4f5d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:52:05.845615 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.compute.api [None req-2f57f45b-4074-45f4-9a52-a9b2192b4f5d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129790) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:52:05.852404 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f57f45b-4074-45f4-9a52-a9b2192b4f5d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:52:05.852890 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f57f45b-4074-45f4-9a52-a9b2192b4f5d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:52:05.853342 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f57f45b-4074-45f4-9a52-a9b2192b4f5d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:52:05.854155 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f57f45b-4074-45f4-9a52-a9b2192b4f5d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:52:05.854643 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f57f45b-4074-45f4-9a52-a9b2192b4f5d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:52:05.855068 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG oslo_concurrency.lockutils [None req-2f57f45b-4074-45f4-9a52-a9b2192b4f5d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:52:05.858986 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=84 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:52:05.869340 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.wsgi [None req-2f57f45b-4074-45f4-9a52-a9b2192b4f5d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] HTTP exception thrown: Instance 5507ea1e-7623-46eb-9317-03688967021e could not be found. Aug 04 23:52:05.870925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2f57f45b-4074-45f4-9a52-a9b2192b4f5d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Request method failure captured: Aug 04 23:52:05.870925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: request: DELETE /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e HTTP/1.1 Aug 04 23:52:05.870925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept: application/json Aug 04 23:52:05.870925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Accept-Encoding: identity Aug 04 23:52:05.870925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Connection: close Aug 04 23:52:05.870925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Length: 0 Aug 04 23:52:05.870925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Content-Type: application/json Aug 04 23:52:05.870925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Host: 10.222.0.33 Aug 04 23:52:05.870925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Openstack-System-Scope: None Aug 04 23:52:05.870925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: User-Agent: python-urllib3/1.26.11 Aug 04 23:52:05.870925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Auth-Token: gAAAAABi7FNHc_exw7mmzHYR1jyubTtj6G3MhJK1aBBv_3qJmnBeA2R71X6H3jEL0OcZhAhNY3eiubbJ6VTuXvmObZLmnmAiMyaDq4JU4MGDh76KH282SNT6WdOttaYrsLZQcPgr2Ui-0Ak8Q6Al_pRlVdFng0L3ZlY5O11R7R0f4L9nqSD-rbQ Aug 04 23:52:05.870925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Id: None Aug 04 23:52:05.870925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Domain-Name: None Aug 04 23:52:05.870925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Identity-Status: Confirmed Aug 04 23:52:05.870925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Is-Admin-Project: True Aug 04 23:52:05.870925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Id: default Aug 04 23:52:05.870925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Domain-Name: Default Aug 04 23:52:05.870925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Id: 7954e7a03fce4b64b498e68370483def Aug 04 23:52:05.870925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Project-Name: tempest-TestVolumeBootPattern-1875845652 Aug 04 23:52:05.870925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Role: reader,member Aug 04 23:52:05.870925 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Roles: reader,member Aug 04 23:52:05.872294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7954e7a03fce4b64b498e68370483def"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7954e7a03fce4b64b498e68370483def"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7954e7a03fce4b64b498e68370483def"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7954e7a03fce4b64b498e68370483def"}]}] Aug 04 23:52:05.872294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant: tempest-TestVolumeBootPattern-1875845652 Aug 04 23:52:05.872294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Id: 7954e7a03fce4b64b498e68370483def Aug 04 23:52:05.872294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-Tenant-Name: tempest-TestVolumeBootPattern-1875845652 Aug 04 23:52:05.872294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User: tempest-TestVolumeBootPattern-1875845652-project Aug 04 23:52:05.872294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Id: default Aug 04 23:52:05.872294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Domain-Name: Default Aug 04 23:52:05.872294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Id: 95c10802aacf46be91e86b33dff95abc Aug 04 23:52:05.872294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: X-User-Name: tempest-TestVolumeBootPattern-1875845652-project Aug 04 23:52:05.872294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: method: > Aug 04 23:52:05.872294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: exception: Instance 5507ea1e-7623-46eb-9317-03688967021e could not be found. Aug 04 23:52:05.872294 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: action_args: {'id': '5507ea1e-7623-46eb-9317-03688967021e'} Aug 04 23:52:05.873188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:52:05.873188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:52:05.873188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:52:05.873188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:52:05.873188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:52:05.873188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:52:05.873188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:52:05.873188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:52:05.873188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:52:05.873188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:52:05.873188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5507ea1e-7623-46eb-9317-03688967021e could not be found. Aug 04 23:52:05.873188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:52:05.873188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:52:05.873188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:52:05.873188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:52:05.873188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:52:05.873188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:52:05.873188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:52:05.873188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:52:05.873188 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:52:05.874577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:52:05.874577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 23:52:05.874577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 23:52:05.874577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 23:52:05.874577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 23:52:05.874577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:52:05.874577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:52:05.874577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:52:05.874577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:52:05.874577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5507ea1e-7623-46eb-9317-03688967021e could not be found. Aug 04 23:52:05.874577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:52:05.874577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:52:05.874577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:52:05.874577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:52:05.874577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:52:05.874577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:52:05.874577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:52:05.874577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:52:05.874577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5507ea1e-7623-46eb-9317-03688967021e could not be found. Aug 04 23:52:05.874577 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR nova.api.openstack.wsgi Aug 04 23:52:05.875906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-2f57f45b-4074-45f4-9a52-a9b2192b4f5d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Returning 404 to user: Instance 5507ea1e-7623-46eb-9317-03688967021e could not be found. {{(pid=129790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:52:05.875906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-2f57f45b-4074-45f4-9a52-a9b2192b4f5d tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 404 len: 111 microversion: 2.1 time: 0.031163 Aug 04 23:52:05.875906 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1363/2701] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Aug 4 23:52:05 2022] DELETE /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 23:52:05.880936 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b27107e4-6d34-4af3-bba0-a8e35a0ee836 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '>' {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:52:05.881549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.compute.api [None req-b27107e4-6d34-4af3-bba0-a8e35a0ee836 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] [instance: 5507ea1e-7623-46eb-9317-03688967021e] Fetching instance by UUID {{(pid=129791) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 23:52:05.888383 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b27107e4-6d34-4af3-bba0-a8e35a0ee836 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:52:05.888866 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b27107e4-6d34-4af3-bba0-a8e35a0ee836 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:52:05.889304 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b27107e4-6d34-4af3-bba0-a8e35a0ee836 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:52:05.889993 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b27107e4-6d34-4af3-bba0-a8e35a0ee836 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Acquiring lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 23:52:05.890559 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b27107e4-6d34-4af3-bba0-a8e35a0ee836 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 23:52:05.890984 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG oslo_concurrency.lockutils [None req-b27107e4-6d34-4af3-bba0-a8e35a0ee836 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Lock "87c32cd0-6efe-4e80-b8c3-7af92af1b107" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 23:52:05.904668 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.wsgi [None req-b27107e4-6d34-4af3-bba0-a8e35a0ee836 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] HTTP exception thrown: Instance 5507ea1e-7623-46eb-9317-03688967021e could not be found. Aug 04 23:52:05.906190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b27107e4-6d34-4af3-bba0-a8e35a0ee836 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Request method failure captured: Aug 04 23:52:05.906190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: request: GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e HTTP/1.1 Aug 04 23:52:05.906190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept: application/json Aug 04 23:52:05.906190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Accept-Encoding: identity Aug 04 23:52:05.906190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Connection: close Aug 04 23:52:05.906190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Length: 0 Aug 04 23:52:05.906190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Content-Type: application/json Aug 04 23:52:05.906190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Host: 10.222.0.33 Aug 04 23:52:05.906190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Openstack-System-Scope: None Aug 04 23:52:05.906190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: User-Agent: python-urllib3/1.26.11 Aug 04 23:52:05.906190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Auth-Token: gAAAAABi7FNHc_exw7mmzHYR1jyubTtj6G3MhJK1aBBv_3qJmnBeA2R71X6H3jEL0OcZhAhNY3eiubbJ6VTuXvmObZLmnmAiMyaDq4JU4MGDh76KH282SNT6WdOttaYrsLZQcPgr2Ui-0Ak8Q6Al_pRlVdFng0L3ZlY5O11R7R0f4L9nqSD-rbQ Aug 04 23:52:05.906190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Id: None Aug 04 23:52:05.906190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Domain-Name: None Aug 04 23:52:05.906190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Identity-Status: Confirmed Aug 04 23:52:05.906190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Is-Admin-Project: True Aug 04 23:52:05.906190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Id: default Aug 04 23:52:05.906190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Domain-Name: Default Aug 04 23:52:05.906190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Id: 7954e7a03fce4b64b498e68370483def Aug 04 23:52:05.906190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Project-Name: tempest-TestVolumeBootPattern-1875845652 Aug 04 23:52:05.906190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Role: reader,member Aug 04 23:52:05.906190 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Roles: reader,member Aug 04 23:52:05.907627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7954e7a03fce4b64b498e68370483def"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7954e7a03fce4b64b498e68370483def"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7954e7a03fce4b64b498e68370483def"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7954e7a03fce4b64b498e68370483def"}]}] Aug 04 23:52:05.907627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant: tempest-TestVolumeBootPattern-1875845652 Aug 04 23:52:05.907627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Id: 7954e7a03fce4b64b498e68370483def Aug 04 23:52:05.907627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-Tenant-Name: tempest-TestVolumeBootPattern-1875845652 Aug 04 23:52:05.907627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User: tempest-TestVolumeBootPattern-1875845652-project Aug 04 23:52:05.907627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Id: default Aug 04 23:52:05.907627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Domain-Name: Default Aug 04 23:52:05.907627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Id: 95c10802aacf46be91e86b33dff95abc Aug 04 23:52:05.907627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: X-User-Name: tempest-TestVolumeBootPattern-1875845652-project Aug 04 23:52:05.907627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: method: > Aug 04 23:52:05.907627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: exception: Instance 5507ea1e-7623-46eb-9317-03688967021e could not be found. Aug 04 23:52:05.907627 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: action_args: {'id': '5507ea1e-7623-46eb-9317-03688967021e'} Aug 04 23:52:05.908372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: {{(pid=129791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 23:52:05.908372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:52:05.908372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 23:52:05.908372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 23:52:05.908372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 23:52:05.908372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 23:52:05.908372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 23:52:05.908372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 23:52:05.908372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 23:52:05.908372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 23:52:05.908372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5507ea1e-7623-46eb-9317-03688967021e could not be found. Aug 04 23:52:05.908372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:52:05.908372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:52:05.908372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:52:05.908372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:52:05.908372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:52:05.908372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:52:05.908372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 23:52:05.908372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 23:52:05.908372 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 23:52:05.909549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 23:52:05.909549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 23:52:05.909549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 23:52:05.909549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 23:52:05.909549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 23:52:05.909549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 23:52:05.909549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 23:52:05.909549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5507ea1e-7623-46eb-9317-03688967021e could not be found. Aug 04 23:52:05.909549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:52:05.909549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 23:52:05.909549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:52:05.909549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 23:52:05.909549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 23:52:05.909549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 23:52:05.909549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 23:52:05.909549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 23:52:05.909549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5507ea1e-7623-46eb-9317-03688967021e could not be found. Aug 04 23:52:05.909549 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: ERROR nova.api.openstack.wsgi Aug 04 23:52:05.910674 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: DEBUG nova.api.openstack.wsgi [None req-b27107e4-6d34-4af3-bba0-a8e35a0ee836 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Returning 404 to user: Instance 5507ea1e-7623-46eb-9317-03688967021e could not be found. {{(pid=129791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 23:52:05.910674 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO nova.api.openstack.requestlog [None req-b27107e4-6d34-4af3-bba0-a8e35a0ee836 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e" status: 404 len: 111 microversion: 2.1 time: 0.030528 Aug 04 23:52:05.910674 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: [pid: 129791|app: 0|req: 1339/2702] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Aug 4 23:52:05 2022] GET /compute/v2.1/servers/5507ea1e-7623-46eb-9317-03688967021e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 23:53:03.651870 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:53:03.652479 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:53:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:53:23.979905 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:53:23.980511 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:53:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:53:49.567653 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:53:49.568369 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:53:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:54:30.560391 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:54:30.560956 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:54:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:54:43.471464 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:54:43.472021 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:54:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:55:01.107178 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:55:01.107743 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:55:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:56:23.660462 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:56:23.661176 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:56:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:56:43.989177 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:56:43.989769 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:56:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:57:09.576889 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:57:09.577644 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:57:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:57:50.570338 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:57:50.571163 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:57:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:58:03.480696 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:58:03.481305 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Thu Aug 4 23:58:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:58:07.114425 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: ERROR oslo.messaging._drivers.impl_rabbit [-] [62a536c9-a179-45d6-974a-c287dee98d4b] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 23:58:07.118101 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG nova.api.openstack.wsgi [None req-6a954337-940b-4394-b1c7-c7ddd68652d2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] Calling method '.version_select at 0x7f6d25ca3c10>' {{(pid=129790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 23:58:07.122570 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_api:SELECT=3 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:58:07.123301 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: DEBUG dbcounter [-] [129790] Writing DB stats nova_cell1:SELECT=1 {{(pid=129790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 23:58:07.147354 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO nova.api.openstack.requestlog [None req-6a954337-940b-4394-b1c7-c7ddd68652d2 tempest-TestVolumeBootPattern-1875845652 tempest-TestVolumeBootPattern-1875845652-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1320467911" status: 202 len: 0 microversion: 2.1 time: 0.035703 Aug 04 23:58:07.148328 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: [pid: 129790|app: 0|req: 1364/2703] 10.222.0.33 () {58 vars in 1263 bytes} [Thu Aug 4 23:58:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1320467911 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 23:58:21.116228 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:58:21.116780 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:58:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 23:59:43.668618 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 23:59:43.669332 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Thu Aug 4 23:59:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 00:00:03.997140 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 00:00:03.997692 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Fri Aug 5 00:00:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 00:00:29.586547 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 00:00:29.587245 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Fri Aug 5 00:00:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 00:01:10.578265 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 00:01:10.579652 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Fri Aug 5 00:01:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 00:01:23.489854 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 00:01:23.490497 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Fri Aug 5 00:01:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 00:01:41.124135 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 00:01:41.124686 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Fri Aug 5 00:01:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 00:03:03.677939 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 00:03:03.678714 dv-cinder-852210-1-iscsi devstack@n-api.service[129790]: Fri Aug 5 00:03:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 00:03:24.008117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 00:03:24.008117 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Fri Aug 5 00:03:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 00:03:49.594625 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 00:03:49.595339 dv-cinder-852210-1-iscsi devstack@n-api.service[129791]: Fri Aug 5 00:03:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!